LeroyDyer
/

_Spydaz_Web_AI_ChatQA_007_RefinedChat_4_BIT

Text Generation

Question-Answer

Token-Classification

Sequence-Classification

LCARS_AI_StarTrek_Computer

text-generation-inference

chain-of-thought

tree-of-knowledge

forest-of-thoughts

visual-spacial-sketchpad

knowledge-graph

entity-detection

mega-transformers

Mulit-Mega-Merge

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

_Spydaz_Web_AI_ChatQA_007_RefinedChat_4_BIT / generation_config.json

LeroyDyer's picture

Update generation_config.json

170884d verified about 9 hours ago

history blame contribute delete

200 Bytes

	{
	"_from_model_config": true,
	"bos_token_id": 1,
	"do_sample": true,
	"eos_token_id": 2,
	"max_length": 524288,
	"temperature": 0.7,
	"transformers_version": "4.45.1",
	"use_cache": false
	}