Qwen
/

Qwen2.5-Coder-1.5B-Instruct-GPTQ-Int4

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

cyente commited on 11 days ago

Commit

3c732ce

•

1 Parent(s): 082862a

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -33,7 +33,7 @@ Qwen2.5-Coder is the latest series of Code-Specific Qwen large language models (
 - Number of Paramaters (Non-Embedding): 1.31B
 - Number of Layers: 28
 - Number of Attention Heads (GQA): 12 for Q and 2 for KV
-- Context Length: Full 131,072 tokens
   - Please refer to [this section](#processing-long-texts) for detailed instructions on how to deploy Qwen2.5 for handling long texts.
 - Quantization: GPTQ 4-bit

 - Number of Paramaters (Non-Embedding): 1.31B
 - Number of Layers: 28
 - Number of Attention Heads (GQA): 12 for Q and 2 for KV
+- Context Length: Full 32,768 tokens
   - Please refer to [this section](#processing-long-texts) for detailed instructions on how to deploy Qwen2.5 for handling long texts.
 - Quantization: GPTQ 4-bit