jklj077 commited on
Commit
20513c8
1 Parent(s): 53114ac

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -20,7 +20,7 @@ Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we rele
20
  - **Long-context Support** up to 128K tokens and can generate up to 8K tokens.
21
  - **Multilingual support** for over 29 languages, including Chinese, English, French, Spanish, Portuguese, German, Italian, Russian, Japanese, Korean, Vietnamese, Thai, Arabic, and more.
22
 
23
- **This repo contains the GPTQ-quantized 4-bit instruction-tuned 3B Qwen2.5 model**, which has the following features:
24
  - Type: Causal Language Models
25
  - Training Stage: Pretraining & Post-training
26
  - Architecture: transformers with RoPE, SwiGLU, RMSNorm, Attention QKV bias and tied word embeddings
 
20
  - **Long-context Support** up to 128K tokens and can generate up to 8K tokens.
21
  - **Multilingual support** for over 29 languages, including Chinese, English, French, Spanish, Portuguese, German, Italian, Russian, Japanese, Korean, Vietnamese, Thai, Arabic, and more.
22
 
23
+ **This repo contains the GPTQ-quantized 8-bit instruction-tuned 3B Qwen2.5 model**, which has the following features:
24
  - Type: Causal Language Models
25
  - Training Stage: Pretraining & Post-training
26
  - Architecture: transformers with RoPE, SwiGLU, RMSNorm, Attention QKV bias and tied word embeddings