feihu.hf
commited on
Commit
•
0176a16
1
Parent(s):
f57a973
update README.md
Browse files
README.md
CHANGED
@@ -27,7 +27,7 @@ Qwen2.5-Coder is the latest series of Code-Specific Qwen large language models (
|
|
27 |
- A more comprehensive foundation for real-world applications such as **Code Agents**. Not only enhancing coding capabilities but also maintaining its strengths in mathematics and general competencies.
|
28 |
- **Long-context Support** up to 128K tokens.
|
29 |
|
30 |
-
**This repo contains the instruction-tuned 3B Qwen2.5-Coder model in the GGUF
|
31 |
- Type: Causal Language Models
|
32 |
- Training Stage: Pretraining & Post-training
|
33 |
- Architecture: transformers with RoPE, SwiGLU, RMSNorm, Attention QKV bias and tied word embeddings
|
@@ -39,7 +39,7 @@ Qwen2.5-Coder is the latest series of Code-Specific Qwen large language models (
|
|
39 |
- Note: Currently, only vLLM supports YARN for length extrapolating. If you want to process sequences up to 131,072 tokens, please refer to non-GGUF models.
|
40 |
- Quantization: q2_K, q3_K_M, q4_0, q4_K_M, q5_0, q5_K_M, q6_K, q8_0
|
41 |
|
42 |
-
For more details, please refer to our [blog](https://qwenlm.github.io/blog/qwen2.5-coder/), [GitHub](https://github.com/QwenLM/Qwen2.5-Coder), [Documentation](https://qwen.readthedocs.io/en/latest/), [Arxiv](https://arxiv.org/abs/2409.12186).
|
43 |
|
44 |
## Quickstart
|
45 |
|
@@ -69,9 +69,7 @@ For users, to achieve chatbot-like experience, it is recommended to commence in
|
|
69 |
|
70 |
## Evaluation & Performance
|
71 |
|
72 |
-
Detailed evaluation results are reported in this [📑 blog](https://qwenlm.github.io/blog/qwen2.5-coder/).
|
73 |
-
|
74 |
-
For quantized models, the benchmark results against the original bfloat16 models can be found [here](https://qwen.readthedocs.io/en/latest/benchmark/quantization_benchmark.html)
|
75 |
|
76 |
For requirements on GPU memory and the respective throughput, see results [here](https://qwen.readthedocs.io/en/latest/benchmark/speed_benchmark.html).
|
77 |
|
|
|
27 |
- A more comprehensive foundation for real-world applications such as **Code Agents**. Not only enhancing coding capabilities but also maintaining its strengths in mathematics and general competencies.
|
28 |
- **Long-context Support** up to 128K tokens.
|
29 |
|
30 |
+
**This repo contains the instruction-tuned 3B Qwen2.5-Coder model in the GGUF Format**, which has the following features:
|
31 |
- Type: Causal Language Models
|
32 |
- Training Stage: Pretraining & Post-training
|
33 |
- Architecture: transformers with RoPE, SwiGLU, RMSNorm, Attention QKV bias and tied word embeddings
|
|
|
39 |
- Note: Currently, only vLLM supports YARN for length extrapolating. If you want to process sequences up to 131,072 tokens, please refer to non-GGUF models.
|
40 |
- Quantization: q2_K, q3_K_M, q4_0, q4_K_M, q5_0, q5_K_M, q6_K, q8_0
|
41 |
|
42 |
+
For more details, please refer to our [blog](https://qwenlm.github.io/blog/qwen2.5-coder-family/), [GitHub](https://github.com/QwenLM/Qwen2.5-Coder), [Documentation](https://qwen.readthedocs.io/en/latest/), [Arxiv](https://arxiv.org/abs/2409.12186).
|
43 |
|
44 |
## Quickstart
|
45 |
|
|
|
69 |
|
70 |
## Evaluation & Performance
|
71 |
|
72 |
+
Detailed evaluation results are reported in this [📑 blog](https://qwenlm.github.io/blog/qwen2.5-coder-family/).
|
|
|
|
|
73 |
|
74 |
For requirements on GPU memory and the respective throughput, see results [here](https://qwen.readthedocs.io/en/latest/benchmark/speed_benchmark.html).
|
75 |
|