JustinLin610
commited on
Commit
•
82e2f71
1
Parent(s):
fe06eec
Update README.md
Browse files
README.md
CHANGED
@@ -17,7 +17,7 @@ tags:
|
|
17 |
|
18 |
Qwen1.5 is the beta version of Qwen2, a transformer-based decoder-only language model pretrained on a large amount of data. In comparison with the previous released Qwen, the improvements include:
|
19 |
|
20 |
-
*
|
21 |
* Significant performance improvement in human preference for chat models;
|
22 |
* Multilingual support of both base and chat models;
|
23 |
* Stable support of 32K context length for models of all sizes
|
|
|
17 |
|
18 |
Qwen1.5 is the beta version of Qwen2, a transformer-based decoder-only language model pretrained on a large amount of data. In comparison with the previous released Qwen, the improvements include:
|
19 |
|
20 |
+
* 8 model sizes, including 0.5B, 1.8B, 4B, 7B, 14B, 32B and 72B dense models, and an MoE model of 14B with 2.7B activated;
|
21 |
* Significant performance improvement in human preference for chat models;
|
22 |
* Multilingual support of both base and chat models;
|
23 |
* Stable support of 32K context length for models of all sizes
|