| Qwen2.5-0.5B-Instruct | |
| Quant Size (MB) PPL Size (%) Accuracy (%) PPL error rate | |
| IQ1_S 302 30.0453 0.23714 | |
| IQ1_M 304 24.9151 0.19238 | |
| IQ2_XXS 307 21.4864 0.16704 | |
| IQ2_XS 310 19.7829 0.15355 | |
| IQ2_S 311 19.2041 0.14841 | |
| IQ2_M 314 18.3250 0.14001 | |
| Q2_K_S 316 18.3462 0.14091 | |
| IQ3_XXS 319 16.9784 0.12828 | |
| Q3_K_S 323 17.7765 0.13668 | |
| IQ3_S 323 16.3794 0.12173 | |
| IQ3_XS 323 16.3794 0.12173 | |
| Q2_K 323 17.6841 0.13561 | |
| IQ3_M 327 16.3667 0.12182 | |
| IQ4_XS 334 15.8792 0.11933 | |
| IQ4_NL 337 15.8468 0.11921 | |
| Q4_0 337 17.1007 0.13053 | |
| Q3_K_M 339 15.8499 0.11934 | |
| Q3_K_L 353 15.7298 0.11820 | |
| Q4_1 358 16.1819 0.12328 | |
| Q4_K_S 368 15.5497 0.11716 | |
| Q5_0 380 15.5038 0.11702 | |
| Q4_K_M 380 15.4428 0.11637 | |
| Q5_K_S 394 15.5266 0.11682 | |
| Q5_1 400 15.4875 0.11641 | |
| Q5_K_M 401 15.4788 0.11631 | |
| Q6_K 483 15.2145 0.11422 | |
| Q8_0 507 15.2390 0.11452 | |
| F16 949 15.1819 0.11400 | |