perplexity.md

Qwen2.5-0.5B-Instruct
Quant	Size (MB)	PPL	Size (%)	Accuracy (%)	PPL error rate
IQ1_S	302	30.0453			0.23714
IQ1_M	304	24.9151			0.19238
IQ2_XXS	307	21.4864			0.16704
IQ2_XS	310	19.7829			0.15355
IQ2_S	311	19.2041			0.14841
IQ2_M	314	18.3250			0.14001
Q2_K_S	316	18.3462			0.14091
IQ3_XXS	319	16.9784			0.12828
Q3_K_S	323	17.7765			0.13668
IQ3_S	323	16.3794			0.12173
IQ3_XS	323	16.3794			0.12173
Q2_K	323	17.6841			0.13561
IQ3_M	327	16.3667			0.12182
IQ4_XS	334	15.8792			0.11933
IQ4_NL	337	15.8468			0.11921
Q4_0	337	17.1007			0.13053
Q3_K_M	339	15.8499			0.11934
Q3_K_L	353	15.7298			0.11820
Q4_1	358	16.1819			0.12328
Q4_K_S	368	15.5497			0.11716
Q5_0	380	15.5038			0.11702
Q4_K_M	380	15.4428			0.11637
Q5_K_S	394	15.5266			0.11682
Q5_1	400	15.4875			0.11641
Q5_K_M	401	15.4788			0.11631
Q6_K	483	15.2145			0.11422
Q8_0	507	15.2390			0.11452
F16	949	15.1819			0.11400