Quantize Phi-3-mini-4k-instruct with llamafile-0.8.4 BF16 8c131bf verified jartine commited on May 10
Quantize Phi-3-mini-4k-instruct with llamafile-0.8.4 Q6_K 842339f verified jartine commited on May 10
Quantize Phi-3-mini-4k-instruct with llamafile-0.8.4 Q5_K_M 3753aa7 verified jartine commited on May 10
Quantize Phi-3-mini-4k-instruct with llamafile-0.8.4 Q5_K_S ad6d2ac verified jartine commited on May 10
Quantize Phi-3-mini-4k-instruct with llamafile-0.8.4 Q4_K_M b01e9af verified jartine commited on May 10
Quantize Phi-3-mini-4k-instruct with llamafile-0.8.4 Q4_K_S b006bb1 verified jartine commited on May 10
Quantize Phi-3-mini-4k-instruct with llamafile-0.8.4 Q3_K_L 9df38b8 verified jartine commited on May 10
Quantize Phi-3-mini-4k-instruct with llamafile-0.8.4 Q3_K_M 02eddc1 verified jartine commited on May 10
Quantize Phi-3-mini-4k-instruct with llamafile-0.8.4 Q3_K_S 1c87afc verified jartine commited on May 10
Quantize Phi-3-mini-4k-instruct with llamafile-0.8.4 Q2_K c0e214f verified jartine commited on May 10
Quantize Phi-3-mini-4k-instruct with llamafile-0.8.4 Q5_1 03f52d9 verified jartine commited on May 10
Quantize Phi-3-mini-4k-instruct with llamafile-0.8.4 Q5_0 7b87f94 verified jartine commited on May 10
Quantize Phi-3-mini-4k-instruct with llamafile-0.8.4 Q4_1 5ad3eb9 verified jartine commited on May 10
Quantize Phi-3-mini-4k-instruct with llamafile-0.8.4 Q8_0 19397ca verified jartine commited on May 10
Quantize Phi-3-mini-4k-instruct with llamafile-0.8.4 Q4_0 112bdc0 verified jartine commited on May 10
Quantize Phi-3-mini-4k-instruct with llamafile-0.8.1 BF16 6e01ba0 verified jartine commited on Apr 26