ThomasBaruzier
/

Qwen2.5-3B-Instruct-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Qwen2.5-3B-Instruct-GGUF / .gitattributes

Commit History

Upload Qwen2.5-3B-Instruct-Q4_0_8_8.gguf

744908f
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-Q4_0_4_8.gguf

e682e38
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-Q4_0_4_4.gguf

5b45b93
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-Q8_0.gguf

c1aadc4
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-Q5_1.gguf

56e1602
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-Q5_0.gguf

1d60cf1
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-Q4_1.gguf

aea12b7
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-Q4_0.gguf

c250af4
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-F16.gguf

0c2d05c
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-Q6_K.gguf

fffdcd9
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-Q5_K_M.gguf

44d51a2
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-Q5_K_S.gguf

89e1de9
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-IQ4_XS.gguf

e2c942d
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-Q4_K_S.gguf

15a0937
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-IQ4_NL.gguf

b1c3a5e
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-Q4_K_M.gguf

e2ea540
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-IQ3_XS.gguf

be67f4a
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-Q3_K_M.gguf

9374c21
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-IQ3_S.gguf

570b138
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-IQ3_M.gguf

7be5d4f
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-IQ3_XXS.gguf

4de19df
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-Q3_K_L.gguf

83aefa8
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-Q3_K_S.gguf

02bdf41
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-IQ2_M.gguf

50e607c
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-Q2_K.gguf

9ac10c8
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-IQ2_XXS.gguf

6dcda30
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-Q2_K_S.gguf

43dcd54
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-IQ2_XS.gguf

81c0495
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-IQ2_S.gguf

8cba0aa
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-IQ1_S.gguf

8642287
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-3B-Instruct-IQ1_M.gguf

fce5921
verified

ThomasBaruzier commited on Sep 19

Upload imatrix.dat

f0c5e6c
verified

ThomasBaruzier commited on Sep 19

initial commit

5020c73
verified

ThomasBaruzier commited on Sep 19