ThomasBaruzier
/

Qwen2.5-7B-Instruct-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Qwen2.5-7B-Instruct-GGUF / .gitattributes

Commit History

Upload Qwen2.5-7B-Instruct-Q4_0_8_8.gguf

a3ff4b1
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-Q4_0_4_8.gguf

ef16618
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-Q4_0_4_4.gguf

b372e5f
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-Q8_0.gguf

a48ee35
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-Q5_1.gguf

b927c8e
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-Q5_0.gguf

190fa09
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-Q4_1.gguf

82d9d33
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-Q4_0.gguf

2d88afd
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-F16.gguf

17b148c
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-Q6_K.gguf

81a58ba
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-Q5_K_S.gguf

2a2ba59
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-Q5_K_M.gguf

4fdf565
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-Q4_K_S.gguf

1410cc3
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-IQ4_NL.gguf

96e0a4a
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-IQ4_XS.gguf

f4dbe6d
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-Q4_K_M.gguf

0a4bd8b
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-IQ3_M.gguf

efc024e
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-Q3_K_L.gguf

247e95b
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-IQ3_XXS.gguf

0b3c9c7
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-Q3_K_S.gguf

474e8ed
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-Q3_K_M.gguf

b2eb626
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-IQ3_S.gguf

807dcf2
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-IQ3_XS.gguf

7e03d34
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-IQ2_XXS.gguf

5c0ad80
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-Q2_K.gguf

14d9ad3
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-IQ2_M.gguf

909bcd7
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-IQ2_S.gguf

9e5502d
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-Q2_K_S.gguf

1641195
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-IQ2_XS.gguf

3c6e228
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-IQ1_S.gguf

c8a73c6
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-7B-Instruct-IQ1_M.gguf

264ec11
verified

ThomasBaruzier commited on Sep 19

Upload imatrix.dat

c9e9d2f
verified

ThomasBaruzier commited on Sep 19

initial commit

c3fee72
verified

ThomasBaruzier commited on Sep 19