ThomasBaruzier
/

Llama-3.2-3B-Instruct-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Llama-3.2-3B-Instruct-GGUF

Commit History

Update README.md

4d28c65
verified

ThomasBaruzier commited on 25 days ago

Upload Llama-3.2-3B-Instruct-Q4_0_8_8.gguf

cf9209e
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-Q4_0_4_8.gguf

8c0967f
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-Q4_0_4_4.gguf

67acdc7
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-Q8_0.gguf

1a71eb1
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-Q5_1.gguf

396731b
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-Q5_0.gguf

019b163
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-Q4_1.gguf

98434ec
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-Q4_0.gguf

a344574
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-F16.gguf

ffeda9b
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-Q6_K.gguf

2d0b949
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-Q5_K_S.gguf

75370db
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-Q5_K_M.gguf

8574e18
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-Q4_K_S.gguf

d92a150
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-Q4_K_M.gguf

f620e35
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-IQ4_NL.gguf

c0b3fbd
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-IQ4_XS.gguf

92ca13b
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-Q3_K_S.gguf

cb1c608
verified

ThomasBaruzier commited on Sep 25

Create README.md

ffac611
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-IQ3_S.gguf

c95064b
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-IQ3_XS.gguf

765dc44
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-IQ3_XXS.gguf

d62d2ff
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-Q3_K_L.gguf

b83f31d
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-IQ3_M.gguf

cf4c790
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-Q3_K_M.gguf

b855332
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-IQ2_M.gguf

d530485
verified

ThomasBaruzier commited on Sep 25

Upload perplexity.md

c5f48d3
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-Q2_K.gguf

bd8b910
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-IQ2_S.gguf

91be283
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-Q2_K_S.gguf

e3f4791
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-IQ2_XXS.gguf

289791f
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-IQ2_XS.gguf

85c8566
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-IQ1_M.gguf

0763208
verified

ThomasBaruzier commited on Sep 25

Upload Llama-3.2-3B-Instruct-IQ1_S.gguf

c96a9f3
verified

ThomasBaruzier commited on Sep 25

Upload imatrix.dat

a2017d0
verified

ThomasBaruzier commited on Sep 25

initial commit

4855774
verified

ThomasBaruzier commited on Sep 25