Hugging Face's logo

ThomasBaruzier
/
Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation
Transformers
GGUF
PyTorch
facebook
meta
llama
llama-3
Inference Endpoints
imatrix
conversational
Model card Files Community
1
Meta-Llama-3.1-70B-Instruct-GGUF

Commit History

Upload Meta-Llama-3.1-70B-Instruct-Q6_K-00002-of-00002.gguf
74bac70
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-70B-Instruct-Q5_K_M.gguf
175fe5f
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-70B-Instruct-Q5_0.gguf
de25e03
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-70B-Instruct-Q5_K_S.gguf
9223467
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-70B-Instruct-Q4_1.gguf
71e6f93
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-70B-Instruct-Q4_K_M.gguf
7b73ce3
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-70B-Instruct-Q4_K_S.gguf
7fd40e9
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-70B-Instruct-Q4_0.gguf
f922cb0
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-70B-Instruct-IQ4_NL.gguf
278788e
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-70B-Instruct-IQ4_XS.gguf
158c76f
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-70B-Instruct-Q3_K_L.gguf
1cbb967
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-70B-Instruct-Q3_K_M.gguf
4ee2a2f
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-70B-Instruct-IQ3_M.gguf
4c41503
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-70B-Instruct-Q3_K_S.gguf
a397627
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-70B-Instruct-IQ3_S.gguf
d9cfe01
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-70B-Instruct-IQ3_XS.gguf
0667dde
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-70B-Instruct-IQ3_XXS.gguf
cd184b6
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-70B-Instruct-Q2_K.gguf
8c51ef6
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-70B-Instruct-Q2_K_S.gguf
b4988d0
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-70B-Instruct-IQ2_M.gguf
90eadb5
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-70B-Instruct-IQ2_S.gguf
463e1e3
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-70B-Instruct-IQ2_XS.gguf
0c9ed7a
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-70B-Instruct-IQ2_XXS.gguf
66765fc
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-70B-Instruct-IQ1_M.gguf
15026ac
verified

ThomasBaruzier commited on

Rename Meta-Llama-3.1-70B-Instruct-IQ1_S.gguf.fix to Meta-Llama-3.1-70B-Instruct-IQ1_S.gguf
fb8a99b
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-70B-Instruct-IQ1_S.gguf.fix
6b1b02a
verified

ThomasBaruzier commited on

Delete Meta-Llama-3.1-70B-Instruct-F16/Meta-Llama-3.1-70B-Instruct-F16-00003-of-00003.gguf
887b194
verified

ThomasBaruzier commited on

Delete Meta-Llama-3.1-70B-IQ1_S.gguf
b7066ae
verified

ThomasBaruzier commited on

Delete Meta-Llama-3.1-70B-Instruct-F16/Meta-Llama-3.1-70B-Instruct-F16-00002-of-00003.gguf
00e1f13
verified

ThomasBaruzier commited on

Rename ggml-model-IQ1_S.gguf to Meta-Llama-3.1-70B-IQ1_S.gguf
ff9e587
verified

ThomasBaruzier commited on

Upload ggml-model-IQ1_S.gguf to
e04e71b
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-70B-Instruct-F16-00002-of-00003.gguf to Meta-Llama-3.1-70B-Instruct-F16
040231f
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-70B-Instruct-F16-00003-of-00003.gguf to Meta-Llama-3.1-70B-Instruct-F16
d7c1f41
verified

ThomasBaruzier commited on

Upload calibration_datav3.txt
1237252
verified

ThomasBaruzier commited on