ThomasBaruzier
/

Llama-3.3-70B-Instruct-GGUF

Inference Endpoints

Model card Files Files and versions Community

Llama-3.3-70B-Instruct-GGUF

Commit History

Upload Llama-3.3-70B-Instruct-Q4_0_4_4.gguf

9c9348e
verified

ThomasBaruzier commited on 14 days ago

Upload Llama-3.3-70B-Instruct-Q5_0.gguf

d22f862
verified

ThomasBaruzier commited on 14 days ago

Upload Llama-3.3-70B-Instruct-Q4_1.gguf

8238758
verified

ThomasBaruzier commited on 14 days ago

Upload Llama-3.3-70B-Instruct-Q5_K_S.gguf

45b31ef
verified

ThomasBaruzier commited on 14 days ago

Upload Llama-3.3-70B-Instruct-IQ4_NL.gguf

b13108a
verified

ThomasBaruzier commited on 14 days ago

Upload Llama-3.3-70B-Instruct-Q4_K_S.gguf

174e427
verified

ThomasBaruzier commited on 14 days ago

Upload Llama-3.3-70B-Instruct-IQ3_S.gguf

ed36675
verified

ThomasBaruzier commited on 15 days ago

Upload Llama-3.3-70B-Instruct-Q3_K_S.gguf

36688ad
verified

ThomasBaruzier commited on 15 days ago

Upload Llama-3.3-70B-Instruct-IQ3_XS.gguf

1508603
verified

ThomasBaruzier commited on 15 days ago

Upload Llama-3.3-70B-Instruct-Q3_K_L.gguf

a14ca62
verified

ThomasBaruzier commited on 15 days ago

Upload Llama-3.3-70B-Instruct-Q3_K_M.gguf

8a52c28
verified

ThomasBaruzier commited on 15 days ago

Upload Llama-3.3-70B-Instruct-IQ3_M.gguf

a44dcf2
verified

ThomasBaruzier commited on 15 days ago

Upload Llama-3.3-70B-Instruct-IQ2_XS.gguf

e5efeaa
verified

ThomasBaruzier commited on 15 days ago

Upload Llama-3.3-70B-Instruct-Q2_K.gguf

80dcefb
verified

ThomasBaruzier commited on 15 days ago

Upload Llama-3.3-70B-Instruct-IQ2_M.gguf

f796d6d
verified

ThomasBaruzier commited on 15 days ago

Upload Llama-3.3-70B-Instruct-IQ2_S.gguf

d197281
verified

ThomasBaruzier commited on 15 days ago

Upload Llama-3.3-70B-Instruct-IQ2_XXS.gguf

a9c21a8
verified

ThomasBaruzier commited on 15 days ago

Upload Llama-3.3-70B-Instruct-Q2_K_S.gguf

3aefd43
verified

ThomasBaruzier commited on 15 days ago

Upload Llama-3.3-70B-Instruct-IQ1_S.gguf

f7bc094
verified

ThomasBaruzier commited on 15 days ago

Upload Llama-3.3-70B-Instruct-IQ1_M.gguf

15968ba
verified

ThomasBaruzier commited on 15 days ago

Upload Llama-3.3-70B-Instruct-Q4_0.gguf

8b45e3d
verified

ThomasBaruzier commited on 15 days ago

Upload Llama-3.3-70B-Instruct-Q5_K_M.gguf

38117fa
verified

ThomasBaruzier commited on 15 days ago

Update README.md

f9ded46
verified

ThomasBaruzier commited on 15 days ago

Create README.md

7b59eb0
verified

ThomasBaruzier commited on 15 days ago

Upload Llama-3.3-70B-Instruct-Q4_K_M.gguf

9b5305d
verified

ThomasBaruzier commited on 15 days ago

Upload Llama-3.3-70B-Instruct-IQ4_XS.gguf

6f89d47
verified

ThomasBaruzier commited on 15 days ago

Upload Llama-3.3-70B-Instruct-IQ3_XXS.gguf

2f619ea
verified

ThomasBaruzier commited on 16 days ago

Upload imatrix.dat

9c0b7ca
verified

ThomasBaruzier commited on 16 days ago

initial commit

8507a66
verified

ThomasBaruzier commited on 16 days ago