Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

2,562

Full-text search

Active filters: llama-3

matrixportal/Llama-3.1-8B-Instruct-Q3_K_M-GGUF

Text Generation • Updated 3 days ago • 25

matrixportal/Llama-3.1-8B-Instruct-IQ3_XXS-GGUF

Text Generation • Updated 3 days ago • 25

saul95/Llama-3.2-1B-GGUF

Text Generation • Updated 3 days ago • 43

saul95/Llama-3.2-1B-4.5bpw-exl2

Text Generation • Updated 3 days ago

saul95/Llama-3.2-1B-GPTQ

Text Generation • Updated 2 days ago • 6

Triangle104/Llama3.2-3B-ShiningValiant2-Q4_K_S-GGUF

Text Generation • Updated 2 days ago • 25

Triangle104/Llama3.2-3B-ShiningValiant2-Q4_K_M-GGUF

Text Generation • Updated 2 days ago • 24

Triangle104/Llama3.2-3B-ShiningValiant2-Q5_K_S-GGUF

Text Generation • Updated 2 days ago • 27

Triangle104/Llama3.2-3B-ShiningValiant2-Q5_K_M-GGUF

Text Generation • Updated 2 days ago • 24

Triangle104/Llama3.2-3B-ShiningValiant2-Q6_K-GGUF

Text Generation • Updated 2 days ago • 24

Triangle104/Llama3.2-3B-ShiningValiant2-Q8_0-GGUF

Text Generation • Updated 2 days ago • 24

Triangle104/Llama3.1-8B-Fireplace2-Q4_K_S-GGUF

Text Generation • Updated 2 days ago • 24

Triangle104/Llama3.1-8B-Fireplace2-Q4_K_M-GGUF

Text Generation • Updated 2 days ago • 27

Triangle104/Llama3.1-8B-Fireplace2-Q5_K_S-GGUF

Text Generation • Updated 2 days ago • 25

matrixportal/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 2 days ago • 4

Khetterman/Llama-3.2-Kapusta-3B-v8-GGUF

Text Generation • Updated about 20 hours ago • 88

mradermacher/Llama3.2-3B-Enigma-GGUF

Updated 1 day ago • 316

mradermacher/Llama3.2-3B-Enigma-i1-GGUF

Updated 1 day ago • 580

wonjib/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 1 day ago • 4

wonjib/Llama-3.2-3B-Instruct-Q5_K_S-GGUF

Text Generation • Updated 1 day ago • 22

wonjib/Llama-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • Updated 1 day ago • 22

Hyeopgeon/Llama-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • Updated 1 day ago • 4

tensorblock/base-eval-GGUF

Text Generation • Updated 1 day ago • 256

mradermacher/OpenBioLLM-Llama3-70B-GGUF

Updated about 16 hours ago • 416

Khetterman/Llama-3.2-Kapusta-JapanChibi-3B-v1

Text Generation • Updated about 20 hours ago • 4

Khetterman/Llama-3.2-Kapusta-JapanChibi-3B-v1-GGUF

Text Generation • Updated about 20 hours ago • 64

mradermacher/OpenBioLLM-Llama3-70B-i1-GGUF

Updated about 8 hours ago • 885

jayakody2000lk/Llama-3.2-3B-Q5_K_M-GGUF

Text Generation • Updated about 13 hours ago • 4

andrejaystevenson/all

Text Generation • Updated about 12 hours ago • 2

KoreaVirtualReality/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated about 10 hours ago