Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

3,374

Full-text search

Active filters: llama-3

osllmai-community/Hermes-3-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Jan 24 • 8

osllmai-community/Llama-3.1-Storm-8B-bnb-4bit

Text Generation • Updated Jan 24 • 22

mradermacher/Llama3.2-3B-ShiningValiant2-GGUF

Updated Nov 18, 2024 • 212 • 1

mradermacher/Llama3.2-3B-ShiningValiant2-i1-GGUF

Updated Nov 18, 2024 • 8.02k • 2

wonjib/Llama-3.2-1B-Q4_K_M-GGUF

Text Generation • Updated Nov 18, 2024 • 5

wonjib/Llama-3.2-1B-Q5_K_S-GGUF

Text Generation • Updated Nov 18, 2024 • 4

mradermacher/llama-3-8b-256k-PoSE-GGUF

Updated Nov 18, 2024 • 146

mradermacher/llama-3-8b-256k-PoSE-i1-GGUF

Updated Nov 18, 2024 • 154

mlx-community/gradientai_Llama-3-8B-Instruct-Gradient-4194k_4bit

Text Generation • Updated Nov 18, 2024 • 19 • 1

matrixportal/Llama-3.1-8B-Instruct-Q3_K_M-GGUF

Text Generation • Updated Nov 19, 2024 • 5

matrixportal/Llama-3.1-8B-Instruct-IQ3_XXS-GGUF

Text Generation • Updated Nov 25, 2024 • 4

saul95/Llama-3.2-1B-GGUF

Text Generation • Updated Nov 19, 2024 • 14

saul95/Llama-3.2-1B-4.5bpw-exl2

Text Generation • Updated Nov 19, 2024

saul95/Llama-3.2-1B-GPTQ

Text Generation • Updated Nov 19, 2024 • 622

Triangle104/Llama3.2-3B-ShiningValiant2-Q4_K_S-GGUF

Text Generation • Updated Nov 19, 2024 • 9

Triangle104/Llama3.2-3B-ShiningValiant2-Q4_K_M-GGUF

Text Generation • Updated Nov 19, 2024 • 8

Triangle104/Llama3.2-3B-ShiningValiant2-Q5_K_S-GGUF

Text Generation • Updated Nov 19, 2024 • 8

Triangle104/Llama3.2-3B-ShiningValiant2-Q5_K_M-GGUF

Text Generation • Updated Nov 19, 2024 • 11

Triangle104/Llama3.2-3B-ShiningValiant2-Q6_K-GGUF

Text Generation • Updated Nov 19, 2024 • 7

Triangle104/Llama3.2-3B-ShiningValiant2-Q8_0-GGUF

Text Generation • Updated Nov 19, 2024 • 6

Khetterman/Llama-3.2-Kapusta-3B-v8

Text Generation • Updated Nov 20, 2024 • 39 • 1

mradermacher/Llama3.2-3B-Enigma-GGUF

Updated Nov 20, 2024 • 293

mradermacher/Llama3.2-3B-Enigma-i1-GGUF

Updated Nov 20, 2024 • 275

wonjib/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 20, 2024 • 2

wonjib/Llama-3.2-3B-Instruct-Q5_K_S-GGUF

Text Generation • Updated Nov 20, 2024 • 1

wonjib/Llama-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Nov 20, 2024 • 4

Hyeopgeon/Llama-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Nov 20, 2024 • 3

tensorblock/base-eval-GGUF

Text Generation • Updated Nov 20, 2024 • 70

mradermacher/OpenBioLLM-Llama3-70B-GGUF

Updated Dec 15, 2024 • 52

Khetterman/Llama-3.2-Kapusta-JapanChibi-3B-v1

Text Generation • Updated Nov 20, 2024 • 26