Edit Models filters

Model Tree

meta-llama/Llama-3.2-3B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

36

Full-text search

Active filters: meta-llama/Llama-3.2-3B-Instruct

bartowski/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated 1 day ago • 6.66k • 23

hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated 2 days ago • 1.98k • 20

lmstudio-community/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated 1 day ago • 6.11k • 17

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 2 days ago • 3.15k • 6

unsloth/Llama-3.2-3B-Instruct-bnb-4bit

Text Generation • Updated 1 day ago • 3.23k • 4

mlx-community/Llama-3.2-3B-Instruct-4bit

Text Generation • Updated 1 day ago • 100 • 2

MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated 1 day ago • 236 • 2

samurai-zero/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated 1 day ago • 15 • 1

gaianet/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated 1 day ago • 148 • 1

MCZK/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated 1 day ago • 289 • 1

Solshine/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 1 day ago • 31 • 1

Solshine/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated about 16 hours ago • 50 • 1

paultimothymooney/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 1 day ago • 13

mlc-ai/Llama-3.2-3B-Instruct-q0f16-MLC

Updated 1 day ago • 5

mlc-ai/Llama-3.2-3B-Instruct-q4f16_1-MLC

Updated 1 day ago • 277

mlc-ai/Llama-3.2-3B-Instruct-q0f32-MLC

Updated 1 day ago • 5

mlc-ai/Llama-3.2-3B-Instruct-q4f32_1-MLC

Updated 1 day ago • 204

jxtngx/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 1 day ago • 8

legraphista/Llama-3.2-3B-Instruct-IMat-GGUF

Text Generation • Updated 1 day ago • 663

mukel/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated 1 day ago • 72

second-state/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated 1 day ago • 312

baslak/Llama-3.2-3B-Instruct-ONNX-Q4

Updated 1 day ago • 11

baslak/Llama-3.2-3B-Instruct-ONNX-Q4-F16

Updated 1 day ago • 10

DevQuasar/Llama-3.2-3B-Instruct-GGUF

Updated 1 day ago • 67

mlc-ai/Llama-3.2-3B-Instruct-q4f16_0-MLC

Updated 1 day ago • 139

SandLogicTechnologies/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated 1 day ago • 11

SanctumAI/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated about 22 hours ago • 1.19k

jimjimjimmyjim/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated about 22 hours ago • 13

numen-tech/Llama-3.2-3B-Instruct-w4a16g128asym

Text Generation • Updated about 22 hours ago

paultimothymooney/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated about 20 hours ago • 29