Edit Models filters

Model Tree

meta-llama/Llama-3.2-3B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

136

Full-text search

Active filters: meta-llama/Llama-3.2-3B-Instruct

bartowski/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Oct 8 • 123k • 72

mlx-community/Llama-3.2-3B-Instruct-4bit

Text Generation • Updated Sep 25 • 20k • 15

MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25 • 1.59M • 7

kinetical/llama3.2-3b-simulMT-et-en

Updated 7 days ago • 85 • 2

QuantFactory/Reasoning-Llama-3b-v0.1-GGUF

Updated Oct 13 • 592 • 2

onnx-community/Llama-3.2-3B-Instruct

Text Generation • Updated Oct 8 • 257 • 10

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25 • 6.7k • 14

hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25 • 46.9k • 40

lmstudio-community/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25 • 8.45k • 28

samurai-zero/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25 • 11 • 1

unsloth/Llama-3.2-3B-Instruct-bnb-4bit

Text Generation • Updated Sep 30 • 263k • 13

mlc-ai/Llama-3.2-3B-Instruct-q4f16_1-MLC

Updated Sep 25 • 853 • 2

bartowski/Llama-3.2-3B-Instruct-exl2

Text Generation • Updated Oct 8 • 103 • 4

mlc-ai/Llama-3.2-3B-Instruct-q4f32_1-MLC

Updated Sep 25 • 783 • 1

neuralmagic/Llama-3.2-3B-Instruct-FP8-dynamic

Text Generation • Updated Oct 9 • 1.87k • 2

legraphista/Llama-3.2-3B-Instruct-IMat-GGUF

Text Generation • Updated Sep 25 • 933 • 1

second-state/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26 • 1.38k • 1

gaianet/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25 • 273 • 1

neuralmagic/Llama-3.2-3B-Instruct-FP8

Text Generation • Updated 30 days ago • 10.7k • 2

Solshine/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 26 • 7 • 1

beethogedeon/Llama-3.2-3B-Instruct-Q4_K_S-GGUF

Text Generation • Updated Sep 26 • 6 • 1

Solshine/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 26 • 27 • 1

joshmiller656/Llama3.2-3B-Instruct-AWQ-INT4

Updated Sep 26 • 653 • 1

kingabzpro/llama-3.2-3b-it-Ecommerce-ChatBot

Text Generation • Updated Oct 1 • 300 • 3

QuantFactory/Llama-3.2-Taiwan-Legal-3B-Instruct-GGUF

Text Generation • Updated 13 days ago • 2.2k • 7

QuantFactory/VersatiLlama-Llama-3.2-3B-Instruct-Abliterated-GGUF

Text Generation • Updated Oct 8 • 795 • 3

QuantFactory/Llama3.2-3B-Enigma-GGUF

Text Generation • Updated Oct 8 • 757 • 2

QuantFactory/Llama3.2-3B-ShiningValiant2-GGUF

Text Generation • Updated Oct 8 • 757 • 3

QuantFactory/Llama3.2-3B-Esper2-GGUF

Text Generation • Updated Oct 8 • 663 • 3

QuantFactory/Llama-3.2-3B-Instruct-abliterated-GGUF

Updated Oct 8 • 2.56k • 6