Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

2,963

Full-text search

Active filters: meta

jwiggerthale/Llama-3.2-3B-Instruct-Q2_K-GGUF

Text Generation • Updated 17 days ago • 5

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_awq-int4-gs128-sym

Text Generation • Updated 17 days ago • 16

jwiggerthale/Llama-3.2-3B-Instruct-Q4_0-GGUF

Text Generation • Updated 17 days ago • 106

fbaldassarri/meta-llama_Llama-3.2-1B-Instruct-auto_awq-int4-gs128-asym

Text Generation • Updated 17 days ago • 22

fbaldassarri/meta-llama_Llama-3.2-1B-Instruct-auto_awq-int4-gs128-sym

Text Generation • Updated 17 days ago • 18

fbaldassarri/meta-llama_Llama-3.2-1B-auto_round-int4-gs128-asym

Text Generation • Updated 17 days ago • 168

fbaldassarri/meta-llama_Llama-3.2-1B-auto_round-int4-gs128-sym

Text Generation • Updated 17 days ago • 36

BronioInt/Lake-1

Text Generation • Updated 16 days ago • 10

fbaldassarri/meta-llama_Llama-3.2-1B-auto_gptq-int4-gs128-asym

Text Generation • Updated 17 days ago • 18

fbaldassarri/meta-llama_Llama-3.2-1B-auto_gptq-int4-gs128-sym

Text Generation • Updated 17 days ago • 19

spicychickennoodles/Llama-3.2-1B-Alpaca

Text Generation • Updated 17 days ago • 23

fbaldassarri/meta-llama_Llama-3.2-1B-auto_awq-int4-gs128-asym

Text Generation • Updated 17 days ago • 22

fbaldassarri/meta-llama_Llama-3.2-1B-auto_awq-int4-gs128-sym

Text Generation • Updated 17 days ago • 21

tensorblock/Meta-Llama-3.1-70B-Instruct-bf16-CORRECTED-GGUF

Text Generation • Updated 16 days ago • 344

smaluk/maluk-whatsapp

Text Generation • Updated 15 days ago • 92

ContaAI/ContaLLM-Beauty-8B-Instruct

Text Generation • Updated about 4 hours ago • 52 • 1

ContaAI/ContaLLM-Beauty-8B-Instruct-8bit

Text Generation • Updated about 4 hours ago • 33 • 1

ContaAI/ContaLLM-Beauty-8B-Instruct-4bit

Text Generation • Updated about 4 hours ago • 51 • 1

mradermacher/GOAT-70B-Storytelling-GGUF

Updated 15 days ago • 175

fbaldassarri/meta-llama_Llama-3.2-3B-auto_round-int4-gs128-asym

Text Generation • Updated 15 days ago • 11

fbaldassarri/meta-llama_Llama-3.2-3B-auto_round-int4-gs128-sym

Text Generation • Updated 15 days ago • 10

fbaldassarri/meta-llama_Llama-3.2-3B-auto_gptq-int4-gs128-asym

Text Generation • Updated 15 days ago • 10

fbaldassarri/meta-llama_Llama-3.2-3B-auto_gptq-int4-gs128-sym

Text Generation • Updated 15 days ago • 10

fbaldassarri/meta-llama_Llama-3.2-3B-auto_awq-int4-gs128-asym

Text Generation • Updated 15 days ago • 9

fbaldassarri/meta-llama_Llama-3.2-3B-auto_awq-int4-gs128-sym

Text Generation • Updated 15 days ago • 10

shashikanth-a/Llama-3.2-11B-Vision-4bit

Image-Text-to-Text • Updated 15 days ago • 23

AIFunOver/Llama-Guard-3-1B-openvino-fp16

Text Generation • Updated 14 days ago • 15

AIFunOver/Llama-Guard-3-1B-openvino-8bit

Text Generation • Updated 14 days ago • 9

AIFunOver/Llama-Guard-3-1B-openvino-4bit

Text Generation • Updated 14 days ago • 8

tarabukinivan/llama3.2

Text Generation • Updated Oct 24 • 19