Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

17,513

Full-text search

Active filters: 4-bit

rinna/llama-3-youko-8b-instruct-gptq

Text Generation • Updated Aug 31 • 71 • 1

ModelCloud/gemma-2-27b-it-gptq-4bit

Text Generation • Updated Jul 23 • 1.05k • 11

shuyuej/gemma-2-27b-it-GPTQ

Text Generation • Updated Sep 28 • 744 • 2

casperhansen/mistral-nemo-instruct-2407-awq

Text Generation • Updated Sep 27 • 228k • 8

shuyuej/Meta-Llama-3.1-70B-Instruct-GPTQ

Text Generation • Updated Sep 28 • 121 • 3

unsloth/Meta-Llama-3.1-70B-bnb-4bit

Text Generation • Updated 1 day ago • 8.73k • 28

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 29 • 1.85M • 37

unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit

Text Generation • Updated 1 day ago • 20.2k • 26

hugging-quants/Meta-Llama-3.1-70B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7 • 84.5k • 18

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7 • 23.5k • 20

RiversHaveWings/Meta-Llama-3.1-405B-AWQ

Text Generation • Updated Jul 24 • 86 • 6

casperhansen/mistral-large-instruct-2407-awq

Text Generation • Updated Jul 25 • 840 • 4

TechxGenus/Mistral-Large-Instruct-2407-GPTQ

Text Generation • Updated Jul 27 • 617 • 2

SoumilB7/L3_8B_Solana_Smart_Contract_Analyser

Text Generation • Updated Aug 22 • 17 • 1

dahara1/llama3.1-8b-Instruct-awq

Text Generation • Updated Jul 29 • 148 • 3

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • Updated about 1 month ago • 10.5k • 21

shuyuej/SFR-Embedding-2_R-GPTQ

Feature Extraction • Updated 2 days ago • 346 • 1

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16

Text Generation • Updated Oct 10 • 22.5k • 25

MaziyarPanahi/gemma-2-2b-it-GGUF

Text Generation • Updated Aug 1 • 1.84M • 5

openbmb/MiniCPM-V-2_6-int4

Image-Text-to-Text • Updated Sep 25 • 76.1k • 67

SicariusSicariiStuff/Dusk_Rainbow-EXL2-4.0-bpw

Updated Aug 17 • 16 • 1

arcee-ai/deepseek-v2-chat-0628-awq

Updated Aug 17 • 8 • 6

MaziyarPanahi/SmolLM-1.7B-Instruct-v0.2-GGUF

Text Generation • Updated Aug 18 • 1.06M • 7

alicekyting/whisper-large-v3-4bit

Automatic Speech Recognition • Updated Aug 22 • 22 • 1

MaziyarPanahi/Phi-3.5-mini-instruct-GGUF

Text Generation • Updated Aug 20 • 1.84M • 5

alicekyting/Qwen2-Audio-7B-Instruct-4bit

Text2Text Generation • Updated Aug 22 • 197 • 3

pzc163/MiniCPMv2_6-prompt-generator

Updated Aug 24 • 931 • 35

ms57rd/Llama-3.1-8B-quantized-EEG-TimeLLM

Updated Aug 25 • 133 • 7

Qwen/Qwen2-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25 • 297k • 39

Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int4

Image-Text-to-Text • Updated Sep 21 • 134k • 25