Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,793

Full-text search

Active filters: awq

solidrust/Llama-3-Lumimaid-8B-v0.1-OAS-AWQ

Text Generation • Updated Sep 3 • 7 • 1

dan-kwiat/Codestral-22B-v0.1-hf-FIM-fix-awq

Text Generation • Updated Jun 27 • 13 • 1

hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation • Updated Sep 13 • 123k • 37

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7 • 407k • 60

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7 • 241k • 90

casperhansen/mistral-nemo-instruct-2407-awq

Text Generation • Updated Sep 27 • 228k • 8

RiversHaveWings/Meta-Llama-3.1-405B-AWQ

Text Generation • Updated Jul 24 • 86 • 6

casperhansen/mistral-large-instruct-2407-awq

Text Generation • Updated Jul 25 • 840 • 4

dahara1/llama3.1-8b-Instruct-awq

Text Generation • Updated Jul 29 • 148 • 3

arcee-ai/deepseek-v2-chat-0628-awq

Updated Aug 17 • 8 • 6

Qwen/Qwen2-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25 • 297k • 39

Qwen/Qwen2-VL-2B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 21 • 9.91k • 15

thesven/Phi-3.5-mini-instruct-awq

Updated Aug 29 • 687 • 1

aixsatoshi/c4ai-command-r-plus-08-2024-awq

Updated Sep 2 • 104 • 3

flowaicom/Flow-Judge-v0.1-AWQ

Text Generation • Updated Oct 9 • 1.67k • 6

Qwen/Qwen2.5-0.5B-Instruct-AWQ

Text Generation • Updated Oct 9 • 3.13k • 4

Qwen/Qwen2.5-1.5B-Instruct-AWQ

Text Generation • Updated Oct 9 • 1.97k • 3

Qwen/Qwen2.5-3B-Instruct-AWQ

Text Generation • Updated Oct 9 • 3.51k • 5

Qwen/Qwen2.5-14B-Instruct-AWQ

Text Generation • Updated Oct 9 • 42k • 9

Qwen/Qwen2.5-Coder-1.5B-Instruct-AWQ

Text Generation • Updated 6 days ago • 706 • 2

AMead10/Llama-3.2-1B-Instruct-AWQ

Text Generation • Updated Sep 25 • 31.1k • 3

hugging-quants/gemma-2-9b-it-AWQ-INT4

Text Generation • Updated Oct 17 • 2.23k • 4

WisPerMed/Llama-3.1-SauerkrautLM-70b-Instruct-AWQ

Text Generation • Updated Oct 23 • 150 • 4

peakji/steiner-32b-preview-awq

Updated Oct 21 • 51 • 3

VAGOsolutions/SauerkrautLM-gemma-2-9b-it-awq

Updated Oct 22 • 613 • 1

ibnzterrell/Nvidia-Llama-3.1-Nemotron-70B-Instruct-HF-AWQ-INT4

Text Generation • Updated 24 days ago • 1.69k • 1

joshmiller656/Llama-3.1-Nemotron-70B-Instruct-AWQ-INT4

Text Generation • Updated 18 days ago • 2.91k • 2

Qwen/Qwen2.5-Coder-3B-Instruct-AWQ

Text Generation • Updated 6 days ago • 381 • 2

Qwen/Qwen2.5-Coder-0.5B-Instruct-AWQ

Text Generation • Updated 6 days ago • 203 • 1

Orion-zhen/OpenCoder-8B-Instruct-AWQ

Text Generation • Updated 12 days ago • 107 • 1