Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

26,536

Full-text search

Active filters: 4-bit

solidrust/Meta-Llama-3.1-8B-Instruct-abliterated-AWQ

Text Generation • Updated Sep 3, 2024 • 94 • 3

ashishkgpian/BioLlama3

Text Generation • Updated Jul 30, 2024 • 25 • 1

unsloth/gemma-2-2b-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 15.9k • 10

unsloth/gemma-2-2b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 16.5k • 15

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16

Text Generation • Updated about 1 month ago • 16k • 31

MaziyarPanahi/gemma-2-2b-it-GGUF

Text Generation • Updated Aug 1, 2024 • 2.4M • 13

HelpMumHQ/MamaBot-Llama

Text Generation • Updated Sep 10, 2024 • 91 • 2

unsloth/Qwen2-Math-1.5B-bnb-4bit

Text Generation • Updated Aug 8, 2024 • 72 • 1

unsloth/Qwen2-Math-7B-Instruct-bnb-4bit

Text Generation • Updated Aug 8, 2024 • 72 • 1

unsloth/Qwen2-Math-7B-bnb-4bit

Text Generation • Updated Aug 8, 2024 • 68 • 1

unsloth/Qwen2-Math-1.5B-Instruct-bnb-4bit

Text Generation • Updated Aug 8, 2024 • 78 • 1

Sergei6000/Qwen2-Audio-7B-Instruct-Int4

Updated Aug 10, 2024 • 303 • 6

PrunaAI/IlyaGusev-gemma-2-2b-it-abliterated-bnb-4bit-smashed

Updated Aug 14, 2024 • 25 • 1

LoneStriker/Hermes-3-Llama-3.1-8B-4.0bpw-h6-exl2

Updated Aug 15, 2024 • 16 • 1

informatiker/Hermes-3-Llama-3.1-8B-4bit

Updated Aug 15, 2024 • 24 • 2

LoneStriker/Hermes-3-Llama-3.1-70B-4.0bpw-h6-exl2

Updated Aug 16, 2024 • 12 • 1

PrunaAI/OuteAI-Lite-Oute-1-300M-Instruct-bnb-4bit-smashed

Updated Aug 16, 2024 • 11 • 1

PrunaAI/Writer-palmyra-base-bnb-4bit-smashed

Updated Aug 20, 2024 • 12 • 1

unsloth/Phi-3.5-mini-instruct-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 30.8k • 13

Statuo/NemoMix-Unleashed-EXL2-4bpw

Text Generation • Updated Aug 23, 2024 • 71 • 8

pzc163/MiniCPMv2_6-prompt-generator

Updated Aug 24, 2024 • 481 • 43

ms57rd/Llama-3.1-8B-quantized-EEG-TimeLLM

Updated Aug 25, 2024 • 39 • 11

IntelLabs/sqft-qa-sparsepeft-mistral-7b-v0.3-50-gptq-gsm8k-heu

Text Generation • Updated about 1 month ago • 323 • 2

IntelLabs/sqft-qa-sparsepeft-mistral-7b-v0.3-50-gptq-math-heu

Text Generation • Updated about 1 month ago • 178 • 3

IntelLabs/sqft-qa-sparsepeft-phi-3-mini-4k-50-gptq-math-heu

Text Generation • Updated about 1 month ago • 177 • 2

IntelLabs/sqft-qa-sparsepeft-phi-3-mini-4k-50-gptq-cs-heu

Text Generation • Updated about 1 month ago • 459 • 2

Qwen/Qwen2-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25, 2024 • 61k • 48

Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int4

Image-Text-to-Text • Updated Sep 21, 2024 • 49.3k • 35

Qwen/Qwen2-VL-2B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 21, 2024 • 5.7k • 21

Qwen/Qwen2-VL-2B-Instruct-GPTQ-Int4

Image-Text-to-Text • Updated Sep 21, 2024 • 6.45k • 24