Edit Models filters

Inference Providers

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

24,566

Full-text search

Active filters: 4-bit

casperhansen/mistral-nemo-instruct-2407-awq

Text Generation • Updated Sep 27, 2024 • 45.8k • 9

unsloth/Meta-Llama-3.1-8B-bnb-4bit

Text Generation • Updated 2 days ago • 241k • 94

ModelCloud/Meta-Llama-3.1-8B-Instruct-gptq-4bit

Text Generation • Updated Jul 29, 2024 • 1.51k • 4

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • Updated 2 days ago • 751k • 56

unsloth/Meta-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 6.23k • 31

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 23, 2024 • 1.03M • 17

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 29, 2024 • 1.04M • 39

unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 10.7k • 29

unsloth/Meta-Llama-3.1-405B-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 278k • 16

shuyuej/Mistral-Nemo-Instruct-2407-GPTQ

Text Generation • Updated Jul 25, 2024 • 4.64k • 5

PrunaAI/Aratako-Oumuamua-7b-RP-bnb-4bit-smashed

Text Generation • Updated Jul 24, 2024 • 84 • 1

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • Updated Dec 17, 2024 • 521k • 24

solidrust/Meta-Llama-3.1-8B-Instruct-abliterated-AWQ

Text Generation • Updated Sep 3, 2024 • 195 • 3

unsloth/gemma-2-2b-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 14.9k • 8

unsloth/gemma-2-2b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 16.6k • 15

MaziyarPanahi/gemma-2-2b-it-GGUF

Text Generation • Updated Aug 1, 2024 • 1.07M • 13

openbmb/MiniCPM-V-2_6-int4

Image-Text-to-Text • Updated Jan 15 • 153k • 74

unsloth/Qwen2-Math-1.5B-bnb-4bit

Text Generation • Updated Aug 8, 2024 • 64 • 1

unsloth/Qwen2-Math-7B-Instruct-bnb-4bit

Text Generation • Updated Aug 8, 2024 • 62 • 1

unsloth/Qwen2-Math-7B-bnb-4bit

Text Generation • Updated Aug 8, 2024 • 58 • 1

unsloth/Qwen2-Math-1.5B-Instruct-bnb-4bit

Text Generation • Updated Aug 8, 2024 • 70 • 1

PrunaAI/IlyaGusev-gemma-2-2b-it-abliterated-bnb-4bit-smashed

Updated Aug 14, 2024 • 12 • 1

LoneStriker/Hermes-3-Llama-3.1-8B-4.0bpw-h6-exl2

Updated Aug 15, 2024 • 5 • 1

informatiker/Hermes-3-Llama-3.1-8B-4bit

Updated Aug 15, 2024 • 16 • 2

LoneStriker/Hermes-3-Llama-3.1-70B-4.0bpw-h6-exl2

Updated Aug 16, 2024 • 6 • 1

PrunaAI/Writer-palmyra-base-bnb-4bit-smashed

Updated Aug 20, 2024 • 12 • 1

unsloth/Phi-3.5-mini-instruct-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 35.8k • 11

Statuo/NemoMix-Unleashed-EXL2-4bpw

Text Generation • Updated Aug 23, 2024 • 109 • 8

pzc163/MiniCPMv2_6-prompt-generator

Updated Aug 24, 2024 • 382 • 42

ms57rd/Llama-3.1-8B-quantized-EEG-TimeLLM

Updated Aug 25, 2024 • 26 • 9