Edit Models filters

Inference Providers

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

24,563

Full-text search

Active filters: 4-bit

haes95/lm3-8-bnb-4bit-v1.0

Text Generation • Updated Apr 21, 2024 • 7 • 1

DevsDoCode/LLama-3-8b-Uncensored-4bit

Text Generation • Updated Apr 25, 2024 • 289 • 21

astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit

Text Generation • Updated Apr 22, 2024 • 5.32k • 25

unsloth/llama-3-70b-Instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 1.27k • 42

MaziyarPanahi/Llama-3-8B-Instruct-64k-GGUF

Text Generation • Updated Apr 25, 2024 • 1.01M • 13

PrunaAI/google-gemma-2b-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 80 • 1

unsloth/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 37.8k • 29

IntelLabs/sqft-phi-3-mini-4k-50-base-gptq

Text Generation • Updated 5 days ago • 232 • 2

unsloth/Yi-1.5-6B-bnb-4bit

Text Generation • Updated May 13, 2024 • 77 • 3

Lokesh477/healthcare_llm

Text Generation • Updated May 14, 2024 • 278 • 1

bineric/NorskGPT-Llama-3-70b-adapter

Text Generation • Updated May 21, 2024 • 91 • 6

openbmb/MiniCPM-Llama3-V-2_5-int4

Visual Question Answering • Updated Jul 22, 2024 • 15k • 71

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 1.24M • 79

unsloth/mistral-7b-v0.3-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 18.7k • 15

unsloth/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 137k • 19

neuralmagic/Mistral-7B-Instruct-v0.3-GPTQ-4bit

Text Generation • Updated Jun 10, 2024 • 1.2k • 18

allganize/Llama-3-Alpha-Ko-8B-Instruct-marlin

Text Generation • Updated May 24, 2024 • 19 • 5

unsloth/Phi-3-medium-4k-instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 3.76k • 5

THUDM/cogvlm2-llama3-chat-19B-int4

Text Generation • Updated May 24, 2024 • 1.17k • 28

lllyasviel/omost-llama-3-8b-4bits

Text Generation • Updated May 29, 2024 • 970 • 19

sdasd112132/Vision-8B-MiniCPM-2_5-Uncensored-and-Detailed-4bit

Visual Question Answering • Updated Jun 1, 2024 • 118 • 28

Qwen/Qwen2-72B-Instruct-AWQ

Text Generation • Updated Aug 21, 2024 • 82.9k • 38

Intel/Qwen2-7B-int4-inc

Text Generation • Updated Oct 24, 2024 • 174 • 6

SeacomSrl/SeaPhi3-medium

Text Generation • Updated Jul 15, 2024 • 5.32k • 4

Qwen/Qwen2-7B-Instruct-GPTQ-Int4

Text Generation • Updated Aug 21, 2024 • 2.2k • 24

Qwen/Qwen2-7B-Instruct-AWQ

Text Generation • Updated Aug 21, 2024 • 779 • 20

unsloth/Qwen2-0.5B-Instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 12k • 5

unsloth/Qwen2-1.5B-Instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 5.06k • 2

unsloth/Qwen2-7B-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 4.55k • 4

unsloth/Qwen2-7B-Instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 5.02k • 5