Edit Models filters

Inference Providers

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

5,945

Full-text search

Active filters: awq

PrunaAI/mayflowergmbh-Wiedervereinigung-7b-dpo-laser-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 76

PrunaAI/sambanovasystems-SambaLingo-Japanese-Base-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 74

PrunaAI/sambanovasystems-SambaLingo-Russian-Base-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 77

Udith-Sandaruwan/Llama-3-8B-AWQ-4bit

Text Generation • Updated Jun 30, 2024 • 5

PrunaAI/mrfakename-refusal-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 78

cc8055/tinyllamafullprecision20k-AWQ

Text Generation • Updated Jul 1, 2024 • 8

DavidHuggingFace/Heimer-dpo-TinyLlama-1.1B-AWQ

Text Generation • Updated Jul 1, 2024 • 6

davidsvaughn/feedback-wizard-4bit-awq

Text Generation • Updated Jul 1, 2024 • 27

internlm/internlm2_5-7b-chat-4bit

Text Generation • Updated Jul 2, 2024 • 86 • 5

Weni/ZeroShot-Agents-Llama3-4.0.42-ORPO-AWQ

Text Generation • Updated Jul 2, 2024 • 8

Udith-Sandaruwan/opt-125m-AWQ-4bit

Text Generation • Updated Jul 2, 2024 • 7

Weni/ZeroShot-Agents-Llama3-4.0.43-ORPO-AWQ

Text Generation • Updated Jul 2, 2024 • 21

XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-AWQ

Text Generation • Updated Jul 9, 2024 • 83

Weni/ZeroShot-Agents-Llama3-4.0.44-ORPO-AWQ

Text Generation • Updated Jul 3, 2024 • 9

Weni/ZeroShot-Agents-Llama3-4.0.45-ORPO-AWQ

Text Generation • Updated Jul 3, 2024 • 78

Weni/ZeroShot-Agents-Llama3-4.0.46-ORPO-AWQ

Text Generation • Updated Jul 4, 2024 • 79

OliP/Phi-3-mini-128k-instruct-awq

Text Generation • Updated Jul 9, 2024 • 112 • 2

typealias/internlm2_5-7b-chat-4bit

Text Generation • Updated Jul 3, 2024 • 55

PrunaAI/Sao10K-L3-8B-Chara-v1-Alpha-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 78

PrunaAI/eryk-mazus-polka-1.1b-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 79

bsmit1659/Phi-3-mini-128k-instruct-0.2-awq

Text Generation • Updated Jul 3, 2024 • 109

PrunaAI/mistralai-Mistral-7B-v0.1-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 86

rubra-ai/Meta-Llama-3-70B-Instruct-AWQ

Text Generation • Updated Jul 4, 2024 • 14

ravi-wcg/Llama-3-8B-AWQ-4bit

Text Generation • Updated Jul 4, 2024 • 78

ravi-wcg/Llama-3-8B-Instruct-AWQ-4bit

Text Generation • Updated Jul 4, 2024 • 78

Weni/ZeroShot-Agents-Llama3-4.0.47-SFT-AWQ

Text Generation • Updated Jul 4, 2024 • 80

Weni/ZeroShot-Agents-Llama3-4.0.48-SFT-AWQ

Text Generation • Updated Jul 5, 2024 • 78

Weni/ZeroShot-Agents-Llama3-4.0.49-DPO-AWQ

Text Generation • Updated Jul 5, 2024 • 78

ellamind/qwen2-72b-instruct-awq-de

Text Generation • Updated Jul 22, 2024 • 10

emaibb/magnum-72b-v1-awq

Text Generation • Updated Jul 5, 2024 • 7 • 3