Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

5,454

Full-text search

Active filters: gptq

Qwen/Qwen1.5-14B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 238 • 21

Qwen/Qwen1.5-7B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 148 • 26

Qwen/Qwen1.5-7B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 322 • 18

Qwen/Qwen1.5-4B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 115 • 5

Qwen/Qwen1.5-4B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 145 • 5

Qwen/Qwen1.5-1.8B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 133 • 2

Qwen/Qwen1.5-1.8B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 140 • 7

Qwen/Qwen1.5-0.5B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 173 • 13

Qwen/Qwen1.5-0.5B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 270 • 4

Qwen/Qwen1.5-MoE-A2.7B-Chat-GPTQ-Int4

Text Generation • Updated Jun 9, 2024 • 385 • 44

Qwen/Qwen1.5-32B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 2.92k • 30

explodinggradients/Ragas-critic-llm-Qwen1.5-GPTQ

Text Generation • Updated Apr 8, 2024 • 12

astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit

Text Generation • Updated Apr 22, 2024 • 6.73k • 25

Qwen/Qwen1.5-110B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 68 • 17

IntelLabs/sqft-phi-3-mini-4k-50-base-gptq

Text Generation • Updated about 1 month ago • 582 • 2

neuralmagic/Mistral-7B-Instruct-v0.3-GPTQ-4bit

Text Generation • Updated Jun 10, 2024 • 1.14k • 18

allganize/Llama-3-Alpha-Ko-8B-Instruct-marlin

Text Generation • Updated May 24, 2024 • 38 • 5

cookey39/Five_Phases_Mindset

Text Generation • Updated May 27, 2024 • 65 • 2

cortecs/Mistral-7B-Instruct-v0.3-GPTQ-8b

Text Generation • Updated Jun 18, 2024 • 263 • 1

Qwen/Qwen2-72B-Instruct-GPTQ-Int4

Text Generation • Updated Aug 21, 2024 • 30.1k • 32

Qwen/Qwen2-72B-Instruct-GPTQ-Int8

Text Generation • Updated Aug 21, 2024 • 2.09k • 15

Qwen/Qwen2-57B-A14B-Instruct-GPTQ-Int4

Text Generation • Updated Aug 21, 2024 • 84 • 23

Qwen/Qwen2-1.5B-Instruct-GPTQ-Int4

Text Generation • Updated Aug 21, 2024 • 11.2k • 4

Qwen/Qwen2-1.5B-Instruct-GPTQ-Int8

Text Generation • Updated Aug 21, 2024 • 146 • 4

Qwen/Qwen2-7B-Instruct-GPTQ-Int4

Text Generation • Updated Aug 21, 2024 • 2.56k • 25

Qwen/Qwen2-7B-Instruct-GPTQ-Int8

Text Generation • Updated Aug 21, 2024 • 313 • 17

Qwen/Qwen2-0.5B-Instruct-GPTQ-Int4

Text Generation • Updated Aug 21, 2024 • 1.15k • 13

Qwen/Qwen2-0.5B-Instruct-GPTQ-Int8

Text Generation • Updated Aug 21, 2024 • 58 • 3

IntelLabs/sqft-mistral-7b-v0.3-50-base-gptq

Text Generation • Updated about 1 month ago • 477 • 2

ModelCloud/gemma-2-9b-it-gptq-4bit

Text Generation • Updated Jul 9, 2024 • 160 • 4