Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

4,650

Full-text search

Active filters: gptq

Xu-Ouyang/pythia-12b-deduped-int2-step71000-GPTQ-wikitext2

Text Generation • Updated Jul 10 • 4

Intern95/opt-1.3b-gptq

Text Generation • Updated Jul 10 • 4

Xu-Ouyang/pythia-12b-deduped-int2-step107000-GPTQ-wikitext2

Text Generation • Updated Jul 10 • 4

Xu-Ouyang/pythia-12b-deduped-int2-step110000-GPTQ-wikitext2

Text Generation • Updated Jul 10 • 4

jcorenday/Daredevil-8B-GPTQ

Text Generation • Updated Jul 10 • 3

HRuiii/Meta-Llama-3-8B-GPTQ-8bit

Text Generation • Updated Jul 10 • 8

HRuiii/Meta-Llama-3-8B-Instruct-GPTQ-8bit

Text Generation • Updated Jul 10 • 3

neuralmagic/Mistral-7B-Instruct-v0.3-quantized.w8a16

Text Generation • Updated Jul 18 • 708

Xu-Ouyang/pythia-2.8b-deduped-int2-step36000-GPTQ-wikitext2

Text Generation • Updated Jul 10 • 4

Xu-Ouyang/pythia-2.8b-deduped-int2-step71000-GPTQ-wikitext2

Text Generation • Updated Jul 10 • 4

Xu-Ouyang/pythia-12b-deduped-int2-step143000-GPTQ-wikitext2

Text Generation • Updated Jul 10 • 4

Xu-Ouyang/pythia-2.8b-deduped-int2-step107000-GPTQ-wikitext2

Text Generation • Updated Jul 10 • 4

Xu-Ouyang/pythia-2.8b-deduped-int2-step110000-GPTQ-wikitext2

Text Generation • Updated Jul 10 • 4

Xu-Ouyang/pythia-12b-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • Updated Aug 18 • 17

Xu-Ouyang/pythia-2.8b-deduped-int2-step143000-GPTQ-wikitext2

Text Generation • Updated Jul 10 • 15

Xu-Ouyang/pythia-2.8b-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • Updated Aug 16 • 5

Xu-Ouyang/pythia-2.8b-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • Updated Aug 17 • 15

ShawnFlower/Meta-Llama-3-8B-Instruct-4bit

Text Generation • Updated Jul 11 • 4

Xu-Ouyang/pythia-2.8b-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • Updated Aug 18 • 3

Xu-Ouyang/pythia-12b-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • Updated Aug 18 • 6

Xu-Ouyang/pythia-2.8b-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • Updated Aug 18 • 4

Xu-Ouyang/pythia-2.8b-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • Updated Aug 18 • 3

Xu-Ouyang/pythia-12b-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • Updated Aug 17 • 4

HRuiii/Meta-Llama-3-8B-Instruct-GPTQ-4bit

Text Generation • Updated Jul 11 • 2

Xu-Ouyang/pythia-12b-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • Updated Aug 18 • 4

model-scope/glm-4-9b-chat-GPTQ-Int4

Text Generation • Updated Jul 17 • 81 • 6

Ksgk-fy/eCoach-v1-gptq

Text Generation • Updated Jul 11 • 5

Xu-Ouyang/pythia-12b-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • Updated Aug 18 • 4

Ksgk-fy/maria-v2-gptq

Text Generation • Updated Jul 11

Xu-Ouyang/pythia-410m-deduped-int2-step36000-GPTQ-wikitext2

Text Generation • Updated Jul 11 • 4