Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

4,617

Full-text search

Active filters: gptq

neuralmagic/Qwen2-7B-Instruct-quantized.w4a16

Text Generation • Updated Jul 18 • 434

neuralmagic/Llama-2-7b-chat-quantized.w4a16

Text Generation • Updated Jul 18 • 12

neuralmagic/Meta-Llama-3-70B-Instruct-quantized.w4a16

Text Generation • Updated Aug 29 • 609 • 2

neuralmagic/Meta-Llama-3-8B-Instruct-quantized.w4a16

Text Generation • Updated Jul 18 • 510 • 2

Xu-Ouyang/pythia-410m-deduped-int2-step110000-GPTQ-wikitext2

Text Generation • Updated Jul 11 • 7

Xu-Ouyang/pythia-6.9b-deduped-int2-step36000-GPTQ-wikitext2

Text Generation • Updated Jul 11 • 7

Xu-Ouyang/pythia-410m-deduped-int2-step143000-GPTQ-wikitext2

Text Generation • Updated Jul 11 • 18

Xu-Ouyang/pythia-410m-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • Updated Aug 16 • 11

Xu-Ouyang/pythia-410m-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • Updated Aug 16 • 18

Xu-Ouyang/pythia-410m-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • Updated Aug 16 • 7

Xu-Ouyang/pythia-410m-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • Updated Aug 16 • 7

Xu-Ouyang/pythia-6.9b-deduped-int2-step71000-GPTQ-wikitext2

Text Generation • Updated Jul 11 • 20

Xu-Ouyang/pythia-410m-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • Updated Aug 16 • 7

Xu-Ouyang/pythia-6.9b-deduped-int2-step107000-GPTQ-wikitext2

Text Generation • Updated Jul 12 • 7

Xu-Ouyang/pythia-6.9b-deduped-int2-step110000-GPTQ-wikitext2

Text Generation • Updated Jul 12 • 7

Xu-Ouyang/pythia-6.9b-deduped-int2-step143000-GPTQ-wikitext2

Text Generation • Updated Jul 12 • 7

Xu-Ouyang/pythia-6.9b-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • Updated Aug 17 • 9

Xu-Ouyang/pythia-6.9b-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • Updated Aug 17 • 7

Xu-Ouyang/pythia-6.9b-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • Updated Aug 17 • 7

Xu-Ouyang/pythia-6.9b-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • Updated Aug 17 • 7

Xu-Ouyang/pythia-6.9b-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • Updated Aug 17 • 11

HRuiii/Meta-Llama-3-8B-GPTQ-4bit

Text Generation • Updated Jul 12 • 7

Xu-Ouyang/pythia-160m-deduped-int2-step36000-GPTQ-wikitext2

Text Generation • Updated Jul 12 • 7

Xu-Ouyang/pythia-160m-deduped-int2-step71000-GPTQ-wikitext2

Text Generation • Updated Jul 12 • 7

Xu-Ouyang/pythia-1b-deduped-int2-step36000-GPTQ-wikitext2

Text Generation • Updated Jul 12 • 8

Xu-Ouyang/pythia-160m-deduped-int2-step107000-GPTQ-wikitext2

Text Generation • Updated Jul 12 • 7

Xu-Ouyang/pythia-160m-deduped-int2-step110000-GPTQ-wikitext2

Text Generation • Updated Jul 12 • 8

Xu-Ouyang/pythia-160m-deduped-int2-step143000-GPTQ-wikitext2

Text Generation • Updated Jul 12 • 7

Xu-Ouyang/pythia-1b-deduped-int2-step71000-GPTQ-wikitext2

Text Generation • Updated Jul 13 • 18

Xu-Ouyang/pythia-160m-deduped-int3-step36000-GPTQ-wikitext2

Text Generation • Updated Jul 13 • 7