Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

4,680

Full-text search

Active filters: gptq

Xu-Ouyang/pythia-12b-deduped-int3-step143000-GPTQ-wikitext2

Text Generation • Updated Jul 1 • 8

acl-srw-2024/llama-3-typhoon-v1.5-8b-instruct-unsloth-sft-epoch-3-gptq-2bit

Text Generation • Updated Jun 29 • 6

acl-srw-2024/llama-3-typhoon-v1.5-8b-instruct-unsloth-sft-epoch-3-gptq-3bit

Text Generation • Updated Jun 29 • 5

acl-srw-2024/llama-3-typhoon-v1.5-8b-instruct-unsloth-sft-epoch-3-gptq-4bit

Text Generation • Updated Jun 29 • 5

acl-srw-2024/llama-3-typhoon-v1.5-8b-instruct-unsloth-sft-epoch-3-gptq-8bit

Text Generation • Updated Jun 29 • 3

agahebr/magnum-gptq-32gs

Text Generation • Updated Jun 29 • 7

acl-srw-2024/openthai-7b-unsloth-gptq-2bit

Text Generation • Updated Jun 30 • 7

acl-srw-2024/openthai-7b-unsloth-gptq-3bit

Text Generation • Updated Jun 30 • 4

acl-srw-2024/openthai-7b-unsloth-gptq-4bit

Text Generation • Updated Jun 30 • 5

acl-srw-2024/openthai-7b-unsloth-gptq-8bit

Text Generation • Updated Jun 30 • 5

Udith-Sandaruwan/opt-125m-gptq-4bit

Text Generation • Updated Jun 30 • 8

Intern95/opt-125m-gptq

Text Generation • Updated Jul 1 • 7

Intern95/opt-350m-gptq

Text Generation • Updated Jul 1 • 8

acl-srw-2024/SeaLLM-7B-v2.5-unsloth-sft-epoch-3-gptq-2bit

Text Generation • Updated Jul 1 • 7

acl-srw-2024/SeaLLM-7B-v2.5-unsloth-sft-epoch-3-gptq-3bit

Text Generation • Updated Jul 1 • 6

ModelCloud/gemma-2-9b-it-gptq-4bit

Text Generation • Updated Jul 9 • 275 • 3

ModelCloud/gemma-2-9b-gptq-4bit

Text Generation • Updated Jul 9 • 36

Granther/Gemma-2-9B-Instruct-4Bit-GPTQ

Text Generation • Updated Jul 8 • 431 • 3

minyichen/Llama-3-Taiwan-70B-Instruct-GPTQ

Text Generation • Updated Aug 1 • 13 • 2

anhduy0911/LLM-IE-Healthcare

Text Generation • Updated Jul 6 • 7

nm-testing/SparseLlama-2-7b-evolcodealpaca-pruned_50.2of4-quantized.w4a16

Text Generation • Updated Jul 2 • 17

gdsaikrishna/Qwen_1.5_Base_gptq_int4_g128_wikitext2

Text Generation • Updated Jul 2 • 8

XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-GPTQ

Text Generation • Updated Jul 9 • 7

BlackSamorez/Meta-Llama-3-70B-Instruct-GPTQ

Text Generation • Updated Jul 16 • 4

lfnothing/opt-125m-gptq

Text Generation • Updated Jul 2 • 11

neuralmagic/Llama-2-7b-chat-quantized.w8a16

Text Generation • Updated Jul 18 • 472

ramitpahwa13/OpenHermes-2.5-Mistral-7B-Pruned50-GPTQ-NO-Marlin

Text Generation • Updated Jul 2 • 3

neuralmagic/Qwen2-0.5B-Instruct-quantized.w8a16

Text Generation • Updated Jul 18 • 29

neuralmagic/Qwen2-1.5B-Instruct-quantized.w8a16

Text Generation • Updated Jul 18 • 8

neuralmagic/Qwen2-7B-Instruct-quantized.w8a16

Text Generation • Updated Jul 18 • 90