Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

26,542

Full-text search

Active filters: 4-bit

janavikhochare/numds-q64

Text Generation • Updated Nov 19, 2023 • 77

TheBloke/LLaMA_2_13B_SFT_v1-GPTQ

Text Generation • Updated Nov 20, 2023 • 19

TheBloke/LLaMA_2_13B_SFT_v1-AWQ

Text Generation • Updated Nov 20, 2023 • 77

Koolchh/Taiwan-LLM-13B-v2.0-chat-4bits-GPTQ

Text Generation • Updated Nov 24, 2023 • 28

s-natsu/octocoder-awq

Text Generation • Updated Nov 20, 2023 • 4

TheBloke/llama2-7B-layla-AWQ

Text Generation • Updated Nov 20, 2023 • 92

TheBloke/llama2-7B-layla-GPTQ

Text Generation • Updated Nov 20, 2023 • 8

TheBloke/mistral-7B-finetuned-orca-dpo-v2-GPTQ

Text Generation • Updated Nov 20, 2023 • 39 • 1

TheBloke/mistral-7B-finetuned-orca-dpo-v2-AWQ

Text Generation • Updated Nov 20, 2023 • 80

heka-ai/zephyr-beta-ft-2000-lr-GPTQ

Text Generation • Updated Nov 20, 2023 • 77

TheBloke/blossom-v3-mistral-7B-GPTQ

Text Generation • Updated Nov 20, 2023 • 6

TheBloke/blossom-v3-mistral-7B-AWQ

Text Generation • Updated Nov 20, 2023 • 83 • 1

TheBloke/Karen_TheEditor_V2_STRICT_Mistral_7B-AWQ

Text Generation • Updated Nov 20, 2023 • 92 • 1

TheBloke/Karen_TheEditor_V2_STRICT_Mistral_7B-GPTQ

Text Generation • Updated Nov 20, 2023 • 28 • 2

TheBloke/GOAT-70B-Storytelling-GPTQ

Text Generation • Updated Nov 20, 2023 • 30 • 4

TheBloke/GOAT-70B-Storytelling-AWQ

Text Generation • Updated Nov 20, 2023 • 13 • 2

marcchew/TinyLLaMA-1.1B-OrcaLaMini-GPTQ

Text Generation • Updated Nov 20, 2023 • 77

heka-ai/zephyr-beta-ft-2000-GPTQ

Text Generation • Updated Nov 20, 2023 • 76

lebe1/opt-125m-4bit

Text Generation • Updated Nov 21, 2023 • 78

TheBloke/Autolycus-Mistral_7B-AWQ

Text Generation • Updated Nov 20, 2023 • 80 • 1

TheBloke/Autolycus-Mistral_7B-GPTQ

Text Generation • Updated Nov 20, 2023 • 7 • 1

TheBloke/Free_Sydney_V2_Mistral_7b-AWQ

Text Generation • Updated Nov 20, 2023 • 85 • 1

TheBloke/Generate_Question_Mistral_7B-AWQ

Text Generation • Updated Nov 20, 2023 • 120 • 2

TheBloke/Free_Sydney_V2_Mistral_7b-GPTQ

Text Generation • Updated Nov 20, 2023 • 26 • 1

TheBloke/Writing_Partner_Mistral_7B-AWQ

Text Generation • Updated Nov 20, 2023 • 95

TheBloke/Generate_Question_Mistral_7B-GPTQ

Text Generation • Updated Nov 20, 2023 • 23 • 3

TheBloke/Writing_Partner_Mistral_7B-GPTQ

Text Generation • Updated Nov 20, 2023 • 25

TheBloke/llama2_7b_merge_orcafamily-AWQ

Text Generation • Updated Nov 20, 2023 • 85

TheBloke/llama2_7b_merge_orcafamily-GPTQ

Text Generation • Updated Nov 20, 2023 • 25

TheBloke/mistral_7b_norobots-GPTQ

Updated Nov 20, 2023