Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

26,542

Full-text search

Active filters: 4-bit

TheBloke/opus-v0.5-70B-AWQ

Text Generation • Updated Nov 18, 2023 • 15 • 1

Trelis/Yi-34B-200K-Llamafied-chat-SFT-AWQ

Text Generation • Updated Nov 26, 2023

TheBloke/Nanbeige-16B-Chat-32K-GPTQ

Text Generation • Updated Nov 18, 2023 • 33 • 3

TheBloke/nsql-llama-2-7B-AWQ

Text Generation • Updated Nov 18, 2023 • 65

TheBloke/nsql-llama-2-7B-GPTQ

Text Generation • Updated Nov 18, 2023 • 182

TheBloke/nucleus-22B-token-500B-GPTQ

Text Generation • Updated Nov 18, 2023 • 24 • 2

TheBloke/nucleus-22B-token-500B-AWQ

Text Generation • Updated Nov 18, 2023 • 13 • 1

TheBloke/tigerbot-70B-chat-v4-GPTQ

Text Generation • Updated Nov 19, 2023 • 17 • 1

TheBloke/tigerbot-70B-chat-v4-AWQ

Text Generation • Updated Nov 19, 2023 • 7

TheBloke/Kaori-70B-v1-GPTQ

Text Generation • Updated Nov 19, 2023 • 8 • 2

TheBloke/Kaori-70B-v1-AWQ

Text Generation • Updated Nov 19, 2023 • 7 • 2

TheBloke/Nanbeige-16B-Base-32K-GPTQ

Text Generation • Updated Nov 19, 2023 • 24 • 1

TheBloke/Nanbeige-16B-Base-GPTQ

Text Generation • Updated Nov 19, 2023 • 23 • 2

TheBloke/Nanbeige-16B-Chat-GPTQ

Text Generation • Updated Nov 19, 2023 • 25 • 1

TheBloke/Capybara-Tess-Yi-34B-200K-AWQ

Text Generation • Updated Nov 19, 2023 • 8 • 3

TheBloke/Capybara-Tess-Yi-34B-200K-GPTQ

Text Generation • Updated Nov 19, 2023 • 31 • 7

TheBloke/X-NoroChronos-13B-AWQ

Text Generation • Updated Nov 19, 2023 • 75

rajivmehtapy/opt-125m-awq

Text Generation • Updated Dec 16, 2023 • 64

TheBloke/XwinCoder-13B-AWQ

Text Generation • Updated Nov 19, 2023 • 82 • 1

TheBloke/X-NoroChronos-13B-GPTQ

Text Generation • Updated Nov 19, 2023 • 12 • 4

TheBloke/XwinCoder-34B-AWQ

Text Generation • Updated Nov 19, 2023 • 13 • 1

Trelis/Yi-34B-200K-Llamafied-chat-SFT-function-calling-v2-AWQ

Text Generation • Updated Dec 12, 2023 • 1

TheBloke/XwinCoder-13B-GPTQ

Text Generation • Updated Nov 19, 2023 • 27 • 1

un-model-runs/coarse-relevancy-multi-label-llama-2-7B-4k-ai-only-low-rank

Text Generation • Updated Nov 20, 2023 • 3

un-model-runs/coarse-relevancy-multi-label-llama-2-7B-4k-all-data-low-rank

Text Generation • Updated Nov 20, 2023 • 3

TheBloke/XwinCoder-34B-GPTQ

Text Generation • Updated Nov 19, 2023 • 29 • 2

un-model-runs/coarse-relevancy-multi-label-llama-2-7B-4k-all-data-high-rank

Text Generation • Updated Nov 21, 2023 • 3

Pontonkid/falcon-med

Text Generation • Updated Nov 24, 2023 • 26

Pazuzzu/zephyr-7b-beta_assistant_v0.2_gptq

Text Generation • Updated Nov 20, 2023 • 84

janavikhochare/awq-numds

Text Generation • Updated Nov 19, 2023 • 77