Edit Models filters

Inference status

Misc

8-bit precision

AutoTrain Compatible

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

5,834

Full-text search

Active filters: 8-bit

MaziyarPanahi/mergekit-slerp-ffdcfot-GGUF

Text Generation • Updated Jun 18 • 24

MaziyarPanahi/mergekit-ties-aspkrwz-GGUF

Text Generation • Updated Jun 18 • 29

MaziyarPanahi/mergekit-slerp-xqswkgn-GGUF

Text Generation • Updated Jun 18 • 50

MaziyarPanahi/mergekit-slerp-zonivkr-GGUF

Text Generation • Updated Jun 18 • 28

MaziyarPanahi/mergekit-slerp-ueqsixf-GGUF

Text Generation • Updated Jun 18 • 35

MaziyarPanahi/mergekit-slerp-xlkdlta-GGUF

Text Generation • Updated Jun 18 • 91 • 1

MaziyarPanahi/mergekit-slerp-ksadkxl-GGUF

Text Generation • Updated Jun 18 • 66 • 1

MaziyarPanahi/mergekit-slerp-qcerglv-GGUF

Text Generation • Updated Jun 18 • 68 • 1

AndrewDOrlov/LLaMA-v2-merged-8b

Text Generation • Updated Jun 18 • 10

MaziyarPanahi/llama-world-GGUF

Text Generation • Updated Jun 18 • 80 • 1

MaziyarPanahi/gemma-gemma-GGUF

Text Generation • Updated Jun 18 • 67

MaziyarPanahi/LWM-14b-Text-Chat-1M-GGUF

Text Generation • Updated Jun 18 • 74

MaziyarPanahi/mergekit-slerp-ozbsicw-GGUF

Text Generation • Updated Jun 18 • 172

MaziyarPanahi/mergekit-slerp-jeyctse-GGUF

Text Generation • Updated Jun 18 • 44

MaziyarPanahi/mergekit-ties-kkhkcqw-GGUF

Text Generation • Updated Jun 18 • 79

MaziyarPanahi/mergekit-slerp-kxzcrwh-GGUF

Text Generation • Updated Jun 18 • 47 • 1

MaziyarPanahi/mergekit-slerp-zzizhry-GGUF

Text Generation • Updated Jun 18 • 66 • 1

MaziyarPanahi/mergekit-slerp-fcxoywi-GGUF

Text Generation • Updated Jun 18 • 11 • 1

MaziyarPanahi/mergekit-slerp-gpprpds-GGUF

Text Generation • Updated Jun 18 • 62 • 1

RyanJT/quantized-granite-3b-code-instruct

Text Generation • Updated Jun 19 • 5

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • Updated Jun 20 • 1.83M • 14

BigHuggyD/BigHuggyD-Grey-WizardLM-2-8x22B_exl2_8.0bpw_h8

Text Generation • Updated Jun 19 • 4

lucyknada/alpindale-magnum-72b-v1-8.0bpw

Text Generation • Updated Jun 19 • 8 • 1

RyanJT/quantized-granite-8bit-3b-code-instruct

Text Generation • Updated Jun 19 • 6

IEITYuan/Yuan2-M32-hf-int8

Text Generation • Updated Jun 20 • 10

ismailpubg5/v2_model

Text Generation • Updated Jun 20 • 6

bullerwins/L3-8B-Stheno-v3.2-exl2_8.0bpw

Text Generation • Updated Jun 20 • 20

booksouls/summarization-endpoint

Text2Text Generation • Updated Jun 26 • 3

Manu1507/Llama-2-7b-quantize

Text Generation • Updated Jun 21 • 7

SotiriosKastanas/lmsys-vicuna-7b-v1.5-8-bit-bnb

Text Generation • Updated Jun 21 • 7