Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

39

Full-text search

Active filters: exllamav2

matlok/lok-instruct-8b-llm3-exl2-8.0bpw

Text Generation • Updated Apr 20

Vikhrmodels/it-5.3-fp16-32k-EXL2

Updated Jun 13 • 1

backyardai/Yi-34B-200K-RPMerge-GGUF

Updated Jul 18 • 253 • 2

WaveCut/WoonaV1.2-9b-EXL2

Text Generation • Updated Sep 1 • 2

Anthonyg5005/Llama-Guard-3-1B-exl2

Text Generation • Updated 29 days ago • 14

mradermacher/Yi-34B-200K-RPMerge-GGUF

Updated 10 days ago • 244

mradermacher/Yi-34B-200K-RPMerge-i1-GGUF

Updated 10 days ago • 606

TheMelonGod/Llama-3.1-8B-ArliAI-RPMax-v1.3-exl2

Text Generation • Updated about 6 hours ago • 17

TheMelonGod/dolphin-2.9.4-llama3.1-8b-exl2

Text Generation • Updated about 6 hours ago • 1