Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,472

Full-text search

Active filters: 6-bit

MaziyarPanahi/gemma-7b-it-GGUF

Text Generation • Updated Feb 27 • 241 • 7

MaziyarPanahi/gemma-2b-it-GGUF

Text Generation • Updated Feb 27 • 359 • 9

MaziyarPanahi/Nous-Hermes-2-Mixtral-8x7B-SFT-Alpaca-GGUF

Text Generation • Updated Feb 21 • 82 • 3

MaziyarPanahi/Nous-Hermes-2-Mixtral-8x7B-SFT-Wikihow-GGUF

Text Generation • Updated Feb 22 • 85 • 4

MaziyarPanahi/GritLM-8x7B-GGUF

Text Generation • Updated Feb 22 • 76 • 4

MaziyarPanahi/tulu-2-dpo-13b-GGUF

Text Generation • Updated Apr 17 • 844 • 3

MaziyarPanahi/Qwen1.5-8x7b-v0.1-GGUF

Text Generation • Updated Mar 2 • 314 • 6

MaziyarPanahi/OpenHermes-2.5-Mistral-7B-mt-bench-DPO-original-v3-GGUF

Text Generation • Updated Feb 25 • 115 • 2

MaziyarPanahi/Yarn-Solar-10b-64k-GGUF

Text Generation • Updated Feb 25 • 98 • 1

MaziyarPanahi/Yarn-Solar-10b-32k-GGUF

Text Generation • Updated Feb 26 • 73 • 1

MaziyarPanahi/LongAlpaca-13B-16k-GGUF

Text Generation • Updated Feb 26 • 72 • 4

MaziyarPanahi/LongAlpaca-13B-GGUF

Text Generation • Updated Feb 26 • 76 • 2

MaziyarPanahi/StructLM-7B-GGUF

Text Generation • Updated Feb 28 • 126 • 3

MaziyarPanahi/StructLM-13B-GGUF

Text Generation • Updated Feb 28 • 126 • 4

MaziyarPanahi/TIGERScore-13B-GGUF

Text Generation • Updated Feb 28 • 77 • 3

MaziyarPanahi/Mistral-7B-Instruct-KhanAcademy-v0.2-GGUF

Text Generation • Updated Feb 28 • 76 • 5

MaziyarPanahi/StructLM-34B-GGUF

Text Generation • Updated Feb 28 • 104 • 2

MaziyarPanahi/Mistral-7B-Instruct-Aya-101-GGUF

Text Generation • Updated Feb 28 • 266 • 7

MaziyarPanahi/OpenCodeInterpreter-DS-6.7B-GGUF

Text Generation • Updated Mar 1 • 227 • 2

MaziyarPanahi/Experiment26-7B-GGUF

Text Generation • Updated Mar 2 • 172 • 4

MaziyarPanahi/jaskier-7b-dpo-v5.6-GGUF

Text Generation • Updated Mar 2 • 132 • 4

MaziyarPanahi/phi-2-logical-sft-GGUF

Text Generation • Updated Mar 3 • 125 • 2

MaziyarPanahi/Calme-7B-Instruct-v0.1-GGUF

Text Generation • Updated Mar 4 • 2.85k • 2

MaziyarPanahi/34b-beta-GGUF

Text Generation • Updated Mar 4 • 119 • 3

MaziyarPanahi/Calme-7B-Instruct-v0.1.1-GGUF

Text Generation • Updated Mar 5 • 141 • 7

MaziyarPanahi/MixTAO-7Bx2-MoE-v8.1-GGUF

Text Generation • Updated Mar 11 • 297 • 11

MaziyarPanahi/merlinite-7b-GGUF

Text Generation • Updated Mar 7 • 145 • 5

MaziyarPanahi/Yi-9B-GGUF

Text Generation • Updated Mar 14 • 242 • 14

MaziyarPanahi/phi-2-super-GGUF

Text Generation • Updated Mar 7 • 144 • 4

MaziyarPanahi/zephyr-7b-gemma-v0.1-GGUF

Text Generation • Updated Mar 7 • 104 • 6