Edit Models filters

Inference status

Misc

4-bit precision

8-bit precision

text-generation-inference

AutoTrain Compatible

Inference Endpoints

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

1,734

Full-text search

Active filters: quantized

afrideva/TinyLlama-1.1B-intermediate-step-1431k-3T-GGUF

Text Generation • Updated Dec 28, 2023 • 74 • 1

afrideva/tinycodellama-1.3b-5k-GGUF

Text Generation • Updated Dec 28, 2023 • 36

afrideva/gpt2-turkish-128-token-GGUF

Text Generation • Updated Dec 28, 2023 • 52

afrideva/gpt2-small-danish-GGUF

Text Generation • Updated Dec 28, 2023 • 78

afrideva/DialoGPT-medium-Oshiwambo-Bot-GGUF

Text Generation • Updated Dec 28, 2023 • 29

afrideva/Smol-Llama-101M-Chat-v1-GGUF

Text Generation • Updated Dec 29, 2023 • 107 • 3

afrideva/japanese-mistral-300m-base-GGUF

Text Generation • Updated Dec 29, 2023 • 34

afrideva/japanese-mistral-300m-instruction-GGUF

Text Generation • Updated Dec 29, 2023 • 48

solidrust/Noromaid-7B-0.4-DPO-AWQ

Text Generation • Updated Mar 2 • 28 • 1

MaziyarPanahi/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • Updated Jan 13 • 6 • 1

ProphetOfBostrom/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss_attn-4bit-moe-2bit-HQQ

Text Generation • Updated Mar 5 • 10 • 6

MaziyarPanahi/Mistral-7B-Instruct-v0.1-GPTQ

Text Generation • Updated Jan 13 • 6 • 1

MaziyarPanahi/dolphin-2.1-mistral-7b-GPTQ

Text Generation • Updated Jan 13 • 7 • 1

MaziyarPanahi/komt-mistral-7b-v1-GPTQ

Text Generation • Updated Jan 13 • 8

MaziyarPanahi/OpenHermes-2-Mistral-7B-GPTQ

Text Generation • Updated Jan 13 • 7 • 1

MaziyarPanahi/WizardLM-70B-V1.0-GPTQ

Text Generation • Updated Jan 15 • 12 • 1

MaziyarPanahi/distilabeled-Hermes-2.5-Mistral-7B-GPTQ

Text Generation • Updated Jan 14 • 11

afrideva/phi-2-code-instruct-GGUF

Text Generation • Updated Jan 16 • 44 • 1

afrideva/Llama-68M-Chat-v1-GGUF

Text Generation • Updated Jan 17 • 70 • 1

afrideva/Walter-Phi-GGUF

Text Generation • Updated Jan 17 • 44 • 1

MaziyarPanahi/MoMo-70B-lora-1.8.6-DPO-GPTQ

Text Generation • Updated Jan 18 • 12 • 1

MaziyarPanahi/MoMo-70B-lora-1.8.4-DPO-GPTQ

Text Generation • Updated Jan 18 • 12 • 1

MaziyarPanahi/neural-chat-7b-v3-3-Slerp-GPTQ

Text Generation • Updated Jan 18 • 12

MaziyarPanahi/neural-chat-7b-v3-3-GPTQ

Text Generation • Updated Jan 18 • 11 • 1

MaziyarPanahi/Turdus-GPTQ

Text Generation • Updated Jan 18 • 14 • 5

MaziyarPanahi/UNA-34Beagles-32K-bf16-v1-GPTQ

Text Generation • Updated Mar 4 • 21 • 3

MaziyarPanahi/openchat-3.5-0106-GPTQ

Text Generation • Updated Jan 19 • 7 • 1

MaziyarPanahi/Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ

Text Generation • Updated Jan 19 • 10 • 1

afrideva/dolphin-2_6-phi-2_oasst2_chatML_V2-GGUF

Text Generation • Updated Jan 19 • 84 • 2

MaziyarPanahi/zephyr-7b-beta-GPTQ

Text Generation • Updated Jan 19 • 8 • 1