Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

8-bit precision

Carbon Emissions

Models

60

Full-text search

Active filters: Instruct

prithivMLmods/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated 6 days ago • 537 • 8

prithivMLmods/Llama-Doctor-3.2-3B-Instruct

Text Generation • Updated 5 days ago • 87 • 7

prithivMLmods/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • Updated 9 days ago • 472 • 8

VAGOsolutions/SauerkrautLM-Mixtral-8x7B-Instruct

Text Generation • Updated Apr 29 • 50.7k • 22

prithivMLmods/SmolLM2-1.7B-Instruct-GGUF

Text Generation • Updated 13 days ago • 219 • 4

prithivMLmods/SmolLM2-135M-Instruct-GGUF

Text Generation • Updated 13 days ago • 233 • 4

CONCISE/LLaMa_V2-13B-Instruct-Uncensored-GGML

Text Generation • Updated Aug 17, 2023 • 17 • 5

Keynote-Technology/KAI-7B-Instruct-v0.1

Text Generation • Updated Aug 23 • 13 • 10

TheBloke/KAI-7B-Instruct-GGUF

Updated Nov 9, 2023 • 80 • 6

TheBloke/KAI-7B-Instruct-AWQ

Text Generation • Updated Nov 9, 2023 • 16 • 1

bartowski/KAI-7B-Instruct-exl2

Updated Nov 9, 2023 • 1

TheBloke/KAI-7B-Instruct-GPTQ

Text Generation • Updated Nov 9, 2023 • 8 • 3

VAGOsolutions/SauerkrautLM-SOLAR-Instruct

Text Generation • Updated Mar 2 • 797 • 47

fblgit/LUNA-SOLARkrautLM-Instruct

Text Generation • Updated Mar 8 • 763 • 8

TheBloke/SauerkrautLM-SOLAR-Instruct-AWQ

Text Generation • Updated Dec 23, 2023 • 4

TheBloke/SauerkrautLM-SOLAR-Instruct-GPTQ

Text Generation • Updated Dec 23, 2023 • 9 • 2

TheBloke/SauerkrautLM-SOLAR-Instruct-GGUF

Text Generation • Updated Dec 23, 2023 • 168 • 2

TheBloke/LUNA-SOLARkrautLM-Instruct-AWQ

Text Generation • Updated Dec 23, 2023 • 6

TheBloke/LUNA-SOLARkrautLM-Instruct-GPTQ

Text Generation • Updated Dec 23, 2023 • 20 • 2

TheBloke/LUNA-SOLARkrautLM-Instruct-GGUF

Text Generation • Updated Dec 23, 2023 • 250 • 4

LoneStriker/SauerkrautLM-Mixtral-8x7B-Instruct-2.4bpw-h6-exl2

Text Generation • Updated Dec 25, 2023 • 2

LoneStriker/SauerkrautLM-Mixtral-8x7B-Instruct-3.0bpw-h6-exl2

Text Generation • Updated Dec 25, 2023 • 5

LoneStriker/SauerkrautLM-Mixtral-8x7B-Instruct-3.5bpw-h6-exl2

Text Generation • Updated Dec 25, 2023 • 5

LoneStriker/SauerkrautLM-Mixtral-8x7B-Instruct-3.75bpw-h6-exl2

Text Generation • Updated Dec 25, 2023 • 2

LoneStriker/SauerkrautLM-Mixtral-8x7B-Instruct-4.0bpw-h6-exl2

Text Generation • Updated Dec 25, 2023 • 5

TheBloke/SauerkrautLM-Mixtral-8x7B-Instruct-GPTQ

Text Generation • Updated Jan 3 • 51 • 3

TheBloke/SauerkrautLM-Mixtral-8x7B-Instruct-GGUF

Text Generation • Updated Dec 25, 2023 • 207 • 9

TheBloke/SauerkrautLM-Mixtral-8x7B-Instruct-AWQ

Text Generation • Updated Jan 3 • 116 • 2

LoneStriker/SauerkrautLM-Mixtral-8x7B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Dec 25, 2023 • 1

LoneStriker/SauerkrautLM-Mixtral-8x7B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated Dec 25, 2023 • 2