Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,930

Full-text search

Active filters: instruct

Triangle104/Qwen2.5-Lumen-14B-Q6_K-GGUF

Text Generation • Updated Sep 21, 2024 • 13

Triangle104/Qwen2.5-Lumen-14B-Q8_0-GGUF

Text Generation • Updated Sep 21, 2024 • 11

QuantFactory/Qwen2.5-Lumen-14B-GGUF

Text Generation • Updated Sep 21, 2024 • 285 • 3

teddylee777/Qwen2.5-7B-Instruct-kowiki-qa-context-gguf

Text Generation • Updated Sep 22, 2024 • 1.2k

mradermacher/Qwen2.5-Lumen-14B-i1-GGUF

Updated Sep 22, 2024 • 819 • 8

QuantFactory/Llama3-OpenBioLLM-8B-GGUF

Updated Sep 22, 2024 • 65 • 1

teddylee777/Qwen2.5-7B-Instruct-kowiki-qa-gguf

Text Generation • Updated Sep 22, 2024 • 345 • 7

byroneverson/Mistral-Small-Instruct-2409-abliterated-gguf

Text Generation • Updated Sep 23, 2024 • 266 • 3

WSDW/Hermes-3-Llama-3.1-8B-Q4_K_M-GGUF

Updated Sep 23, 2024 • 14

QuantFactory/Genstruct-7B-GGUF

Updated Sep 23, 2024 • 207 • 2

mradermacher/Mistral-Small-Instruct-2409-abliterated-i1-GGUF

Updated Sep 24, 2024 • 371 • 1

QuantFactory/Mistral-Trismegistus-7B-GGUF

Updated Sep 26, 2024 • 73 • 1

ValiantLabs/Llama3.2-3B-ShiningValiant2

Text Generation • Updated Jan 21 • 508 • 3

mav23/Hermes-3-Llama-3.1-8B-GGUF

Updated Sep 29, 2024 • 65

Anoxiom/Medical-Llama3-v2-Q6_K-GGUF

Updated Sep 29, 2024 • 8

Kowshik24/Bangla-llama-3.2-3B-Instruct-QA-v2

Text Generation • Updated Feb 4 • 1

ValiantLabs/Llama3.2-3B-Enigma

Text Generation • Updated Jan 21 • 41 • 7

mav23/Hermes-2-Pro-Llama-3-8B-GGUF

Updated Sep 30, 2024 • 148

sequelbox/Llama3.1-8B-PlumMath

Text Generation • Updated Oct 4, 2024 • 50 • 1

Triangle104/Pantheon-RP-1.6.1-12b-Nemo-Q4_K_S-GGUF

Updated Oct 2, 2024 • 6

AnirudhJM24/Llama3-OpenBioLLM-8B-Q4_K_M-GGUF

Updated Oct 2, 2024 • 11

ValiantLabs/Llama3.1-8B-Esper2

Text Generation • Updated 3 days ago • 42 • 2

sequelbox/Llama3.1-8B-PlumCode

Text Generation • Updated Nov 17, 2024 • 26

sequelbox/Llama3.1-8B-PlumChat

Text Generation • Updated Nov 17, 2024 • 21

Triangle104/Pantheon-RP-1.6.1-12b-Nemo-Q4_K_M-GGUF

Updated Oct 3, 2024 • 5

ValiantLabs/Llama3.2-3B-Esper2

Text Generation • Updated Jan 21 • 53 • 3

mradermacher/Llama3.1-8B-PlumMath-GGUF

Updated Oct 11, 2024 • 285

mradermacher/Llama3.1-8B-PlumChat-GGUF

Updated Nov 18, 2024 • 16

mradermacher/Llama3.1-8B-PlumCode-GGUF

Updated Nov 18, 2024 • 131

mradermacher/Llama3.1-8B-PlumMath-i1-GGUF

Updated Oct 11, 2024 • 215