Edit Models filters

Inference status

Misc

text-generation-inference

Inference Endpoints

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

166,094

Full-text search

Active filters: text-generation-inference

google/flan-t5-xxl

Text2Text Generation • Updated Jul 27, 2023 • 639k • 1.21k

microsoft/phi-2

Text Generation • Updated Apr 29 • 202k • 3.25k

TinyLlama/TinyLlama-1.1B-Chat-v1.0

Text Generation • Updated Mar 17 • 2.14M • • 1.1k

cognitivecomputations/dolphin-2.8-mistral-7b-v02

Text Generation • Updated May 20 • 1.31k • 216

taide/Llama3-TAIDE-LX-8B-Chat-Alpha1

Text Generation • Updated Apr 28 • 8.3k • 124

deepseek-ai/DeepSeek-V2-Chat

Text Generation • Updated Jun 8 • 1.29k • 447

RLHFlow/ArmoRM-Llama3-8B-v0.1

Text Classification • Updated Sep 23 • 11.1k • 158

Qwen/Qwen2-7B-Instruct

Text Generation • Updated Aug 21 • 530k • 595

deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct

Text Generation • Updated Jul 3 • 54.1k • 324

google/gemma-2-9b

Text Generation • Updated Aug 7 • 79.2k • 600

meta-llama/Llama-3.1-405B

Text Generation • Updated Sep 25 • 647k • 891

mistralai/Mathstral-7B-v0.1

Text Generation • Updated Jul 31 • 4.14k • 211

arcee-ai/Arcee-Nova

Text Generation • Updated Jul 18 • 2.78k • 44

princeton-nlp/gemma-2-9b-it-SimPO

Text Generation • Updated Aug 2 • 18.3k • 129

cyberagent/Llama-3.1-70B-Japanese-Instruct-2407

Text Generation • Updated Jul 26 • 1.96k • 68

NousResearch/Hermes-3-Llama-3.1-8B

Text Generation • Updated Sep 8 • 80.5k • • 250

NousResearch/Hermes-3-Llama-3.1-405B

Text Generation • Updated Oct 8 • 116k • 171

HF1BitLLM/Llama3-8B-1.58-100B-tokens

Text Generation • Updated Sep 19 • 6.1k • 158

Qwen/Qwen2.5-7B

Text Generation • Updated Sep 25 • 96.2k • 75

inflatebot/MN-12B-Mag-Mell-R1

Text Generation • Updated Oct 13 • 579 • 36

Qwen/Qwen2.5-Coder-7B

Text Generation • Updated 16 days ago • 31.4k • 76

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 9.44k • 11

WhiteRabbitNeo/WhiteRabbitNeo-2.5-Qwen-2.5-Coder-7B

Text Generation • Updated Oct 9 • 530 • 29

rombodawg/Rombos-LLM-V2.5-Qwen-32b

Text Generation • Updated Oct 6 • 5.28k • 32

DISLab/SummLlama3.1-8B

Summarization • Updated 21 days ago • 295 • 8

anthracite-org/magnum-v4-12b

Text Generation • Updated 9 days ago • 744 • 33

MarsupialAI/Monstral-123B

Text Generation • Updated 17 days ago • 434 • 15

deepvk/kazRush-ru-kk

Translation • Updated 5 days ago • 30 • 4

EVA-UNIT-01/EVA-Qwen2.5-72B-v0.2

Text Generation • Updated 1 day ago • 484 • 8

Steelskull/Q2.5-MS-Mistoria-72b-v2

Text Generation • Updated 10 days ago • 176 • 4