Edit Models filters

Model Tree

Qwen/Qwen2-0.5B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

49

Full-text search

Active filters: Qwen/Qwen2-0.5B-Instruct

PrunaAI/Qwen-Qwen2-0.5B-Instruct-bnb-4bit-smashed

Text Generation • Updated Jul 14 • 11

PrunaAI/Qwen-Qwen2-0.5B-Instruct-AWQ-4bit-smashed

Text Generation • Updated Jul 14 • 9

TrentJohnsongtri/Qwen2-0.5B-Instruct-Q2_K-GGUF

Text Generation • Updated Jul 26 • 4

TrentJohnsongtri/Qwen2-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 26 • 5

Morgen0052/Qwen2-0.5B-Instruct-Q4_0-GGUF

Text Generation • Updated Jul 30 • 7

Georgia47/Qwen2-0.5B-Instruct-Q4_0-GGUF

Text Generation • Updated Jul 31 • 20

lapp0/distily_experiments_loss_reverse_kl

Updated Aug 6 • 2

lapp0/distily_experiments_loss_kl

Updated Aug 7 • 3

lapp0/distily_experiments_loss_mse

Updated Aug 6 • 3

lapp0/distily_experiments_loss_cakld

Updated Aug 7 • 10

Felladrin/gguf-q5_k_m-imat-qwen2-0.5b-instruct

Text Generation • Updated Aug 14 • 11

dlhaojin/Qwen2-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Aug 18 • 1

mlc-ai/Qwen2-0.5B-Instruct-q4f16_0-MLC

Updated Aug 23 • 122

Ffftdtd5dtft/Qwen2-0.5B-Instruct-IQ1_S-GGUF

Text Generation • Updated Sep 4 • 6

TitanML/Qwen2-0.5B-Instruct-AWQ

Text Generation • Updated Sep 11 • 2

Elaine5/Qwen2-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 30 • 2

eoe/Qwen2-0.5B-Instruct-Q2_K-GGUF

Text Generation • Updated 21 days ago • 29

eoe/Qwen2-0.5B-Instruct-Q4_0-GGUF

Text Generation • Updated 21 days ago • 38

tensorblock/Qwen2-0.5B-Instruct-GGUF

Text Generation • Updated 9 days ago • 299