Qwen2.5 Quantized - a neuralmagic-ent Collection

neuralmagic-ent 's Collections

DeepSeekCoder-V2 Quantized

Qwen2.5 Math Quantized

Qwen2.5 Coder Quantized

Phi-3 Quantized

Llama 3.3 Quantized

Llama 3.2 Quantized

Llama 3.1 Quantized

Qwen2.5 Quantized

Qwen2.5 Quantized

updated about 14 hours ago

neuralmagic-ent/Qwen2.5-0.5B-quantized.w8a8

Text Generation • Updated about 15 hours ago • 8
neuralmagic-ent/Qwen2.5-1.5B-quantized.w8a8

Text Generation • Updated about 15 hours ago • 8
neuralmagic-ent/Qwen2.5-3B-quantized.w8a8

Text Generation • Updated about 14 hours ago • 8
neuralmagic-ent/Qwen2.5-7B-quantized.w8a8

Text Generation • Updated about 15 hours ago • 8
neuralmagic-ent/Qwen2.5-14B-quantized.w8a8

Text Generation • Updated about 15 hours ago • 68
neuralmagic-ent/Qwen2.5-0.5B-Instruct-quantized.w8a8

Text Generation • Updated about 14 hours ago • 8
neuralmagic-ent/Qwen2.5-32B-quantized.w8a8

Text Generation • Updated about 15 hours ago • 10
neuralmagic-ent/Qwen2.5-72B-quantized.w8a8

Text Generation • Updated about 15 hours ago • 8
neuralmagic-ent/Qwen2.5-3B-Instruct-quantized.w8a8

Text Generation • Updated about 14 hours ago • 11
neuralmagic-ent/Qwen2.5-1.5B-Instruct-quantized.w8a8

Text Generation • Updated about 14 hours ago • 8
neuralmagic-ent/Qwen2.5-7B-Instruct-quantized.w8a8

Text Generation • Updated about 14 hours ago • 11
neuralmagic-ent/Qwen2.5-32B-Instruct-quantized.w8a8

Text Generation • Updated about 14 hours ago • 8
neuralmagic-ent/Qwen2.5-72B-Instruct-quantized.w8a8

Text Generation • Updated about 14 hours ago • 10
neuralmagic-ent/Qwen2.5-72B-Instruct-quantized.w4a16

Updated 8 days ago • 10
neuralmagic-ent/Qwen2.5-32B-Instruct-quantized.w4a16

Updated 8 days ago • 8
neuralmagic-ent/Qwen2.5-72B-FP8-dynamic

Updated 8 days ago • 8
neuralmagic-ent/Qwen2.5-14B-Instruct-quantized.w8a8

Text Generation • Updated about 14 hours ago • 14
neuralmagic-ent/Qwen2.5-32B-FP8-dynamic

Updated 8 days ago • 8
neuralmagic-ent/Qwen2.5-14B-FP8-dynamic

Updated 8 days ago • 4
neuralmagic-ent/Qwen2.5-7B-FP8-dynamic

Updated 8 days ago • 4
neuralmagic-ent/Qwen2.5-0.5B-Instruct-FP8-dynamic

Text Generation • Updated 4 days ago • 20
neuralmagic-ent/Qwen2.5-1.5B-FP8-dynamic

Updated 8 days ago • 4
neuralmagic-ent/Qwen2.5-1.5B-Instruct-FP8-dynamic

Text Generation • Updated 4 days ago • 6
neuralmagic-ent/Qwen2.5-14B-Instruct-FP8-dynamic

Updated 8 days ago • 6
neuralmagic-ent/Qwen2.5-32B-Instruct-FP8-dynamic

Updated 8 days ago • 6
neuralmagic-ent/Qwen2.5-32B-quantized.w4a16

Updated 8 days ago • 6
neuralmagic-ent/Qwen2.5-3B-FP8-dynamic

Updated 8 days ago • 4
neuralmagic-ent/Qwen2.5-3B-Instruct-FP8-dynamic

Updated 8 days ago • 4
neuralmagic-ent/Qwen2.5-72B-Instruct-FP8-dynamic

Updated 8 days ago • 6
neuralmagic-ent/Qwen2.5-72B-quantized.w4a16

Updated 8 days ago • 6
neuralmagic-ent/Qwen2.5-0.5B-FP8-dynamic

Updated 8 days ago • 16
neuralmagic-ent/Qwen2.5-7B-Instruct-FP8-dynamic

Updated 8 days ago • 68
neuralmagic-ent/Qwen2.5-7B-quantized.w4a16

Updated 8 days ago • 7
neuralmagic-ent/Qwen2.5-1.5B-quantized.w4a16

Text Generation • Updated about 14 hours ago • 1
neuralmagic-ent/Qwen2.5-0.5B-quantized.w4a16

Text Generation • Updated about 14 hours ago • 2
neuralmagic-ent/Qwen2.5-3B-quantized.w4a16

Text Generation • Updated about 14 hours ago • 2