neuralmagic/granite-3.1-2b-base-quantized.w4a16
Text Generation
•
Updated
•
25
Neural Magic
company
Verified
AI & ML interests
LLMs, optimization, compression, sparsification, quantization, pruning, distillation, NLP, CV
Recent Activity
View all activity
neuralmagic's activity
nm-research
updated
a
model
about 7 hours ago
nm-research
updated
6
models
about 8 hours ago
neuralmagic/granite-3.1-8b-base-FP8-dynamic
Updated
neuralmagic/granite-3.1-8b-base-quantized.w8a8
Text Generation
•
Updated
•
8
neuralmagic/granite-3.1-8b-instruct-quantized.w4a16
Text Generation
•
Updated
•
128
•
1
neuralmagic/granite-3.1-8b-base-quantized.w4a16
Text Generation
•
Updated
•
26
neuralmagic/granite-3.1-2b-base-quantized.w8a8
Text Generation
•
Updated
•
20
neuralmagic/granite-3.1-2b-base-FP8-dynamic
Text Generation
•
Updated
•
23
mgoin
published
13
models
2 days ago
neuralmagic/Qwen2.5-3B-quantized.w8a8
Text Generation
•
Updated
•
5
neuralmagic/Qwen2.5-14B-quantized.w8a8
Text Generation
•
Updated
•
9
neuralmagic/Qwen2.5-14B-FP8-dynamic
Text Generation
•
Updated
•
15
neuralmagic/Qwen2.5-72B-FP8-dynamic
Text Generation
•
Updated
•
2
neuralmagic/Qwen2.5-3B-FP8-dynamic
Text Generation
•
Updated
•
4
neuralmagic/Qwen2.5-0.5B-FP8-dynamic
Text Generation
•
Updated
•
2
neuralmagic/Qwen2.5-72B-quantized.w8a16
Text Generation
•
Updated
•
4
neuralmagic/Qwen2.5-32B-quantized.w8a16
Text Generation
•
Updated
•
4
neuralmagic/Qwen2.5-7B-quantized.w8a16
Text Generation
•
Updated
•
4
neuralmagic/Qwen2.5-1.5B-quantized.w8a16
Text Generation
•
Updated
•
4
neuralmagic/Qwen2.5-0.5B-Instruct-quantized.w8a8
Text Generation
•
Updated
•
2
neuralmagic/Qwen2.5-3B-quantized.w8a16
Text Generation
•
Updated
•
4
neuralmagic/Qwen2.5-72B-quantized.w8a8
Text Generation
•
Updated
•
4