gmonair/NuminaMath-7B-TIR-W8A16
Updated
•
6
Edit Models filters
Active filters:
compressed-tensors
noneUsername/magnum-v4-22b-W8A8-Dynamic-Per-Token
Updated
•
12
gmonair/Qwen2.5-Math-7B-Instruct-W8A16
Updated
•
4
gmonair/deepseek-math-7b-rl-W8A16
Updated
•
7
noneUsername/magnum-v4-12b-W8A8-Dynamic-Per-Token
Updated
•
11
nm-testing/SparseLlama-3-8B-pruned_50.2of4_Fp8-compressed
Updated
•
8
nm-testing/llama2.c-stories15M-pruned_50.2of4-uncompressed
Updated
•
7
nm-testing/TinyLlama-1.1B-Chat-v1.0-pruned_50.2of4-INT8-compressed
Updated
•
6
asabet/Llama-3.2-11B-Vision-Instruct-fp8-dynamic
Updated
•
35
PyrTools/Ministral-8B-Instruct-2410-FP8-Dynamic
Updated
•
6
nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-quantized.w8a8
Updated
•
13
nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-FP8
Updated
•
17
nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-quantized.w4a16
Updated
•
81
CalamitousFelicitousness/Llama-3.05-Nemotron-Tenyxchat-Storybreaker-70B-FP8-Dynamic
Updated
•
57
mbayser/granite-20b-functioncalling-FP8-KV
Updated
•
55
nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16_2of4-e2e
Text Generation
•
Updated
•
38
nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16_2of4_channel-e2e
Text Generation
•
Updated
•
119
CalamitousFelicitousness/EVA-Qwen2.5-72B-v0.0-FP8-Dynamic
Text Generation
•
Updated
•
212
nm-testing/paligemma-3b-mix-224-FP8-dynamic
Updated
•
38
nm-testing/llava-onevision-qwen2-7b-ov-hf-FP8-dynamic
Updated
•
28
yejingfu/nmagic-Meta-Llama-3.1-8B-Instruct-FP8
Text Generation
•
Updated
•
4
CalamitousFelicitousness/EVA-Qwen2.5-32B-v0.1-FP8-Dynamic
Text Generation
•
Updated
•
30
PyrTools/Rocinante-12B-v1.1-FP8-Dynamic
Updated
•
2
PyrTools/Cydonia-22B-v1.2-FP8-Dynamic
Updated
•
4
stan-hua/Meta-Llama-3.1-70B-Instruct-LC-RTN-W4A16
Text Generation
•
Updated
•
24
nm-testing/pixtral-12b-FP8-dynamic-all
Updated
•
2
SicariusSicariiStuff/TheDrummer_Behemoth-123B-v1.1_FP8
Updated
•
91
nm-testing/Llama-3.2-1B-Instruct-FP8-KV
Updated
•
22
stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-RTN-W4A16
Text Generation
•
Updated
•
30
stan-hua/Llama-3.1-8B-Instruct-LC-SmoothQuant-RTN-W8A8
Text Generation
•
Updated
•
27