nm-testing/Meta-Llama-3-8B-Instruct-W8-Channel-A8-Dynamic-Per-Token-Test Text Generation • Updated 28 days ago • 1.35k
nm-testing/Meta-Llama-3-8B-FP8-compressed-tensors-test-bos Text Generation • Updated 28 days ago • 14
nm-testing/TinyLlama-1.1B-compressed-tensors-kv-cache-scheme Text Generation • Updated 28 days ago • 34.7k
nm-testing/Meta-Llama-3-8B-Instruct-W4A16-compressed-tensors-test Text Generation • Updated 28 days ago • 12
neuralmagic/Phi-3-medium-128k-instruct-quantized.w8a16 Text Generation • Updated 28 days ago • 8.16k • 2
neuralmagic/Phi-3-medium-128k-instruct-quantized.w8a8 Text Generation • Updated 28 days ago • 1.74k • 2
neuralmagic/Phi-3-medium-128k-instruct-quantized.w4a16 Text Generation • Updated 28 days ago • 8.46k • 3
nm-testing/Meta-Llama-3-8B-Instruct-W8A8-FP8-Channelwise-compressed-tensors Text Generation • Updated 28 days ago • 1.5k
nm-testing/Meta-Llama-3-8B-Instruct-Non-Uniform-compressed-tensors Text Generation • Updated 28 days ago • 12