RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16 Text Generation • 8B • Updated about 9 hours ago • 56.9k • 30
RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic Text Generation • 8B • Updated about 9 hours ago • 40.8k • 9
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8 Text Generation • 8B • Updated about 9 hours ago • 19.2k • 20
RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w4a16 Text Generation • 24B • Updated about 9 hours ago • 423 • 1
RedHatAI/granite-3.1-8b-base-quantized.w4a16 Text Generation • 8B • Updated about 9 hours ago • 96 • 1
RedHatAI/Qwen2.5-7B-Instruct-quantized.w8a8 Text Generation • 8B • Updated about 9 hours ago • 287 • 2
RedHatAI/granite-3.1-8b-instruct-quantized.w4a16 Text Generation • 8B • Updated about 9 hours ago • 1.23k • 1
RedHatAI/granite-3.1-8b-instruct-quantized.w8a8 Text Generation • 8B • Updated about 9 hours ago • 370 • 2
RedHatAI/Llama-3.3-70B-Instruct-quantized.w4a16 Text Generation • 71B • Updated about 9 hours ago • 5.99k • 3
RedHatAI/Llama-3.3-70B-Instruct-quantized.w8a8 Text Generation • 71B • Updated about 9 hours ago • 17k • 14
RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF Text Generation • 71B • Updated about 9 hours ago • 40 • 2
RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-dynamic Text Generation • 71B • Updated about 9 hours ago • 886 • 15
RedHatAI/Qwen2.5-7B-Instruct-FP8-dynamic Text Generation • 8B • Updated about 9 hours ago • 28.1k • 1
RedHatAI/granite-3.1-8b-instruct-FP8-dynamic Text Generation • 8B • Updated about 9 hours ago • 625 • 1
RedHatAI/Llama-3.3-70B-Instruct-FP8-dynamic Text Generation • 71B • Updated about 9 hours ago • 56.3k • 16
RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w8a8 Text Generation • 24B • Updated about 9 hours ago • 14.9k • 2