Edit Models filters

Inference status

Misc

compressed-tensors

AutoTrain Compatible

Inference Endpoints

text-generation-inference

8-bit precision

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

258

Full-text search

Active filters: compressed-tensors

neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8

Text Generation • Updated 28 days ago • 2.26k • 31

neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w4a16

Text Generation • Updated 26 days ago • 3.71k • 12

neuralmagic/Meta-Llama-3.1-8B-Instruct-FP8

Text Generation • Updated 27 days ago • 129k • 32

neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8-dynamic

Text Generation • Updated 18 days ago • 2.16k • 3

neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8

Text Generation • Updated 27 days ago • 45.5k • 32

neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8-dynamic

Text Generation • Updated 18 days ago • 422 • 14

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated 14 days ago • 8k • 11

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a16

Text Generation • Updated 27 days ago • 1.39k • 2

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation • Updated 26 days ago • 19.1k • 10

neuralmagic/gemma-2-9b-it-quantized.w4a16

Text Generation • Updated 27 days ago • 426 • 1

neuralmagic/gemma-2-9b-it-quantized.w8a8

Text Generation • Updated 27 days ago • 237 • 2

neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a8

Text Generation • Updated 26 days ago • 1.01k • 2

nm-testing/Phi-3.5-MoE-instruct-FP8

Updated 27 days ago • 81 • 2

neuralmagic/Llama-3.2-11B-Vision-Instruct-FP8-dynamic

Text Generation • Updated Oct 2 • 23.2k • 10

neuralmagic/Llama-3.2-1B-Instruct-FP8-dynamic

Text Generation • Updated 27 days ago • 1.03k • 2

neuralmagic/Llama-3.2-3B-Instruct-FP8-dynamic

Text Generation • Updated 27 days ago • 1.71k • 2

neuralmagic/Llama-3.2-1B-Instruct-quantized.w8a8

Text Generation • Updated 20 days ago • 1.2k • 3

neuralmagic/Llama-3.2-90B-Vision-Instruct-FP8-dynamic

Text Generation • Updated Oct 2 • 15.5k • 3

neuralmagic/Llama-3.2-3B-Instruct-FP8

Text Generation • Updated 20 days ago • 8.86k • 2

neuralmagic/Phi-3.5-mini-instruct-FP8-KV

Text Generation • Updated Oct 1 • 346 • 1

qeternity/Qwen2.5-72B-Instruct-W8A8

Updated Oct 1 • 8 • 1

nm-testing/NVLM-D-72B-FP8-dynamic

Updated 29 days ago • 1.9k • 2

neuralmagic/pixtral-12b-FP8-dynamic

Text Generation • Updated 5 days ago • 1.81k • 1

noneUsername/SuperNova-Medius-W8A8-Dynamic-Per-Token

Updated 18 days ago • 197 • 1

flowaicom/Flow-Judge-v0.1-FP8

Updated 23 days ago • 56 • 1

flowaicom/Flow-Judge-v0.1-W8A16

Updated 23 days ago • 21 • 1

flowaicom/Flow-Judge-v0.1-W4A16

Updated 23 days ago • 35 • 1

neuralmagic/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-dynamic

Text Generation • Updated 20 days ago • 9.08k • 8

thwin27/Aria-sequential_mlp-FP8-dynamic

Image-Text-to-Text • Updated 13 days ago • 193 • 5

nm-testing/TinyLlama-1.1B-Chat-v1.0-pruned_50.2of4-FP8-compressed

Updated 7 days ago • 14 • 1