Edit Models filters

Inference status

Misc

compressed-tensors

AutoTrain Compatible

Inference Endpoints

text-generation-inference

8-bit precision

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

507

Full-text search

Active filters: compressed-tensors

nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8_tensor_weight_static_per_tensor_act-e2e

Text Generation • Updated about 16 hours ago • 562

nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8_channel_weight_static_per_tensor-e2e

Text Generation • Updated about 16 hours ago • 470

nm-testing/tinyllama-fp8-dynamic-compressed

Updated Oct 9 • 1.23k

nm-testing/tinyllama-w4a16-compressed

Updated Oct 9 • 1.21k

nm-testing/tinyllama-w8a8-compressed

Updated Oct 9 • 1.26k

nm-testing/tinyllama-w8a16-dense

Updated Oct 9 • 1.22k

nm-testing/TinyLlama-1.1B-Chat-v1.0-actorder-weight-e2e

Text Generation • Updated about 17 hours ago • 575

nm-testing/TinyLlama-1.1B-Chat-v1.0-actorder-group

Text Generation • Updated Oct 9 • 3.92k

nm-testing/TinyLlama-1.1B-Chat-v1.0-actorder-weight

Text Generation • Updated Oct 9 • 9

nm-testing/TinyLlama-1.1B-Chat-v1.0-actorder-group-e2e

Text Generation • Updated about 17 hours ago • 440

nm-testing/tinyllama-fp8-dynamic-compressed-hf-quantizer

Updated Sep 11 • 3

nm-testing/tinyllama-w4a16-compressed-hf-quantizer

Updated Sep 11 • 74

nm-testing/tinyllama-w8a8-compressed-hf-quantizer

Updated Sep 11 • 75

nm-testing/tinyllama-w8a16-dense-hf-quantizer

Updated Sep 11 • 63

nm-testing/DeepSeek-Coder-V2-Lite-Instruct-W8A8

Updated Oct 9 • 30

nm-testing/Qwen2-VL-7B-Instruct-FP8-dynamic

Updated Oct 29 • 23

nm-testing/OLMoE-1B-7B-0924-Instruct-FP8

Updated Oct 9 • 5

nm-testing/Meta-Llama-3.1-8B-Instruct-FP8-hf

Text Generation • Updated Sep 24 • 134

nm-testing/tinyllama-oneshot-w8a8-channel-dynamic-token-v2-asym

Updated Oct 9 • 2.75k

nm-testing/Meta-Llama-3-8B-Instruct-W8-Channel-A8-Dynamic-Asym-Per-Token-Test

Updated Oct 9 • 1.03k • 1

nm-testing/asym-w8w8-int8-static-per-tensor-tiny-llama

Updated Oct 9 • 2.78k

neuralmagic/Llama-3.2-1B-Instruct-FP8-dynamic

Text Generation • Updated Oct 9 • 867 • 2

neuralmagic/Llama-3.2-3B-Instruct-quantized.w8a8

Text Generation • Updated Oct 16 • 10k • 1

nm-testing/tiny-llama-w4a16-new-key

Updated Sep 26 • 5

neuralmagic/Llama-3.2-1B-quantized.w8a8

Updated Oct 9 • 1.57k

neuralmagic/Llama-3.2-3B-quantized.w8a8

Updated Oct 9 • 218

neuralmagic/Llama-3.2-1B-FP8

Updated Oct 9 • 403

horheynm/TinyLlama-1.1B-Chat-v1.0-QuantizedCache

Updated Sep 30 • 5

qeternity/Qwen2.5-72B-Instruct-FP8

Updated Oct 1 • 4

qeternity/Qwen2.5-72B-Instruct-W8A8

Updated Oct 1 • 21 • 1