Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

Inference Endpoints

text-generation-inference

Misc with no match

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

4

Full-text search

Active filters: omniquant

compressa-ai/Saiga-Llama-3-8B-OmniQuant

Text Generation • Updated Apr 23 • 64

compressa-ai/Llama-3-8B-Instruct-OmniQuant

Text Generation • Updated Apr 27 • 7

compressa-ai/Saiga-Llama-3-8B-AdaQRound

Text Generation • Updated Apr 27 • 16

compressa-ai/Llama-3-70B-Instruct-OmniQuant

Text Generation • Updated May 2 • 9