Vortex Collection ModelCloud optimized and validated quants that pass/meet strict quality assurance on multiple benchmarks. No one quantize • 22 items • Updated about 8 hours ago • 10
view article Article Accelerating LLM Inference: Fast Sampling with Gumbel-Max Trick By cxdu • Oct 24, 2024 • 13