Dynamic Quant?

#5
by wyes1 - opened

Just came here from the full size R1 quant announcement, I was wondering if this model could get a dynamic quant?

Unsloth AI org

Just came here from the full size R1 quant announcement, I was wondering if this model could get a dynamic quant?

Good idea we'll see what we can do. However it might not be as good as R1's efficiency

Sign up or log in to comment