Dracones

/

mixtral-8x22b-instruct-oh_exl2_2.25bpw

like 1

Using gpu-split 16, 16, 16 on 3x RTX 3090s, 21/20/14 GB actual usage with overhead taken account of.

No action required, just notating in these for people to see VRAM usage in these quants. Thanks for these, @Dracones !