Exl2
Collection
Models that we have quantized to exllamav2's quantization format
•
22 items
•
Updated
•
2
This is a Exl2 quantized version of Lewd-Sydney-20B
Please refer to the original creator for more information.
Calibration dataset: wikitext
All my infrastructure and cloud expenses are paid out of pocket. If you'd like to donate, you can do so here: https://ko-fi.com/kingbri