DeusImperator/Lyra4-Gutenberg-12B_exl2_8bpw_max
Text Generation
•
Updated
•
7
•
1
8 BPW exl2 quants using modified quantization script to force using best quantization method for each layer for max quality