Can you make a 2.4bpw exl2 quantisation for this model?

by xldistance - opened Jan 25

Jan 25

@LoneStriker
It feels like this model is going to be strong

Owner Jan 25

•

please wait the test metrics.
I'm a little afraid of overfitting

Owner Jan 25

Jan 26

Owner Jan 26

quants were completed yesterday: https://huggingface.co/models?search=LoneStriker%20Truthful_DPO_TomGrc_FusionNet_34Bx2_MoE

many thanks

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment