Configs needed to be updated in the main repo.
#1
by
Nitral-AI
- opened
I removed the rope scaling factor from the config during the train and just now re-added it to the configs, so your quant will most likely need to be redone for you to get proper scaling to 32k with the model.
Thanks for letting me know, I'll rerun it
Done!
Reiterate3680
changed discussion status to
closed