how do you merge the base model and qlora adapter model
#5
by
CrazyAIGC
- opened
Hi, jondurbin, I am using your repo codes to reproduce your model. Can you give me a help that how do you merge the base model and qlora adapter model into a single hf model like this one? I can not find the script in your repo. Thank you very much.
If you do a git pull of the repo, the merge_weights.py file was added recently: https://github.com/jondurbin/qlora/blob/main/merge_weights.py
I believe thebloke wrote it originally, but I honestly can't recall where I originally found it.