on MPT-30B gradient checkpointing

#7
by DanielTTY - opened

Could you do the same for the 30B version? or could you explain to us how it should be done here? thanks

are the changes to allow gradient checkpointing in these lines?:
https://huggingface.co/cekal/mpt-7b-peft-compatible/commit/a5eab52c1c61c1d50a4e01428949f6ff90c73c48

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment