Parameters contains nan numbers when loading model locally

#69
by yunsxie - opened

I download the files and tried to load them locally on HPC. It seems like there are nan numbers in model parameters. This happened for both 40b and 40b-instruct

Did not have this problem for 7b models.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment