System Configuration for llama 3.1 8B

#44
by nonlinearnimesh - opened

Hi Everyone, i am trying to use llama 3.1 8b model for generating the embedding from csv which has around 2.2 lac. Initially the model is getting download 30/30 but the model it start pulling the checkpoints it get killed after 6/30. Can anyone please tell me what is the system configuration that i need to use to run llama 3.1 8B.

Thanks

Sign up or log in to comment