Hi! Planning to run some coding tests. What are the rec. smapling parameters? temp, top_k, top_p etc.?

#10
by Fernanda24 - opened

Hi! Thanks for this model! Planning to run some coding tests. What are the rec. smapling parameters? temp, top_k, top_p etc.?

inclusionAI org

Hi, thanks for the inquiry, for temperature, we could try 0.7; and for top_p, suggested to use 0.95.
I'll also update the model card to reflect this information.

Sign up or log in to comment