meta-llama

/

Llama-3.1-8B-Instruct

like 3.01k

Follow

Meta Llama 7,610

I am trying to extract information from a document, but whenever i am trying to run the same prompt on llama 3.1 for multiple times, it is getting differnet kinds of result. How can that scenario be handled to reduce the variability in model answer.

I have set temperature value to zero and top_p value to 0.99 but still the unpredictability of answer is still remaining