num_beams=3
What is the meaning of num_beams?
I cannot found the documentation regarding this parameter
Hi, @mikael17125 ! num_beams refer to 'beam_search' generation strategy when the model evaluate the probabilities of tokens after the one being sampled instead of choosing the top item or sampling the top k items. It leads to increased accuracy, but can be computationally costly and lead to text degradation/creativity loss. You can read more about it here https://huggingface.co/docs/transformers/generation_strategies#customize-text-generation
Hi, @mikael17125 ! num_beams refer to 'beam_search' generation strategy when the model evaluate the probabilities of tokens after the one being sampled instead of choosing the top item or sampling the top k items. It leads to increased accuracy, but can be computationally costly and lead to text degradation/creativity loss. You can read more about it here https://huggingface.co/docs/transformers/generation_strategies#customize-text-generation
Thank you for your help !!!