Add eos_token_id to generation config
#65
by
udhavsethi
- opened
If the model is used without pipeline
, the model shows unexpected behaviour and generates extra unneeded tokens. The eos_token_id
has to be passed explicitly to fix it since the generation config does not have it.
sam-mosaic
changed pull request status to
merged