Fix eos_token_id
#3
by
shijie-wu
- opened
eos_token_id should be the same as bos_token_id, as indicated by tokenizer_config.json.
stellaathena
changed pull request status to
merged
eos_token_id should be the same as bos_token_id, as indicated by tokenizer_config.json.