BOS and EOS tokens are the same?
#2
by
RonanMcGovern
- opened
Is that how the model was trained?
There is only an EOS token, the model was not trained with BOS as was done with GPT-style models. <|endoftext|> is the EOS token.
sam-mosaic
changed discussion status to
closed