Did SAE training tokens include special tokens, e.g., <BOS> or <EOS>?
#2
by
syleetolow
- opened
Hello,
Thank you for the great work. I have a question regarding the training details of the provided SAE model.
- Did SAE training tokens include special tokens, e.g., <BOS> or <EOS> ?
I thank in advance for your response.
Warm regards,
Soo Yong Lee
We did use BOS, which is added by the Llama tokenizer by default.
syleetolow
changed discussion status to
closed