Model sometimes generates '</s>'

#63

by jlzhou - opened Jul 11, 2023

jlzhou

Jul 11, 2023

•

But </s> is neither the stop token nor in the special token list.
Shall we add </s> to the special token list?

Oct 27, 2023

I am also wondering this! The model seems to output this frequently

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment