

TITLE
[s2s] label smoothing loss should be normalized

COMMENTS
3

REACTIONS
+1: 0
-1: 0
laugh: 0
hooray: 0
heart: 0
rocket: 0
eyes: 0

BODY
by the number of padding tokens in a batch.
Currently, if you change `--train_batch_size` or `--max_target_length`, your loss value will scale wildly, making it hard to compare runs.