

TITLE
[WIP] [performance doc] faster/leaner optimizers

COMMENTS
1

REACTIONS
+1: 1
-1: 0
laugh: 0
hooray: 0
heart: 0
rocket: 0
eyes: 0

BODY
documenting faster / leaner optimizers

TODO:

- add `--optim adamw_bnb_8bit` for HF Trainer.
