

TITLE
OOMKilled with exit code 137 with finetune_trainer.py

COMMENTS
2

REACTIONS
+1: 0
-1: 0
laugh: 0
hooray: 0
heart: 0
rocket: 0
eyes: 0

BODY
Hi
I am trying to train on WMT with TPUs using seq2seq_trainer.py, and I always get "OOMKilled with exit code 137" on the line when it tries to use xm.spawn to run the main function on multiple TPUs. I decreased the batch size as much as possible, still the error is there. Do you have an idea why this is happening? thank you. I appreciate your help. 