Convert t5x checkpoint of switch to pytorch

by Siddharth63 - opened Jan 1

Jan 1

Hi. I have pretrained my own switch transformers model using ul2 training procedure with t5x. I have got t5x checkpoint. which script to use to convert the t5x checkpoint to flax/pytorch model.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment