Fine Tuning Molmo

#3
by chrishoertnagl - opened

Really cool work!
Is it possible to futher fine-tune the model e.g. on an OCR dataset or something? Are there any notebooks or examples you could share?

Ai2 org

Thank you! We will release full training code for these models but we do not have that ready yet. For now these models do support a forward pass and backpropagation so you can place them into a standard torch training loop yourself.

Any update about releasing the fine tuning molmo script? thanks in advance

Hey @mavericklsd , we are planning to release the code along with checkpoints and weights by the end of November.

Sign up or log in to comment