Missing processor_config.json
Hello!
I have a fine-tuning notebook setup to fine-tune Idefics2 on custom data. I just tried to swap out Idefics 2 with llava-interleaved, but I got the below error while trying to run an eval:
ValueError: No chat template is set for this processor. Please either set the `chat_template` attribute, or provide a chat template as an argument. See https://huggingface.co/docs/transformers/main/en/chat_templating for more information.
And after diving into the files in this repo I noticed that it doesn't have a processor_config.json. Is that a by design or a small bug?
Thank you!
Tim
Hi Tim! Yes, the processor config is missing on purpose. Chat template is loaded in its own json file on the hub, and can be used with the latest Transformers version. I just merged the PR for llava chat template support so it will work, so you can update it with !pip install --upgrade git+https://github.com/huggingface/transformers.git
Hello, I have updated my transformers with pip to the latest version (4.42.4), however, the error still occurred.
@Benjamin02
you have to update to the latest main branch since the changes were merged just a few days ago. You can do that by running pip install git+https://github.com/huggingface/transformers.git.
The PyPi release will be around next week
Thank you, @RaushanTurganbay !