Arena does not work anymore

#1
by Alexander-Fichtl - opened

Dear openreviewer community and team,

I tried uploading various papers to the reviewer arena, but the app keeps throwing errors:
Screenshot 2025-06-02 095259.png
Is there some preprocessing of the PDFs I have to do, or is the app outdated by now?

Moreover, I wanted to ask the authors if they would be willing to share the fine-tuned LMM Evaluator that you used in your paper (AI-Driven Review Systems: Evaluating LLMs in Scalable and Bias-Aware Academic Reviews) to do pairwise win-rates & rankings (bottom right in Figure 3). Our research team would like to do additional experiments (citing your publication of course).

Thank you, and all the best

Alex

Sign up or log in to comment