Problem with submissions

#1
by kinzak - opened

Hello,

I am trying to run the evaluation on the random model (without any change to the code) on both text and image tasks. But the evaluation takes forever and doesn't produce any results after 2 hours. Can you please check if there is any problem with the template ? Thank you in advance.

Best regards

Hi,

I've the same issue, queue is like lasting "forever" lol, like it crashed on previous evaluation and got stuck.
It works fine when duplicating the space (in few minutes - although when it failed it required factory re-building) but it is not possible to submit as we don't have TOKENs.
I've been trying to submit on /image for 3 days now....

Any suggestion? Is it possible to restart the submission portal space? having TOKEN?

Thanks anyway for the organization, always great to be challenged on such topics.

Hi, I had the same issue but I solved it by going to the settings of my template space, then "Variables and secrets" and creating a Secret called HF_TOKEN with the value as my personal read token (that I created before in my personal account settings).

Hi @aweber ,

Thanks a lot for your help. For me, it didn't work with the "read" token, and with the "write" token, I had to put "create_pr=1" in api.upload_file argument so it reached the dataset but was waiting for pull request approval (that I've closed today).
Anyway it works today with the original space (no queueing) and I eventually managed to submit it.

Thanks a lot

Thank you all for your answers. However, I believe I've identified the root cause of my problem: the submission system works intermittently, typically functioning early in the morning but failing later in the day. I suspect this occurs when someone submits code containing an infinite loop or that produces and error and does not return the expect results, which then blocks the entire submission queue as the system waits indefinitely for that code to complete execution. To resolve this, I recommend implementing a timeout mechanism in the submission API to prevent any single submission from blocking the entire pipeline.

Sign up or log in to comment