gradio tqdm abnormal display

#6
by chenpangpang - opened

I install the python package use pip install -r requirements.txt. The inference is normal, but the display of gradio web is abnormal, like this:
截屏2024-08-29 11.55.33.png
May I ask if you have installed a specific version of Gradio or made any changes to the source code of Gradio package? May I ask what I should do?

Knowledge Engineering Group (KEG) & Data Mining at Tsinghua University org

When space is launched for the first time, it will compile the model once. This compilation takes less than an hour, and the displayed screen is your "error screen." This is normal. However, from the second time onwards, as long as space is not shut down, it will continue to infer at a faster speed. You can disable this optimization by removing this code

pipe.transformer = torch.compile(pipe.transformer, mode="max-autotune", fullgraph=True)

However, doing so requires an additional 30 seconds for each inference compared to after compilation

When space is launched for the first time, it will compile the model once. This compilation takes less than an hour, and the displayed screen is your "error screen." This is normal. However, from the second time onwards, as long as space is not shut down, it will continue to infer at a faster speed. You can disable this optimization by removing this code

pipe.transformer = torch.compile(pipe.transformer, mode="max-autotune", fullgraph=True)

However, doing so requires an additional 30 seconds for each inference compared to after compilation

You're so great, thank you very much!

zRzRzRzRzRzRzR changed discussion status to closed

Sign up or log in to comment