Dataset generation is absurdly slow
Sorry if I'm rather inexperienced, this is one of my first LLM projects. This tool just doesn't work for me like 90% of the time. When I click "regenerate sample" it works perfectly fine, and within a few seconds I instantly get the results back. When I try to create a dataset however, it sometimes works like one or two times, but then it just doesn't anymore. It loads perpetually forever and ever.
After 2 hours of waiting, I still had this. This was with just the base 10 number of rows.
It seems to occur whenever I start a dataset process, and then interrupt it(by refreshing the page or closing my computer for example). Whenever I do that, it just breaks for the next few hours.
Hi @qkasriel , data generation normally is rather slow. I think the interruption causes the process to remain active until it has finished running, causing it to seem unresponsive. I think the batching issue fix, might have also resolved a part of the problem.
Alright, thanks!