Spaces:

livecodebench

/

leaderboard

like 32

Running

https://huggingface.co/livecodebench there are datasets here https://github.com/LiveCodeBench/livecodebench.github.io/tree/44ecb7d74a8ce27b465e131d1a113e32e90c1156/src/mocks the leaderboard is stored here as JSON

https://huggingface.co/livecodebench there are datasets here https://github.com/LiveCodeBench/livecodebench.github.io/tree/44ecb7d74a8ce27b465e131d1a113e32e90c1156/src/mocks the leaderboard is stored here as JSON

Thanks, but these are the raw results. How to download the leaderboard as csv?

Sorry, currently, we don't have any csv. You can reconstruct it from the JSONs easily though.

Sorry, currently, we don't have any csv. You can reconstruct it from the JSONs easily though.

How to achieve it quickly?

All the functions are contained here: https://github.com/LiveCodeBench/livecodebench.github.io/blob/44ecb7d74a8ce27b465e131d1a113e32e90c1156/src/leaderboardLib.tsx. I don't think we have a Python version for it right now

All the functions are contained here: https://github.com/LiveCodeBench/livecodebench.github.io/blob/44ecb7d74a8ce27b465e131d1a113e32e90c1156/src/leaderboardLib.tsx. I don't think we have a Python version for it right now

Thanks! Is there any particular function that I can look into so that I can export the dataframe as CSV directly?

function getLeaderboard(...) is the entry point, it uses function get_pass_at_1(...).