Spaces:
Running
on
CPU Upgrade
Update leaderboard so can support newer models? (Can't submit newer Qwen2+, gemma, phi models)
Any plans to update the leaderboard, so that it can support (detect) newer derivative models types such as qwen2, gemma2, & gemma, phi ?
the error message is Model {model name}was not found on the hub!
thx!
examples:
MaziyarPanahi/Qwen2-72B-Instruct-v0.1
pankajmathur/orca_mini_v7_72b
migtissera/Tess-v2.5.2-Qwen2-72B
dfurman/Qwen2-72B-Orpo-v0.1
cognitivecomputations/dolphin-2.9.2-qwen2-72b
cognitivecomputations/dolphin-2.9.2-qwen2-7b
Alibaba-NLP/gte-Qwen2-7B-instruct
Weyaxi/Einstein-v7-Qwen2-7B
BAAI/Infinity-Instruct-3M-0625-Qwen2-7B
macadeliccc/Samantha-Qwen-2-7B
openchat/openchat-3.5-0106-gemma
beomi/gemma-mling-7b
SakanaAI/DiscoPOP-zephyr-7b-gemma
TheDrummer/Big-Tiger-Gemma-27B-v1
TheDrummer/Tiger-Gemma-9B-v1
the error message is Model "{model name}" was not found on hub!
would bumping up the version of transformers in https://huggingface.co/spaces/BAAI/open_cn_llm_leaderboard/blob/main/requirements.txt help?
see https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard/discussions/859/files
here are some leaderboards that somehow supported those models , what could be updated, what is missing or out-of-date?
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard
Open-Arabic-LLM-Leaderboard
open_pt_llm_leaderboard
open-ko-llm-leaderboard