怎么测试mmlu数据集精度呢?

#48
by StriveForC - opened

我在本地测试mmlu的精度是50.6,没办法复现61.4

Knowledge Engineering Group (KEG) & Data Mining at Tsinghua University org

你是使用base模型吗

是的,请问有提供精度测试的code吗

Knowledge Engineering Group (KEG) & Data Mining at Tsinghua University org

目前没有

zRzRzRzRzRzRzR changed discussion status to closed

Sign up or log in to comment