backend / src

Commit History

change to lighteval's latest
0c0a603
Running

Clémentine commited on

updated with meg's suggestions + cleaned up a bit
412f8e5

Clémentine commited on

eval_harness_v043_updates (#10)
5375d59
verified

clefourrier HF staff meg HF staff commited on

Update src/envs.py
5506f29
verified

clefourrier HF staff commited on

Renaming environ variable (#6)
fbede76
verified

clefourrier HF staff meg HF staff commited on

Update src/envs.py
df9a594
verified

clefourrier HF staff commited on

adds variables EvalRequest is searching for (#8)
e47a979
verified

clefourrier HF staff meg HF staff commited on

added doc
7689092

Clémentine commited on

simplified backend
3e6770c

Clémentine commited on

debug inference endpoint launch and requirements
6bc96ff

Clémentine commited on

force cleanup on failure
1d6da9d

Clémentine commited on

changed default instance to cpu just in case
6902167

Clémentine commited on

added example for parameters
18abd06

Clémentine commited on

add logging back
272ebb9

Clémentine commited on

updated backend
08ae6c5

Clémentine commited on

CPU, TOKEN, env variables (#4)
55cc480
verified

clefourrier HF staff meg HF staff commited on

Update src/submission/check_validity.py
6eb8bfd

clefourrier HF staff commited on

made token a requirement
f982b8e

Clémentine commited on

test
f0298e1

Clémentine commited on

fix
c15e77e

Clémentine commited on

removed quantization to simplify
b899767

Clémentine commited on

now with a functionning backend
1ffc326

Clémentine commited on

update read
943f952

Clémentine commited on

fixs
314f91a

Clémentine commited on

updated leaderboard
efeee6d

Clémentine commited on

Simplified leaderboard v0
9833cdb

Clémentine commited on

simplified some parts of the code + updated requirements
9d22eee

Clémentine commited on

Added check on tokenizer to prevent submissions which won't run
7302987

Clémentine commited on

Update benchmark count and fix typo (`inetuning->finetuning`) (#395)
7abc6a7

clefourrier HF staff alvarobartt HF staff commited on

fix order of request file vs request file list, to avoid resubmitting issues
976f398

Clémentine commited on

cache
4ff9eef

Clémentine commited on

update for caching
395eff6

Clémentine commited on

add model architecture as column
3dfaf22

Clémentine commited on

Simplify About
eaace79

Clémentine commited on

Refactor 2 - added plotting back
b1a1395

Clémentine commited on

fix value error in param size
ccefec9

Clémentine commited on

Fix requirements for mistral models - to change once transformers gets updated.
002172c

Clémentine commited on

fix col width
fc1e99b

Clémentine commited on

refacto style + rate limit
df66f6e

Clémentine commited on

Fix TruthfulQA NaN scores to 0
bb17be3

Clémentine commited on

refacto part 1
2a5f9fb

Clémentine commited on

add new evals to the leaderboard
e3aaf53

Nathan Habib commited on

token for checking gated base models
f3cda22

Clémentine commited on

Fix BibTex author ordering (#342)
216309b

clefourrier HF staff lewtun HF staff commited on

fix disapearing models
280033c

Nathan Habib commited on

Merge branch 'main' of https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
0f4fbd6

Nathan Habib commited on

fix model display when fething metadata
624b3c8

Nathan Habib commited on