backend_demo / src /backend /run_eval_suite_lighteval.py

Commit History

Added instance size exception for gemma-2
0462f2c

Shaltiel commited on

Removed gemma-2 exceptions and moved to stable container
1fb69db

Shaltiel commited on

force gemma-2 on a100
6b03453

Shaltiel commited on

Added custom container for gemma 2
837a251

Shaltiel commited on

Updated tgi inference version
f100cf0

Shaltiel commited on

Added ilfacts task (not for eval yet) and updated backend with fallback
9e82c5f

Shaltiel commited on

Fixed quotes
87ef24d

Shaltiel commited on

Added timeout redundancy, fixed naming for underscores
67fde66

Shaltiel commited on

Fixed cleanup + increased translation
d0d5565

Shaltiel commited on

Fixed cleanup with reuse existing
73adc1c

Shaltiel commited on

Fix names that start with -
b4de7a5

Shaltiel commited on

Updated backend to use newer version of lighteval
9378bc3

Shaltiel commited on

Added owner to namespace
e6396f6

Shaltiel commited on

Added revision + increased batch size
7135a84

Shaltiel commited on

Removed save details
2e91fe1

Shaltiel commited on

Added english tasks
fe281bf

Shaltiel commited on

Added model info passing directly
45e5a75

Shaltiel commited on

Updated json dump + fix evaluation
eb2a0ba

Shaltiel commited on

Added sentiment, added lots of monkey patching
7798457

Shaltiel commited on

Updated reuse existing
c0bdfc9

Shaltiel commited on

Patched the task
d243b31

Shaltiel commited on

Fixed name
2f97778

Shaltiel commited on

Added missing param
3d4c820

Shaltiel commited on

Added call outside of try catch
03c1807

Shaltiel commited on

Added reuse disabled cleanup
eb22e2e

Shaltiel commited on

Disabled resue
95ad884

Shaltiel commited on

Added exception printing
51bfeec

Shaltiel commited on

Added params
d876fb6

Shaltiel commited on

Fixed endpoint model
d943ab1

Shaltiel commited on

Added monkey patch
4eba5d7

Shaltiel commited on

Fixed endpoint model
1ba7e1c

Shaltiel commited on

Add default namespace
72bd0af

Shaltiel commited on

Updated run eval suite
f72e694

Shaltiel commited on

force cleanup on failure
1d6da9d

Clémentine commited on

updated backend
08ae6c5

Clémentine commited on