Commit History

Added admin exception for counters
98eee75

Shaltiel commited on

Updated backend to use rejected
ffccb41

Shaltiel commited on

force gemma-2 on a100
6b03453

Shaltiel commited on

Added custom container for gemma 2
837a251

Shaltiel commited on

Adjusted caps and params
d3573c0

Shaltiel commited on

Update README.md
c55e8f9
verified

Shaltiel commited on

Added 4bit support
3af3367

Shaltiel commited on

Added t4s back in for small models
59447e3

Shaltiel commited on

Updated tgi inference version
f100cf0

Shaltiel commited on

Moved back to a10g
17f7b4d

Shaltiel commited on

space change
5c49547

Shaltiel commited on

Updated reqs and allowed larger moels
ca8bbe5

Shaltiel commited on

Fixed dataset location
10bea21

Shaltiel commited on

Added ilfacts task
4d998ac

Shaltiel commited on

Added ilfacts task (not for eval yet) and updated backend with fallback
9e82c5f

Shaltiel commited on

Added restart every 12 hours so logs don't get huge
b128812

Shaltiel commited on

Updated counters to use use info
15b1ab3

Shaltiel commited on

Fixed quotes
87ef24d

Shaltiel commited on

Added timeout redundancy, fixed naming for underscores
67fde66

Shaltiel commited on

Added instance size t ocounter key
0270220

Shaltiel commited on

Fixed cleanup + increased translation
d0d5565

Shaltiel commited on

Added failed handling for large models
398ca01

Shaltiel commited on

Added snli task back in
098b102

Shaltiel commited on

Added snli task
c2465e1

Shaltiel commited on

Fixed cleanup with reuse existing
73adc1c

Shaltiel commited on

Updated instance sizes
0e63ee0

Shaltiel commited on

Fix names that start with -
b4de7a5

Shaltiel commited on

Update missing requirement
e0daeb0

Shaltiel commited on

Updated backend to use newer version of lighteval
9378bc3

Shaltiel commited on

Added filter for counters file
2036459

Shaltiel commited on

Added mkdir
ea2793e

Shaltiel commited on

Fixed quotemarks
cf9b0aa

Shaltiel commited on

Added caps management
0f5c75a

Shaltiel commited on

Fixed envs
b88b6bf

Shaltiel commited on

Added owner to namespace
e6396f6

Shaltiel commited on

Fixed results dir
c500f60

Shaltiel commited on

Updated owner organization
a08a2d9

Shaltiel commited on

Fixed translation metric
e40dcd5

Shaltiel commited on

Added translation task
fe84b5e

Shaltiel commited on

Added revision + increased batch size
7135a84

Shaltiel commited on

Removed save details
2e91fe1

Shaltiel commited on

Adjusted large dtype
3042a5d

Shaltiel commited on

choose better instance size
ee78bc4

Shaltiel commited on

Swapped to p4de
a04d546

Shaltiel commited on

Moved back to T4
e301a6e

Shaltiel commited on

Moved to A100
288c838

Shaltiel commited on

Fixed spelling
ae8f4f4

Shaltiel commited on

Added support for large models
ca54606

Shaltiel commited on

Moved reqs for higher tgi container version
86e6b81

Shaltiel commited on

Moved back to install from huggingface lighteval
625a925

Shaltiel commited on