Commit History

Moved reqs for higher tgi container version
86e6b81

Shaltiel commited on

Moved back to install from huggingface lighteval
625a925

Shaltiel commited on

Renamed token secret
049923d

Shaltiel commited on

Fixed whitespace for prediction
adf0b2e

Shaltiel commited on

Added english tasks
fe281bf

Shaltiel commited on

Added model info passing directly
45e5a75

Shaltiel commited on

Removed xml tags from heq score
5d21832

Shaltiel commited on

Disabled limit
22e8b00

Shaltiel commited on

Fix winograd task comparison
d643a0e

Shaltiel commited on

Disabled upload of log
18907b9

Shaltiel commited on

added support for 8bit, 4bit, gpq
d47ac37

Shaltiel commited on

Added winograd tasks
5f1bc85

Shaltiel commited on

Updated json dump + fix evaluation
eb2a0ba

Shaltiel commited on

Added sentiment, added lots of monkey patching
7798457

Shaltiel commited on

fixed recursion
8ff6e46

Shaltiel commited on

Fixed patch
9ff3dc7

Shaltiel commited on

Try 2 with monkey patch
01b7fc0

Shaltiel commited on

monkey patch func 3
18f5bd1

Shaltiel commited on

Added disable tqdm
ef4c1c3

Shaltiel commited on

Fixed return
5c22430

Shaltiel commited on

Fixed add special tokens
8447248

Shaltiel commited on

Updated reuse existing
c0bdfc9

Shaltiel commited on

Patched tokenization
19caf33

Shaltiel commited on

Patched the task
d243b31

Shaltiel commited on

Changed list to tuple
acaeec7

Shaltiel commited on

Fixed name
2f97778

Shaltiel commited on

Added missing param
3d4c820

Shaltiel commited on

Added call outside of try catch
03c1807

Shaltiel commited on

Added reuse disabled cleanup
eb22e2e

Shaltiel commited on

Disabled resue
95ad884

Shaltiel commited on

Added exception printing
51bfeec

Shaltiel commited on

Added params
d876fb6

Shaltiel commited on

Redo metric
7e34f5e

Shaltiel commited on

Updated container + instance type
79410f6

Shaltiel commited on

Removed TGI docker update
4debe6f

Shaltiel commited on

Monkeypatched create inference
cc39e19

Shaltiel commited on

Fix patch
fa2a7fa

Shaltiel commited on

Updated config patch
c911bc5

Shaltiel commited on

Added patch for name
3f6926c

Shaltiel commited on

Fixed endpoint model
d943ab1

Shaltiel commited on

Fixed envs
2c38fe4

Shaltiel commited on

Added monkey patch
4eba5d7

Shaltiel commited on

Fixed endpoint model
1ba7e1c

Shaltiel commited on

Add default namespace
72bd0af

Shaltiel commited on

Updated run eval suite
f72e694

Shaltiel commited on

Fixed logging dir
e0361b5

Shaltiel commited on

Prepped for QA test
b686823

Shaltiel commited on

force cleanup on failure
1d6da9d

Clémentine commited on

changed default instance to cpu just in case
6902167

Clémentine commited on

added example for parameters
18abd06

Clémentine commited on