Full dataset

Moving to just toxicity

Update src/envs.py

Changing to HF_TOKEN

Changes to whatever

Changing to BACKEND_TOKEN

Toxigen

string parsing error

Fixing timing bug

changing max new tokens to None due to continuing warning on backend: Running generate_until requests: 0%| | 13/99442 [10:42<1539:30:14, 55.74s/it]Both (=2048) and (=302) seem to have been set. will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)

changing batch size to auto

evaluation with hf not hf-auto

Run full eval

DEBUG

DEBUG

just realtoxicityprompts

Limit to 20 now

debug

debug

debug

debug

Debug

debug

Debug

Changing refresh rate to 1 hr

Updates, not sure what -- left over from last night

Refreshing less

Changing model from hf-causal-experimental to hf-auto

Trying to make it work with new EAI versions

Should be realtoxicityprompts as one of the target tasks

Removing argument throwing a TypeError

Update src/backend/run_eval_suite_harness.py

Remove parens

Handling change in name of ALL_TASKS

changing HF_TOKEN to TOKEN

Printing all data it's getting in to debug

Printing all data it's getting in to debug

Fixing base_model error

Updating REPO_ID

Updating to my own version

added doc

simplified backend

pr_3_add_button_readme_and_better_logs (#3)

debug inference endpoint launch and requirements

adding_log_visualizer (#1)

Args is being accessed incorrectly (#2)

force cleanup on failure

changed default instance to cpu just in case

added example for parameters

add logging back