This is our script to evaluate InfiniteBench. | |
You need to first install dependencies from requirement.txt | |
``` | |
pip install -r requirement.txt | |
``` | |
Then you need to configure the model_path and data_home in *test_vllm.sh* and then run the following command | |
``` | |
bash test_vllm.sh | grep "final display" | |
``` | |
to get the corresponding score | |