shizue commited on
Commit
718a69b
β€’
1 Parent(s): 0998fbb

update submission format

Browse files
Files changed (1) hide show
  1. content.py +2 -1
content.py CHANGED
@@ -18,11 +18,12 @@ This dataset is proposed in the ICLR 2024 paper: [Measuring Vision-Language STEM
18
  ## How to Submit
19
  Feel free to follow our code to format your predictions on our test set. Scores are accuracy. In our paper, we also provide exam scores from millions of elementary students on the dataset.
20
 
21
- We expect each row of the submission file to contain the predicted `answer_idx` for each question of the test set. Note that the order of the predictions should follow the order of the questions of the dataset. Below is an example submission format. The complete example file can be downloaded [here](https://raw.githubusercontent.com/stemdataset/STEM/main/example_preds/random_test_preds.txt).
22
  ```text
23
  2
24
  0
25
  0
 
26
  ...
27
  ```
28
 
 
18
  ## How to Submit
19
  Feel free to follow our code to format your predictions on our test set. Scores are accuracy. In our paper, we also provide exam scores from millions of elementary students on the dataset.
20
 
21
+ We expect each row of the submission file to contain the predicted `answer_idx` for each question of the test set. Note that the order of the predictions should follow the order of the questions of the dataset. Below is an example submission format.
22
  ```text
23
  2
24
  0
25
  0
26
+ 1
27
  ...
28
  ```
29