Spaces:
Runtime error
Runtime error
update submission format
Browse files- content.py +2 -1
content.py
CHANGED
@@ -18,11 +18,12 @@ This dataset is proposed in the ICLR 2024 paper: [Measuring Vision-Language STEM
|
|
18 |
## How to Submit
|
19 |
Feel free to follow our code to format your predictions on our test set. Scores are accuracy. In our paper, we also provide exam scores from millions of elementary students on the dataset.
|
20 |
|
21 |
-
We expect each row of the submission file to contain the predicted `answer_idx` for each question of the test set. Note that the order of the predictions should follow the order of the questions of the dataset. Below is an example submission format.
|
22 |
```text
|
23 |
2
|
24 |
0
|
25 |
0
|
|
|
26 |
...
|
27 |
```
|
28 |
|
|
|
18 |
## How to Submit
|
19 |
Feel free to follow our code to format your predictions on our test set. Scores are accuracy. In our paper, we also provide exam scores from millions of elementary students on the dataset.
|
20 |
|
21 |
+
We expect each row of the submission file to contain the predicted `answer_idx` for each question of the test set. Note that the order of the predictions should follow the order of the questions of the dataset. Below is an example submission format.
|
22 |
```text
|
23 |
2
|
24 |
0
|
25 |
0
|
26 |
+
1
|
27 |
...
|
28 |
```
|
29 |
|