Update README.md
Browse files
README.md
CHANGED
@@ -17,10 +17,14 @@ For LLM and vision tower, we choose [OpenELM-270M-Instruct](apple/OpenELM-270M-I
|
|
17 |
|
18 |
# Result
|
19 |
|
20 |
-
|
21 |
|
22 |
| Category | # Samples | TP | FP | TN | FN | Accuracy | Precision | Recall | F1 Score | Yes Ratio |
|
23 |
|-------------|------------|------|-----|------|-----|----------|-----------|--------|----------|-----------|
|
24 |
| Adversarial | 3000 | 1264 | 575 | 925 | 236 | 0.7297 | 0.6873 | 0.8427 | 0.7571 | 0.613 |
|
25 |
| Popular | 3000 | 1264 | 301 | 1199 | 236 | 0.8210 | 0.8077 | 0.8427 | 0.8248 | 0.5217 |
|
26 |
| Random | 2910 | 1264 | 290 | 1120 | 236 | 0.8192 | 0.8134 | 0.8427 | 0.8278 | 0.5340 |
|
|
|
|
|
|
|
|
|
|
17 |
|
18 |
# Result
|
19 |
|
20 |
+
[POPE](https://tinyllava-factory.readthedocs.io/en/latest/Evaluation.html#pope):
|
21 |
|
22 |
| Category | # Samples | TP | FP | TN | FN | Accuracy | Precision | Recall | F1 Score | Yes Ratio |
|
23 |
|-------------|------------|------|-----|------|-----|----------|-----------|--------|----------|-----------|
|
24 |
| Adversarial | 3000 | 1264 | 575 | 925 | 236 | 0.7297 | 0.6873 | 0.8427 | 0.7571 | 0.613 |
|
25 |
| Popular | 3000 | 1264 | 301 | 1199 | 236 | 0.8210 | 0.8077 | 0.8427 | 0.8248 | 0.5217 |
|
26 |
| Random | 2910 | 1264 | 290 | 1120 | 236 | 0.8192 | 0.8134 | 0.8427 | 0.8278 | 0.5340 |
|
27 |
+
|
28 |
+
[TEXTVQA](https://tinyllava-factory.readthedocs.io/en/latest/Evaluation.html#textvqa)
|
29 |
+
|
30 |
+
Samples 5000, Accuracy 27%
|