sbrzz commited on
Commit
1d504d2
1 Parent(s): b9a84c1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -1
README.md CHANGED
@@ -17,10 +17,14 @@ For LLM and vision tower, we choose [OpenELM-270M-Instruct](apple/OpenELM-270M-I
17
 
18
  # Result
19
 
20
- For now we measured only [POPE](https://tinyllava-factory.readthedocs.io/en/latest/Evaluation.html#pope) with these results
21
 
22
  | Category | # Samples | TP | FP | TN | FN | Accuracy | Precision | Recall | F1 Score | Yes Ratio |
23
  |-------------|------------|------|-----|------|-----|----------|-----------|--------|----------|-----------|
24
  | Adversarial | 3000 | 1264 | 575 | 925 | 236 | 0.7297 | 0.6873 | 0.8427 | 0.7571 | 0.613 |
25
  | Popular | 3000 | 1264 | 301 | 1199 | 236 | 0.8210 | 0.8077 | 0.8427 | 0.8248 | 0.5217 |
26
  | Random | 2910 | 1264 | 290 | 1120 | 236 | 0.8192 | 0.8134 | 0.8427 | 0.8278 | 0.5340 |
 
 
 
 
 
17
 
18
  # Result
19
 
20
+ [POPE](https://tinyllava-factory.readthedocs.io/en/latest/Evaluation.html#pope):
21
 
22
  | Category | # Samples | TP | FP | TN | FN | Accuracy | Precision | Recall | F1 Score | Yes Ratio |
23
  |-------------|------------|------|-----|------|-----|----------|-----------|--------|----------|-----------|
24
  | Adversarial | 3000 | 1264 | 575 | 925 | 236 | 0.7297 | 0.6873 | 0.8427 | 0.7571 | 0.613 |
25
  | Popular | 3000 | 1264 | 301 | 1199 | 236 | 0.8210 | 0.8077 | 0.8427 | 0.8248 | 0.5217 |
26
  | Random | 2910 | 1264 | 290 | 1120 | 236 | 0.8192 | 0.8134 | 0.8427 | 0.8278 | 0.5340 |
27
+
28
+ [TEXTVQA](https://tinyllava-factory.readthedocs.io/en/latest/Evaluation.html#textvqa)
29
+
30
+ Samples 5000, Accuracy 27%