English
align
clip
bgyoon commited on
Commit
248f3b8
1 Parent(s): d1875f9

Update README.md

Browse files

Update training setup. 8 days on V3-512

Files changed (1) hide show
  1. README.md +7 -7
README.md CHANGED
@@ -16,7 +16,7 @@ This is an unofficial implementation of [ALIGN](https://arxiv.org/abs/2102.05918
16
 
17
  It's developed by Kakao Brain to validate the performance of COYO-700M dataset on a large-scale model.
18
 
19
- The training took about 10 days on TPU V3-1024 with `batch_size=64k`.
20
 
21
  ## Model Date
22
 
@@ -34,10 +34,10 @@ This model is trained on [COYO-700M](https://github.com/kakaobrain/coyo-dataset)
34
 
35
  # Evaluation results
36
 
37
- | | Dataset | ImageNet | Flickr30k | | MsCOCO | |
38
- |--------------------------------|:----------:|:--------:|:---------:|:-------:|:-------:|:-------:|
39
- | | | KNN | I2T R@1 | T2I R@1 | I2T R@1 | T2I R@1 |
40
- | ALIGN-L2-Large(Google) | ALIGN 1.8B | 76.4 | 88.6 | 75.7 | 58.6 | 45.6 |
41
- | ALIGN-B7-Base(Google) | ALIGN 1.8B | 69.3 | - | - | 55.4 | 41.7 |
42
- | COYO-ALIGN-B7-Base(Kakao Brain) | COYO-700M | 68.6 | 88.1 | 73.2 | 61.2 | 43.1 |
43
 
 
16
 
17
  It's developed by Kakao Brain to validate the performance of COYO-700M dataset on a large-scale model.
18
 
19
+ The training took about 8 days on TPU V3-512.
20
 
21
  ## Model Date
22
 
 
34
 
35
  # Evaluation results
36
 
37
+ | | Dataset | ImageNet | Flickr30k | | MsCOCO | |
38
+ |----------------------------------|:----------:|:--------:|:---------:|:-------:|:-------:|:-------:|
39
+ | | | KNN | I2T R@1 | T2I R@1 | I2T R@1 | T2I R@1 |
40
+ | ALIGN-L2-Large(Google) | ALIGN 1.8B | 76.4 | 88.6 | 75.7 | 58.6 | 45.6 |
41
+ | ALIGN-B7-Base(Google) | ALIGN 1.8B | 69.3 | - | - | 55.4 | 41.7 |
42
+ | COYO-ALIGN-B7-Base(Kakao Brain) | COYO-700M | 68.6 | 88.1 | 73.2 | 61.2 | 43.1 |
43