Update README.md
Browse files
README.md
CHANGED
@@ -12,11 +12,11 @@ inference: false
|
|
12 |
|
13 |
# Model Details
|
14 |
|
15 |
-
This is an implementation of [ALIGN](https://arxiv.org/abs/2102.05918) trained on [COYO-700M](https://github.com/kakaobrain/coyo-dataset). The official ALIGN is trained on its dataset of 1.8B samples. That dataset is not released to the public. Instead, we trained our implementation of ALIGN model on [COYO-700M](https://github.com/kakaobrain/coyo-dataset).
|
16 |
|
17 |
It's developed by Kakao Brain to validate the performance of COYO-700M dataset on a large-scale model.
|
18 |
|
19 |
-
The training took about 10 days on V3-1024 with batch_size=64k
|
20 |
|
21 |
## Model Date
|
22 |
|
|
|
12 |
|
13 |
# Model Details
|
14 |
|
15 |
+
This is an unofficial implementation of [ALIGN](https://arxiv.org/abs/2102.05918) trained on [COYO-700M](https://github.com/kakaobrain/coyo-dataset). The official ALIGN is trained on its dataset of 1.8B samples. That dataset is not released to the public. Instead, we trained our implementation of ALIGN model on [COYO-700M](https://github.com/kakaobrain/coyo-dataset).
|
16 |
|
17 |
It's developed by Kakao Brain to validate the performance of COYO-700M dataset on a large-scale model.
|
18 |
|
19 |
+
The training took about 10 days on TPU V3-1024 with `batch_size=64k`.
|
20 |
|
21 |
## Model Date
|
22 |
|