Update readme
Browse files
README.md
CHANGED
@@ -10,29 +10,29 @@ pinned: false
|
|
10 |
<!-- The classes below are necessary for correct rendering -->
|
11 |
<div class="lg:col-span-3">
|
12 |
<p class="mb-2">
|
13 |
-
This organization is a part of the NeurIPS 2021 demonstration <a href="https://training-transformers-together.github.io/">"Training Transformers Together"</a>.
|
14 |
</p>
|
15 |
<p class="mb-2">
|
16 |
In this demo, we train a model similar to <u><a target="_blank" href="https://openai.com/blog/dall-e/">OpenAI DALL-E</a></u> โ
|
17 |
a Transformer "language model" that generates images from text descriptions.
|
18 |
-
It is trained on <a target="_blank" href="https://laion.ai/laion-400-open-dataset/">LAION-400M</a>,
|
19 |
the world's largest openly available image-text-pair dataset with 400 million samples. Our model is based on
|
20 |
-
the <a target="_blank" href="https://github.com/lucidrains/DALLE-pytorch">dalleโpytorch</a> implementation
|
21 |
-
by <a target="_blank" href="https://github.com/lucidrains">Phil Wang</a> with a few tweaks to make it communication-efficient.
|
22 |
</p>
|
23 |
<p class="mb-2">
|
24 |
-
See details about how to join and how it works on <a target="_blank" href="https://training-transformers-together.github.io/">our website</a>.
|
25 |
</p>
|
26 |
<p class="mb-2">
|
27 |
This organization gathers people participating in the collaborative training and provides links to the necessary resources:
|
28 |
</p>
|
29 |
<ul class="mb-2">
|
30 |
<li>๐ Starter kits for <b>Google Colab</b> and <b>Kaggle</b> (easy way to join the training)</li>
|
31 |
-
<li>๐ <a target="_blank" href="https://huggingface.co/spaces/training-transformers-together/Dashboard">Dashboard</a> (the current training state: loss, number of peers, etc.)</li>
|
32 |
-
<li>๐ <a target="_blank" href="https://huggingface.co/training-transformers-together/dalle-demo">Model</a> (the latest checkpoint)</li>
|
33 |
-
<li>๐ <a target="_blank" href="https://huggingface.co/datasets/laion/laion_100m_vqgan_f8">Dataset</a></li>
|
34 |
</ul>
|
35 |
<p class="mb-2">
|
36 |
-
Feel free to reach us on <a target="_blank" href="https://discord.gg/uGugx9zYvN">Discord</a> if you have any questions ๐
|
37 |
</p>
|
38 |
</div>
|
|
|
10 |
<!-- The classes below are necessary for correct rendering -->
|
11 |
<div class="lg:col-span-3">
|
12 |
<p class="mb-2">
|
13 |
+
This organization is a part of the NeurIPS 2021 demonstration <u><a href="https://training-transformers-together.github.io/">"Training Transformers Together"</a></u>.
|
14 |
</p>
|
15 |
<p class="mb-2">
|
16 |
In this demo, we train a model similar to <u><a target="_blank" href="https://openai.com/blog/dall-e/">OpenAI DALL-E</a></u> โ
|
17 |
a Transformer "language model" that generates images from text descriptions.
|
18 |
+
It is trained on <u><a target="_blank" href="https://laion.ai/laion-400-open-dataset/">LAION-400M</a></u>,
|
19 |
the world's largest openly available image-text-pair dataset with 400 million samples. Our model is based on
|
20 |
+
the <u><a target="_blank" href="https://github.com/lucidrains/DALLE-pytorch">dalleโpytorch</a></u> implementation
|
21 |
+
by <u><a target="_blank" href="https://github.com/lucidrains">Phil Wang</a></u> with a few tweaks to make it communication-efficient.
|
22 |
</p>
|
23 |
<p class="mb-2">
|
24 |
+
See details about how to join and how it works on <u><a target="_blank" href="https://training-transformers-together.github.io/">our website</a></u>.
|
25 |
</p>
|
26 |
<p class="mb-2">
|
27 |
This organization gathers people participating in the collaborative training and provides links to the necessary resources:
|
28 |
</p>
|
29 |
<ul class="mb-2">
|
30 |
<li>๐ Starter kits for <b>Google Colab</b> and <b>Kaggle</b> (easy way to join the training)</li>
|
31 |
+
<li>๐ <u><a target="_blank" href="https://huggingface.co/spaces/training-transformers-together/Dashboard">Dashboard</a></u> (the current training state: loss, number of peers, etc.)</li>
|
32 |
+
<li>๐ <u><a target="_blank" href="https://huggingface.co/training-transformers-together/dalle-demo">Model</a></u> (the latest checkpoint)</li>
|
33 |
+
<li>๐ <u><a target="_blank" href="https://huggingface.co/datasets/laion/laion_100m_vqgan_f8">Dataset</a></u></li>
|
34 |
</ul>
|
35 |
<p class="mb-2">
|
36 |
+
Feel free to reach us on <u><a target="_blank" href="https://discord.gg/uGugx9zYvN">Discord</a></u> if you have any questions ๐
|
37 |
</p>
|
38 |
</div>
|