robot-bengali-2 commited on
Commit
d10efa1
โ€ข
1 Parent(s): a3aed67

Update readme

Browse files
Files changed (1) hide show
  1. README.md +28 -26
README.md CHANGED
@@ -7,29 +7,31 @@ sdk: static
7
  pinned: false
8
  ---
9
 
10
- <p class="lg:col-span-3">
11
- This organization is a part of the NeurIPS 2021 demonstration <a href="https://training-transformers-together.github.io/">"Training Transformers Together"</a>.
12
- </p>
13
- <p class="lg:col-span-3">
14
- In this demo, we train a model similar to <a target="_blank" href="https://openai.com/blog/dall-e/">OpenAI DALL-E</a> โ€”
15
- a Transformer "language model" that generates images from text descriptions.
16
- It is trained on <a target="_blank" href="https://laion.ai/laion-400-open-dataset/">LAION-400M</a>,
17
- the world's largest openly available image-text-pair dataset with 400 million samples. Our model is based on
18
- the <a target="_blank" href="https://github.com/lucidrains/DALLE-pytorch">dalleโ€‘pytorch</a> implementation
19
- by <a target="_blank" href="https://github.com/lucidrains">Phil Wang</a> with a few tweaks to make it communication-efficient.
20
- </p>
21
- <p class="lg:col-span-3">
22
- See details about how to join and how it works on <a target="_blank" href="https://training-transformers-together.github.io/">our website</a>.
23
- </p>
24
- <p class="lg:col-span-3">
25
- This organization gathers people participating in the collaborative training and provides links to the necessary resources:
26
- </p>
27
- <ul class="lg:col-span-3">
28
- <li>๐Ÿ‘‰ Starter kits for <b>Google Colab</b> and <b>Kaggle</b> (easy way to join the training)</li>
29
- <li>๐Ÿ‘‰ <a target="_blank" href="https://huggingface.co/spaces/training-transformers-together/Dashboard">Dashboard</a> (the current training state: loss, number of peers, etc.)</li>
30
- <li>๐Ÿ‘‰ <a target="_blank" href="https://huggingface.co/training-transformers-together/dalle-demo">Model</a> (the latest checkpoint)</li>
31
- <li>๐Ÿ‘‰ <a target="_blank" href="https://huggingface.co/datasets/laion/laion_100m_vqgan_f8">Dataset</a></li>
32
- </ul>
33
- <p class="lg:col-span-3">
34
- Feel free to reach us on <a target="_blank" href="https://discord.gg/uGugx9zYvN">Discord</a> if you have any questions ๐Ÿ™‚
35
- </p>
 
 
 
7
  pinned: false
8
  ---
9
 
10
+ <div class="lg:col-span-3">
11
+ <p>
12
+ This organization is a part of the NeurIPS 2021 demonstration <a href="https://training-transformers-together.github.io/">"Training Transformers Together"</a>.
13
+ </p>
14
+ <p>
15
+ In this demo, we train a model similar to <a target="_blank" href="https://openai.com/blog/dall-e/">OpenAI DALL-E</a> โ€”
16
+ a Transformer "language model" that generates images from text descriptions.
17
+ It is trained on <a target="_blank" href="https://laion.ai/laion-400-open-dataset/">LAION-400M</a>,
18
+ the world's largest openly available image-text-pair dataset with 400 million samples. Our model is based on
19
+ the <a target="_blank" href="https://github.com/lucidrains/DALLE-pytorch">dalleโ€‘pytorch</a> implementation
20
+ by <a target="_blank" href="https://github.com/lucidrains">Phil Wang</a> with a few tweaks to make it communication-efficient.
21
+ </p>
22
+ <p>
23
+ See details about how to join and how it works on <a target="_blank" href="https://training-transformers-together.github.io/">our website</a>.
24
+ </p>
25
+ <p>
26
+ This organization gathers people participating in the collaborative training and provides links to the necessary resources:
27
+ </p>
28
+ <ul>
29
+ <li>๐Ÿ‘‰ Starter kits for <b>Google Colab</b> and <b>Kaggle</b> (easy way to join the training)</li>
30
+ <li>๐Ÿ‘‰ <a target="_blank" href="https://huggingface.co/spaces/training-transformers-together/Dashboard">Dashboard</a> (the current training state: loss, number of peers, etc.)</li>
31
+ <li>๐Ÿ‘‰ <a target="_blank" href="https://huggingface.co/training-transformers-together/dalle-demo">Model</a> (the latest checkpoint)</li>
32
+ <li>๐Ÿ‘‰ <a target="_blank" href="https://huggingface.co/datasets/laion/laion_100m_vqgan_f8">Dataset</a></li>
33
+ </ul>
34
+ <p>
35
+ Feel free to reach us on <a target="_blank" href="https://discord.gg/uGugx9zYvN">Discord</a> if you have any questions ๐Ÿ™‚
36
+ </p>
37
+ </div>