robot-bengali-2 commited on
Commit
096a91f
ยท
unverified ยท
1 Parent(s): d016be4

Update readme

Browse files
Files changed (1) hide show
  1. README.md +9 -9
README.md CHANGED
@@ -10,29 +10,29 @@ pinned: false
10
  <!-- The classes below are necessary for correct rendering -->
11
  <div class="lg:col-span-3">
12
  <p class="mb-2">
13
- This organization is a part of the NeurIPS 2021 demonstration <a href="https://training-transformers-together.github.io/">"Training Transformers Together"</a>.
14
  </p>
15
  <p class="mb-2">
16
  In this demo, we train a model similar to <u><a target="_blank" href="https://openai.com/blog/dall-e/">OpenAI DALL-E</a></u> โ€”
17
  a Transformer "language model" that generates images from text descriptions.
18
- It is trained on <a target="_blank" href="https://laion.ai/laion-400-open-dataset/">LAION-400M</a>,
19
  the world's largest openly available image-text-pair dataset with 400 million samples. Our model is based on
20
- the <a target="_blank" href="https://github.com/lucidrains/DALLE-pytorch">dalleโ€‘pytorch</a> implementation
21
- by <a target="_blank" href="https://github.com/lucidrains">Phil Wang</a> with a few tweaks to make it communication-efficient.
22
  </p>
23
  <p class="mb-2">
24
- See details about how to join and how it works on <a target="_blank" href="https://training-transformers-together.github.io/">our website</a>.
25
  </p>
26
  <p class="mb-2">
27
  This organization gathers people participating in the collaborative training and provides links to the necessary resources:
28
  </p>
29
  <ul class="mb-2">
30
  <li>๐Ÿ‘‰ Starter kits for <b>Google Colab</b> and <b>Kaggle</b> (easy way to join the training)</li>
31
- <li>๐Ÿ‘‰ <a target="_blank" href="https://huggingface.co/spaces/training-transformers-together/Dashboard">Dashboard</a> (the current training state: loss, number of peers, etc.)</li>
32
- <li>๐Ÿ‘‰ <a target="_blank" href="https://huggingface.co/training-transformers-together/dalle-demo">Model</a> (the latest checkpoint)</li>
33
- <li>๐Ÿ‘‰ <a target="_blank" href="https://huggingface.co/datasets/laion/laion_100m_vqgan_f8">Dataset</a></li>
34
  </ul>
35
  <p class="mb-2">
36
- Feel free to reach us on <a target="_blank" href="https://discord.gg/uGugx9zYvN">Discord</a> if you have any questions ๐Ÿ™‚
37
  </p>
38
  </div>
 
10
  <!-- The classes below are necessary for correct rendering -->
11
  <div class="lg:col-span-3">
12
  <p class="mb-2">
13
+ This organization is a part of the NeurIPS 2021 demonstration <u><a href="https://training-transformers-together.github.io/">"Training Transformers Together"</a></u>.
14
  </p>
15
  <p class="mb-2">
16
  In this demo, we train a model similar to <u><a target="_blank" href="https://openai.com/blog/dall-e/">OpenAI DALL-E</a></u> โ€”
17
  a Transformer "language model" that generates images from text descriptions.
18
+ It is trained on <u><a target="_blank" href="https://laion.ai/laion-400-open-dataset/">LAION-400M</a></u>,
19
  the world's largest openly available image-text-pair dataset with 400 million samples. Our model is based on
20
+ the <u><a target="_blank" href="https://github.com/lucidrains/DALLE-pytorch">dalleโ€‘pytorch</a></u> implementation
21
+ by <u><a target="_blank" href="https://github.com/lucidrains">Phil Wang</a></u> with a few tweaks to make it communication-efficient.
22
  </p>
23
  <p class="mb-2">
24
+ See details about how to join and how it works on <u><a target="_blank" href="https://training-transformers-together.github.io/">our website</a></u>.
25
  </p>
26
  <p class="mb-2">
27
  This organization gathers people participating in the collaborative training and provides links to the necessary resources:
28
  </p>
29
  <ul class="mb-2">
30
  <li>๐Ÿ‘‰ Starter kits for <b>Google Colab</b> and <b>Kaggle</b> (easy way to join the training)</li>
31
+ <li>๐Ÿ‘‰ <u><a target="_blank" href="https://huggingface.co/spaces/training-transformers-together/Dashboard">Dashboard</a></u> (the current training state: loss, number of peers, etc.)</li>
32
+ <li>๐Ÿ‘‰ <u><a target="_blank" href="https://huggingface.co/training-transformers-together/dalle-demo">Model</a></u> (the latest checkpoint)</li>
33
+ <li>๐Ÿ‘‰ <u><a target="_blank" href="https://huggingface.co/datasets/laion/laion_100m_vqgan_f8">Dataset</a></u></li>
34
  </ul>
35
  <p class="mb-2">
36
+ Feel free to reach us on <u><a target="_blank" href="https://discord.gg/uGugx9zYvN">Discord</a></u> if you have any questions ๐Ÿ™‚
37
  </p>
38
  </div>