Update README.md
Browse files
README.md
CHANGED
@@ -19,10 +19,7 @@ widget:
|
|
19 |
example_title: "Question Answering"
|
20 |
---
|
21 |
|
22 |
-
<
|
23 |
-
<img src="https://toma.together.xyz/logo.svg" width="110"/>
|
24 |
-
<h1>TOGETHER<h1/>
|
25 |
-
</div>
|
26 |
|
27 |
***!!! Be careful, this repo is still under construction. The content might change recently. !!!***
|
28 |
|
@@ -61,5 +58,4 @@ We truncate the input sequence to 2048 tokens, and for input sequence that conta
|
|
61 |
# Infrastructure
|
62 |
|
63 |
We used [the Together Research Computer](https://together.xyz/) to conduct training.
|
64 |
-
Specifically, we used 4 data parallel workers, each containing 2 \* A100 80GB GPUs.
|
65 |
-
Together Research Computer connects clusters at Stanford University, ETH Zurich, Open Science Grid, and University of Wisconsin-Madison.
|
|
|
19 |
example_title: "Question Answering"
|
20 |
---
|
21 |
|
22 |
+
<h1>TOGETHER RESEARCH<h1/>
|
|
|
|
|
|
|
23 |
|
24 |
***!!! Be careful, this repo is still under construction. The content might change recently. !!!***
|
25 |
|
|
|
58 |
# Infrastructure
|
59 |
|
60 |
We used [the Together Research Computer](https://together.xyz/) to conduct training.
|
61 |
+
Specifically, we used 4 data parallel workers, each containing 2 \* A100 80GB GPUs.
|
|