kartikmosaicml
commited on
Commit
•
572bbbf
1
Parent(s):
5a1cae6
Updating Readme
Browse files
README.md
CHANGED
@@ -47,7 +47,6 @@ CC-By-SA-3.0
|
|
47 |
> What is a quoll?
|
48 |
|
49 |
**MPT-30B-Instruct**:
|
50 |
-
TBD (update these)
|
51 |
>A Quoll (pronounced “cool”) is one of Australia’s native carnivorous marsupial mammals, which are also known as macropods or wallabies in other parts around Asia and South America
|
52 |
|
53 |
## How to Use
|
@@ -171,8 +170,7 @@ The data was tokenized using the [EleutherAI/gpt-neox-20b](https://huggingface.c
|
|
171 |
|
172 |
### Training Configuration
|
173 |
|
174 |
-
|
175 |
-
This model was trained using the [MosaicML Platform](https://www.mosaicml.com/platform).
|
176 |
The model was trained with sharded data parallelism using [FSDP](https://pytorch.org/docs/stable/fsdp.html) and used the AdamW optimizer.
|
177 |
|
178 |
## Limitations and Biases
|
@@ -194,7 +192,7 @@ If you're interested in [training](https://www.mosaicml.com/training) and [deplo
|
|
194 |
|
195 |
## Disclaimer
|
196 |
|
197 |
-
The license on this model does not constitute legal advice. We are not responsible for the actions of third parties who use this model. Please
|
198 |
|
199 |
## Citation
|
200 |
|
|
|
47 |
> What is a quoll?
|
48 |
|
49 |
**MPT-30B-Instruct**:
|
|
|
50 |
>A Quoll (pronounced “cool”) is one of Australia’s native carnivorous marsupial mammals, which are also known as macropods or wallabies in other parts around Asia and South America
|
51 |
|
52 |
## How to Use
|
|
|
170 |
|
171 |
### Training Configuration
|
172 |
|
173 |
+
This model was trained on 72 A100 40GB GPUs for 8 hours using the [MosaicML Platform](https://www.mosaicml.com/platform).
|
|
|
174 |
The model was trained with sharded data parallelism using [FSDP](https://pytorch.org/docs/stable/fsdp.html) and used the AdamW optimizer.
|
175 |
|
176 |
## Limitations and Biases
|
|
|
192 |
|
193 |
## Disclaimer
|
194 |
|
195 |
+
The license on this model does not constitute legal advice. We are not responsible for the actions of third parties who use this model. Please consult an attorney before using this model for commercial purposes.
|
196 |
|
197 |
## Citation
|
198 |
|