kartikmosaicml commited on
Commit
572bbbf
1 Parent(s): 5a1cae6

Updating Readme

Browse files
Files changed (1) hide show
  1. README.md +2 -4
README.md CHANGED
@@ -47,7 +47,6 @@ CC-By-SA-3.0
47
  > What is a quoll?
48
 
49
  **MPT-30B-Instruct**:
50
- TBD (update these)
51
  >A Quoll (pronounced “cool”) is one of Australia’s native carnivorous marsupial mammals, which are also known as macropods or wallabies in other parts around Asia and South America
52
 
53
  ## How to Use
@@ -171,8 +170,7 @@ The data was tokenized using the [EleutherAI/gpt-neox-20b](https://huggingface.c
171
 
172
  ### Training Configuration
173
 
174
- TODO: this needs to be changed
175
- This model was trained using the [MosaicML Platform](https://www.mosaicml.com/platform).
176
  The model was trained with sharded data parallelism using [FSDP](https://pytorch.org/docs/stable/fsdp.html) and used the AdamW optimizer.
177
 
178
  ## Limitations and Biases
@@ -194,7 +192,7 @@ If you're interested in [training](https://www.mosaicml.com/training) and [deplo
194
 
195
  ## Disclaimer
196
 
197
- The license on this model does not constitute legal advice. We are not responsible for the actions of third parties who use this model. Please cosult an attorney before using this model for commercial purposes.
198
 
199
  ## Citation
200
 
 
47
  > What is a quoll?
48
 
49
  **MPT-30B-Instruct**:
 
50
  >A Quoll (pronounced “cool”) is one of Australia’s native carnivorous marsupial mammals, which are also known as macropods or wallabies in other parts around Asia and South America
51
 
52
  ## How to Use
 
170
 
171
  ### Training Configuration
172
 
173
+ This model was trained on 72 A100 40GB GPUs for 8 hours using the [MosaicML Platform](https://www.mosaicml.com/platform).
 
174
  The model was trained with sharded data parallelism using [FSDP](https://pytorch.org/docs/stable/fsdp.html) and used the AdamW optimizer.
175
 
176
  ## Limitations and Biases
 
192
 
193
  ## Disclaimer
194
 
195
+ The license on this model does not constitute legal advice. We are not responsible for the actions of third parties who use this model. Please consult an attorney before using this model for commercial purposes.
196
 
197
  ## Citation
198