OpenAssistant
/

oasst-sft-6-llama-30b-xor

Model card Files Files and versions Community

kraaghavin commited on May 4, 2023

Commit

8a8679c

•

1 Parent(s): e9421e4

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -153,7 +153,7 @@ llama-30b-sft-6:
   deepspeed_config: configs/zero3_config_sft.json
   weight_decay: 0.0
   residual_dropout: 0.0
-  max_length: 2048
   use_flash_attention: true
   warmup_steps: 20
   gradient_checkpointing: true

   deepspeed_config: configs/zero3_config_sft.json
   weight_decay: 0.0
   residual_dropout: 0.0
+  max_length: 99999
   use_flash_attention: true
   warmup_steps: 20
   gradient_checkpointing: true