Update README.md

README.md

@@ -49,11 +49,12 @@ model = transformers.AutoModelForCausalLM.from_pretrained('mosaicml/mpt-7b-story
 model.to(device='cuda:0', dtype=torch.bfloat16)
 ```
 
-Although the model was trained with a sequence length of 2048, ALiBi enables users to increase the maximum sequence length during finetuning and/or inference. For example:
+Although the model was trained with a sequence length of 2048 and finetuned with a sequence length of 65536, 
+ALiBi enables users to increase the maximum sequence length during finetuning and/or inference. For example:
 
 ```python
 config = transformers.AutoConfig.from_pretrained('mosaicml/mpt-7b-storywriter', trust_remote_code=True)
-config.update({"max_seq_len": 4096})
+config.update({"max_seq_len": 83968})
 model = transformers.AutoModelForCausalLM.from_pretrained('mosaicml/mpt-7b-storywriter', config=config, trust_remote_code=True)
 ```