Add clarifications/disclaimer

README.md

@@ -16,6 +16,16 @@ inference: false
 
 # MPT-30B
 
+This is the MPT-30B but with added support to finetune using peft (tested with qlora). It is not finetuned further, the weights are the same as the original MPT-30b.
+
+I have not traced through the whole huggingface stack to see if this is working correctly but it does finetune with qlora and outputs are reasonable.
+Inspired by implementations here https://huggingface.co/cekal/mpt-7b-peft-compatible/commits/main
+https://huggingface.co/mosaicml/mpt-7b/discussions/42.
+
+The original description for MosaicML team below:
+
+
+
 MPT-30B is a decoder-style transformer pretrained from scratch on 1T tokens of English text and code.
 This model was trained by [MosaicML](https://www.mosaicml.com).
 
@@ -242,4 +252,4 @@ for open-source foundation models},
     note      = {Accessed: 2023-06-22},
     urldate   = {2023-06-22}
 }
-```
+```