Update README.md

README.md

@@ -48,6 +48,24 @@ LongForm-**OPT-2.7B**: https://huggingface.co/akoksal/LongForm-OPT-2.7B
 
 LongForm-**OPT-6.7B**: https://huggingface.co/akoksal/LongForm-OPT-6.7B
 
+## How to Load
+```python
+import torch
+from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
+model = AutoModelForSeq2SeqLM.from_pretrained("akoksal/LongForm-T5-XL")
+tokenizer = AutoTokenizer.from_pretrained("akoksal/LongForm-T5-XL")
+
+instruction = "Write an essay about meditation."
+torch.manual_seed(42)
+input_ids = tokenizer(instruction, return_tensors="pt").input_ids
+target_ids = model.generate(input_ids, do_sample=True, max_new_tokens=50, top_p=0.9)
+tokenizer.decode(target_ids[0], skip_special_tokens=True)
+# Output:
+# > Meditation is an ancient, spiritual practice. Meditation was first\
+# practiced as early as 3000 BC by Indians. Meditation has been practiced\
+# by people for thousands of years. People meditate in order to become more\
+# present in their life. Meditation is
+```
 
 ## Evaluation
 We provide in-depth evaluation of LongForm models and baselines in the paper. We present the METEOR scores of models in out-of-domain datasets. In all tasks, Recipe Generation (RGen), long-form question answering (ELI5), short story generation (WritingPrompts/WP), LongForm models outperform prior instruction-tuned models.