Create README.md

README.md

@@ -0,0 +1,92 @@
+```
+!pip install transformers
+!pip install torch
+```
+```
+import torch
+from transformers import AutoTokenizer, AutoModelForCausalLM
+tokenizer = AutoTokenizer.from_pretrained("BigSalmon/PointsToParagraphNeo1.3B")
+model = AutoModelForCausalLM.from_pretrained("BigSalmon/PointsToParagraphNeo1.3B")
+```
+
+```
+prompt = """
+- advent
+- podcasts
+- entertainment
+- is an industry transformed
+- no longer
+- consumers touch clicker or turn on radio
+- people plug in their earbuds to listen to a podcast
+- this changing mediums for reasons
+- can be done anywhere
+- more optionality in content
+text: as podcasts have"""
+input_ids = tokenizer.encode(prompt, return_tensors='pt')
+outputs = model.generate(input_ids=input_ids,
+                             max_length=10 + len(prompt),
+                             temperature=1.0,
+                             top_k=50,
+                             top_p=0.95,
+                             do_sample=True,
+                             num_return_sequences=5,
+                             early_stopping=True)
+for i in range(5):
+  print(tokenizer.decode(outputs[i]))
+```
+Most likely outputs (Disclaimer: I highly recommend using this over just generating):
+```
+prompt = """
+- advent
+- podcasts
+- entertainment
+- is an industry transformed
+- no longer
+- consumers touch clicker or turn on radio
+- people plug in their earbuds to listen to a podcast
+- this changing mediums for reasons
+- can be done anywhere
+- more optionality in content
+text: as podcasts have"""
+text = tokenizer.encode(prompt)
+myinput, past_key_values = torch.tensor([text]), None
+myinput = myinput
+myinput= myinput.to(device)
+logits, past_key_values = model(myinput, past_key_values = past_key_values, return_dict=False)
+logits = logits[0,-1]
+probabilities = torch.nn.functional.softmax(logits)
+best_logits, best_indices = logits.topk(250)
+best_words = [tokenizer.decode([idx.item()]) for idx in best_indices]
+text.append(best_indices[0].item())
+best_probabilities = probabilities[best_indices].tolist()
+words = []   
+print(best_words)
+```
+
+Example:
+```
+- advent
+- podcasts
+- entertainment
+- is an industry transformed
+- no longer
+- consumers touch clicker or turn on radio
+- people plug in their earbuds to listen to a podcast
+- this changing mediums for reasons
+- can be done anywhere
+- more optionality in content
+text: as podcasts have proliferated, the entertainment industry has been fundamentally reshaped. in place of flipping through channels or spinning the dial, consumers are plugging in their earbuds to enjoy audio content. this evolution in media consumption is not without explanation, but rather a function of greater portability and content optionality.
+
+***
+
+- newborn
+- caring for
+- full-time job
+- parents
+- often have to work normal job
+- paid leave needs to be universal
+- so parents not overworked
+- child is cared for
+- can spend special time together
+text: tending to a newborn is a full-time job. regrettably, many parents must perform this duty alongside their conventional employment. to spare them from such strain, paid leave must be universal. in this way, children will be provided for, while the parent-child bond will be strengthened.
+```