pszemraj commited on
Commit
8123a13
1 Parent(s): f40f000

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -37,7 +37,7 @@ inference:
37
 
38
  >_this is the "latest" version of the model that has been trained the longest, currently at 70k steps_
39
 
40
- - motivation: typical datasets for summarization models are in the vein of PubMed / arXiv; for my use cases, I have found summaries created by models pretrained on these to be useful.
41
  - summarizing text via arXiv models will typically make the summary sound so needlessly complicated that you might as well have read the original text in that time.
42
  - this model is one attempt to help with that by using the [booksum](https://arxiv.org/abs/2105.08209) dataset to provide **explanatory summarization**
43
  - this model has been trained for seven epochs total (approx 70,000 steps) and is closer to finished.
@@ -93,7 +93,7 @@ print(result[0]['summary_text'])
93
 
94
  ## Alternate Checkpoint
95
 
96
- - if experiencing runtime / memory issues, try [this earlier checkpoint](https://huggingface.co/pszemraj/bigbird-pegasus-large-booksum-40k-K) at 40,000 steps which is almost as good at the explanatory summarization task, but runs faster.
97
 
98
  ---
99
 
 
37
 
38
  >_this is the "latest" version of the model that has been trained the longest, currently at 70k steps_
39
 
40
+ - motivation: typical datasets for summarization models are in the vein of PubMed / arXiv; for my use cases, I have found summaries created by models pretrained on these to be mostly useless.
41
  - summarizing text via arXiv models will typically make the summary sound so needlessly complicated that you might as well have read the original text in that time.
42
  - this model is one attempt to help with that by using the [booksum](https://arxiv.org/abs/2105.08209) dataset to provide **explanatory summarization**
43
  - this model has been trained for seven epochs total (approx 70,000 steps) and is closer to finished.
 
93
 
94
  ## Alternate Checkpoint
95
 
96
+ - if experiencing runtime/memory issues, try [this earlier checkpoint](https://huggingface.co/pszemraj/bigbird-pegasus-large-booksum-40k-K) at 40,000 steps which is almost as good at the explanatory summarization task but runs faster.
97
 
98
  ---
99