Update README.md
Browse files
README.md
CHANGED
@@ -35,11 +35,13 @@ inference:
|
|
35 |
|
36 |
# bigbird pegasus on the booksum dataset
|
37 |
|
38 |
-
|
|
|
|
|
39 |
- summarizing text via arXiv models will typically make the summary sound so needlessly complicated that you might as well have read the original text in that time.
|
40 |
-
- this model is one attempt to help with that
|
41 |
-
- this model has been trained for seven epochs total and is closer to finished.
|
42 |
-
- Will continue to improve (slowly, now that it has been trained
|
43 |
- the starting checkpoint was `google/bigbird-pegasus-large-bigpatent`
|
44 |
|
45 |
# example usage
|
|
|
35 |
|
36 |
# bigbird pegasus on the booksum dataset
|
37 |
|
38 |
+
_this is the "latest" version of the model that has been trained the longest, currently at 70k steps_
|
39 |
+
|
40 |
+
- motivation: typical datasets for summarization models are in the vein of PubMed / arXiv; for my use cases, I have found summaries created by models pretrained on these to be useful.
|
41 |
- summarizing text via arXiv models will typically make the summary sound so needlessly complicated that you might as well have read the original text in that time.
|
42 |
+
- this model is one attempt to help with that by using the [booksum](https://arxiv.org/abs/2105.08209) dataset to provide **explanatory summarization**
|
43 |
+
- this model has been trained for seven epochs total (approx 70,000 steps) and is closer to finished.
|
44 |
+
- Will continue to improve (slowly, now that it has been trained for a long time) based on any result findings/feedback.
|
45 |
- the starting checkpoint was `google/bigbird-pegasus-large-bigpatent`
|
46 |
|
47 |
# example usage
|