Update README.md
Browse files
README.md
CHANGED
@@ -1,33 +1,34 @@
|
|
1 |
-
---
|
2 |
-
language: en
|
3 |
-
tags:
|
4 |
-
- text-generation
|
5 |
-
- wikipedia
|
6 |
-
- pythia
|
7 |
-
license: apache-2.0
|
8 |
-
base_model: EleutherAI/pythia-70m-deduped
|
9 |
-
datasets:
|
10 |
-
- wikipedia
|
11 |
-
metrics:
|
12 |
-
- perplexity
|
13 |
-
- accuracy
|
14 |
-
model-index:
|
15 |
-
- name: pythia-70m-wikipedia-paragraphs
|
16 |
-
results:
|
17 |
-
- task:
|
18 |
-
name: Language Modeling
|
19 |
-
type: text-generation
|
20 |
-
dataset:
|
21 |
-
name: Wikipedia
|
22 |
-
type: wikipedia
|
23 |
-
metrics:
|
24 |
-
- name: Perplexity
|
25 |
-
type: perplexity
|
26 |
-
value: 31.26
|
27 |
-
- name: Accuracy
|
28 |
-
type: accuracy
|
29 |
-
value: 0.2728
|
30 |
-
|
|
|
31 |
|
32 |
# Pythia-70M Wikipedia Paragraphs Text Generation Model
|
33 |
|
@@ -80,25 +81,19 @@ use `set_seed(1234567)` to reproduce the results.
|
|
80 |
<details>
|
81 |
<summary>Input text: "Soon we dropped into a living forest, where cold-tolerant evergreens and boreal animals still evoke the Canadian heritage of an ecosystem pushed south by glaciers 20,000 years ago."</summary>
|
82 |
Output:
|
83 |
-
|
84 |
-
Soon we dropped into a living forest, where cold-tolerant evergreens and boreal animals still evoke the Canadian heritage of an ecosystem pushed south by glaciers 20,000 years ago. The next day we had to change our climate again and we worked with a new science, "our grasslands", we could have as well the most suitable habitat suitable for those species we have, and we are open to natural vegetation. Since the old ground has also been destroyed. The vegetation that weaver protect us is the natural habitat... We have done another good day of good work in both the northern and northern regions, so our work would provide a safe habitat for species and ecosystems. This ecosystem is where the natural ecosystems we inhabit with great potential is dependent on its ecosystem services and ecosystems.
|
85 |
-
|
86 |
-
Soon we dropped into a living forest, where cold-tolerant evergreens and boreal animals still evoke the Canadian heritage of an ecosystem pushed south by glaciers 20,000 years ago.
|
87 |
-
|
88 |
-
Soon we dropped into a living forest, where cold-tolerant evergreens and boreal animals still evoke the Canadian heritage of an ecosystem pushed south by glaciers 20,000 years ago. This is a very rich ecological history of the ecosystems in the eastern forests of the mountainous Sierra Moultrop, which is only part of the extensive forests of the region which in its east, which have been populated by the evergreen forest biomes for centuries. Some parts of the wild world of these forests are located in the forest around the village of Huebelof, a climate well defined and accessible region. The landscapes of this region are of particular interest in biodiversity including the vegetation of many regions and biodiversity of the forests. In addition to the great biodiversity of all the biodiversity out there, there are numerous biodiversity forests, like the extinct forest, the most biodiversity in the region. It does not cover a part of the forests found in the regions and are understudied or otherwise, by the very first decade of the forest degradation it has in fact occurred in natural history.
|
89 |
-
```
|
90 |
</details>
|
91 |
|
92 |
<details>
|
93 |
<summary>Input text: "The important thing was that I had an onion on my belt, which was the style at the time. I didn't have any white onions, because of the war. The only thing you could get was those big yellow ones."</summary>
|
94 |
Output:
|
95 |
-
|
96 |
-
The important thing was that I had an onion on my belt, which was the style at the time. I didn't have any white onions, because of the war. The only thing you could get was those big yellow ones. I looked at the stove. I said I couldn't make a dough in any kind, but the room was small enough with the stove when I went to the bottom of the stove, and, for a good night like work, I made them at the stove in the oven. The room was so hot that I could not bring the stove to cook, and I had only made a few short changes in the stove but I only did the cooking for a few days. This kind of experiment, however, had to wait and we were going up to the stove. I was amazed by the manner instructions, and I felt quite uncomfortable with the stove and, after some years of cooking, I thought that it would work better than when I wanted to get food and was ready to eat. But I couldn't get as much time. I also saw, I kept burning bread, and when I found the hot stove, I just had a cold.
|
97 |
-
|
98 |
-
The important thing was that I had an onion on my belt, which was the style at the time. I didn't have any white onions, because of the war. The only thing you could get was those big yellow ones.
|
99 |
-
|
100 |
-
The important thing was that I had an onion on my belt, which was the style at the time. I didn't have any white onions, because of the war. The only thing you could get was those big yellow ones. This is just something that I would try to soak in the sunshine. The bread I had for a little time to do, just get stuck in the end, and I had a very long time to get things done.
|
101 |
-
```
|
102 |
</details>
|
103 |
|
104 |
## Training Data
|
|
|
1 |
+
---
|
2 |
+
language: en
|
3 |
+
tags:
|
4 |
+
- text-generation
|
5 |
+
- wikipedia
|
6 |
+
- pythia
|
7 |
+
license: apache-2.0
|
8 |
+
base_model: EleutherAI/pythia-70m-deduped
|
9 |
+
datasets:
|
10 |
+
- agentlans/wikipedia-paragraphs
|
11 |
+
metrics:
|
12 |
+
- perplexity
|
13 |
+
- accuracy
|
14 |
+
model-index:
|
15 |
+
- name: pythia-70m-wikipedia-paragraphs
|
16 |
+
results:
|
17 |
+
- task:
|
18 |
+
name: Language Modeling
|
19 |
+
type: text-generation
|
20 |
+
dataset:
|
21 |
+
name: Wikipedia
|
22 |
+
type: wikipedia
|
23 |
+
metrics:
|
24 |
+
- name: Perplexity
|
25 |
+
type: perplexity
|
26 |
+
value: 31.26
|
27 |
+
- name: Accuracy
|
28 |
+
type: accuracy
|
29 |
+
value: 0.2728
|
30 |
+
pipeline_tag: text-generation
|
31 |
+
---
|
32 |
|
33 |
# Pythia-70M Wikipedia Paragraphs Text Generation Model
|
34 |
|
|
|
81 |
<details>
|
82 |
<summary>Input text: "Soon we dropped into a living forest, where cold-tolerant evergreens and boreal animals still evoke the Canadian heritage of an ecosystem pushed south by glaciers 20,000 years ago."</summary>
|
83 |
Output:
|
84 |
+
|
85 |
+
- Soon we dropped into a living forest, where cold-tolerant evergreens and boreal animals still evoke the Canadian heritage of an ecosystem pushed south by glaciers 20,000 years ago. The next day we had to change our climate again and we worked with a new science, "our grasslands", we could have as well the most suitable habitat suitable for those species we have, and we are open to natural vegetation. Since the old ground has also been destroyed. The vegetation that weaver protect us is the natural habitat... We have done another good day of good work in both the northern and northern regions, so our work would provide a safe habitat for species and ecosystems. This ecosystem is where the natural ecosystems we inhabit with great potential is dependent on its ecosystem services and ecosystems.
|
86 |
+
- Soon we dropped into a living forest, where cold-tolerant evergreens and boreal animals still evoke the Canadian heritage of an ecosystem pushed south by glaciers 20,000 years ago. The Canadian people who decided to migrate west through British Columbia were very rich in their wild products, with thousands of young people living nearby and uprooted for as long time. The Fraser settlers were mostly immigrants from the time their arrival in Canada and their wives took refuge with their ancestral relatives and settled on the forest of Gewa. The Aborigines and the Aborigines worked to make their way to the land they are, but the Aboriginal people had left their lands and the villages to them. During their time of arrival the Australians made up an inland strip of land known as the Little Burnocks, they were attacked by the Aborigines who came along their turn.
|
87 |
+
- Soon we dropped into a living forest, where cold-tolerant evergreens and boreal animals still evoke the Canadian heritage of an ecosystem pushed south by glaciers 20,000 years ago. This is a very rich ecological history of the ecosystems in the eastern forests of the mountainous Sierra Moultrop, which is only part of the extensive forests of the region which in its east, which have been populated by the evergreen forest biomes for centuries. Some parts of the wild world of these forests are located in the forest around the village of Huebelof, a climate well defined and accessible region. The landscapes of this region are of particular interest in biodiversity including the vegetation of many regions and biodiversity of the forests. In addition to the great biodiversity of all the biodiversity out there, there are numerous biodiversity forests, like the extinct forest, the most biodiversity in the region. It does not cover a part of the forests found in the regions and are understudied or otherwise, by the very first decade of the forest degradation it has in fact occurred in natural history.
|
|
|
|
|
|
|
88 |
</details>
|
89 |
|
90 |
<details>
|
91 |
<summary>Input text: "The important thing was that I had an onion on my belt, which was the style at the time. I didn't have any white onions, because of the war. The only thing you could get was those big yellow ones."</summary>
|
92 |
Output:
|
93 |
+
|
94 |
+
- The important thing was that I had an onion on my belt, which was the style at the time. I didn't have any white onions, because of the war. The only thing you could get was those big yellow ones. I looked at the stove. I said I couldn't make a dough in any kind, but the room was small enough with the stove when I went to the bottom of the stove, and, for a good night like work, I made them at the stove in the oven. The room was so hot that I could not bring the stove to cook, and I had only made a few short changes in the stove but I only did the cooking for a few days. This kind of experiment, however, had to wait and we were going up to the stove. I was amazed by the manner instructions, and I felt quite uncomfortable with the stove and, after some years of cooking, I thought that it would work better than when I wanted to get food and was ready to eat. But I couldn't get as much time. I also saw, I kept burning bread, and when I found the hot stove, I just had a cold.
|
95 |
+
- The important thing was that I had an onion on my belt, which was the style at the time. I didn't have any white onions, because of the war. The only thing you could get was those big yellow ones. I went to the house where I had made him. Then, I got to do something different, but now I knew so much about it and decided to take things first. The first time I finished my game, they worked at a restaurant and I never told them they were going to try a cook, and I kept going to the kitchen, then they would do it. Then some of the ingredients would work in the oven where they were cooking. Then we went to cook the cook and he made the dish in the oven, the cook only two nights."
|
96 |
+
- The important thing was that I had an onion on my belt, which was the style at the time. I didn't have any white onions, because of the war. The only thing you could get was those big yellow ones. This is just something that I would try to soak in the sunshine. The bread I had for a little time to do, just get stuck in the end, and I had a very long time to get things done.
|
|
|
|
|
|
|
97 |
</details>
|
98 |
|
99 |
## Training Data
|