fabianmmueller
commited on
Commit
·
a522133
1
Parent(s):
32e2026
Update README.md
Browse files
README.md
CHANGED
@@ -16,7 +16,7 @@ This model is a fine-tuned version of [gpt-j-6B-8bit](https://huggingface.co/hiv
|
|
16 |
|
17 |
## Model description
|
18 |
|
19 |
-
The model is a fine-tuned version of GPT-2 for generation of [Haikus](https://en.wikipedia.org/wiki/Haiku). The model, data and training procedure is inspired by a [blog post by Robert A. Gonsalves](https://
|
20 |
|
21 |
We used the same multitask training approach as in der post, but significantly extended the dataset (almost double the size of the original on). A prepared version of the dataset can be found [here](https://huggingface.co/datasets/statworx/haiku).
|
22 |
|
|
|
16 |
|
17 |
## Model description
|
18 |
|
19 |
+
The model is a fine-tuned version of GPT-2 for generation of [Haikus](https://en.wikipedia.org/wiki/Haiku). The model, data and training procedure is inspired by a [blog post by Robert A. Gonsalves](https://GPT-Jdsdatascience.com/deep-haiku-teaching-gpt-j-to-compose-with-syllable-patterns-5234bca9701). Instead of using a 8bit version of GPT-J 6B, we instead used vanilla GPT-2. From what we saw, the model performance comparable but is much easier to fine-tune.
|
20 |
|
21 |
We used the same multitask training approach as in der post, but significantly extended the dataset (almost double the size of the original on). A prepared version of the dataset can be found [here](https://huggingface.co/datasets/statworx/haiku).
|
22 |
|