Commit
•
d2ac7a8
1
Parent(s):
58c4f53
add repo link
Browse files
README.md
CHANGED
|
@@ -51,6 +51,8 @@ Which of the following best characterizes binne bams?\n
|
|
| 51 |
|
| 52 |
**How do I pronounce the name of the model?** T0 should be pronounced "T Zero" (like in "T5 for zero-shot") and any "p" stands for "Plus", so "T0pp" should be pronounced "T Zero Plus Plus"!
|
| 53 |
|
|
|
|
|
|
|
| 54 |
# Model Description
|
| 55 |
|
| 56 |
T0* shows zero-shot task generalization on English natural language prompts, outperforming GPT-3 on many tasks, while being 16x smaller. It is a series of encoder-decoder models trained on a large set of different tasks specified in natural language prompts. We convert numerous English supervised datasets into prompts, each with multiple templates using varying formulations. These prompted datasets allow for benchmarking the ability of a model to perform completely unseen tasks specified in natural language. To obtain T0*, we fine-tune a pretrained language model on this multitask mixture covering many different NLP tasks.
|
|
|
|
| 51 |
|
| 52 |
**How do I pronounce the name of the model?** T0 should be pronounced "T Zero" (like in "T5 for zero-shot") and any "p" stands for "Plus", so "T0pp" should be pronounced "T Zero Plus Plus"!
|
| 53 |
|
| 54 |
+
**Official repository**: [bigscience-workshop/t-zero](https://github.com/bigscience-workshop/t-zero)
|
| 55 |
+
|
| 56 |
# Model Description
|
| 57 |
|
| 58 |
T0* shows zero-shot task generalization on English natural language prompts, outperforming GPT-3 on many tasks, while being 16x smaller. It is a series of encoder-decoder models trained on a large set of different tasks specified in natural language prompts. We convert numerous English supervised datasets into prompts, each with multiple templates using varying formulations. These prompted datasets allow for benchmarking the ability of a model to perform completely unseen tasks specified in natural language. To obtain T0*, we fine-tune a pretrained language model on this multitask mixture covering many different NLP tasks.
|