chiayewken
commited on
Commit
•
3e36cdd
1
Parent(s):
733e9ab
Update README.md
Browse files
README.md
CHANGED
@@ -9,10 +9,13 @@ datasets:
|
|
9 |
Our [repository](https://github.com/declare-lab/flan-alpaca) contains code for extending the [Stanford Alpaca](https://github.com/tatsu-lab/stanford_alpaca)
|
10 |
synthetic instruction tuning to existing instruction-tuned models such as [Flan-T5](https://arxiv.org/abs/2210.11416).
|
11 |
The pretrained models and demos are available on HuggingFace 🤗 :
|
12 |
-
|
13 |
-
|
14 |
-
|
15 |
-
|
|
|
|
|
|
|
16 |
|
17 |
### Why?
|
18 |
|
|
|
9 |
Our [repository](https://github.com/declare-lab/flan-alpaca) contains code for extending the [Stanford Alpaca](https://github.com/tatsu-lab/stanford_alpaca)
|
10 |
synthetic instruction tuning to existing instruction-tuned models such as [Flan-T5](https://arxiv.org/abs/2210.11416).
|
11 |
The pretrained models and demos are available on HuggingFace 🤗 :
|
12 |
+
|
13 |
+
| Model | Parameters | Training GPUs |
|
14 |
+
|---------------------------------------------------------------------------|------------|-----------------|
|
15 |
+
| [Flan-Alpaca-Base](https://huggingface.co/declare-lab/flan-alpaca-base) | 220M | 1x A6000 |
|
16 |
+
| [Flan-Alpaca-Large](https://huggingface.co/declare-lab/flan-alpaca-large) | 770M | 1x A6000 |
|
17 |
+
| [Flan-Alpaca-XL](https://huggingface.co/declare-lab/flan-alpaca-xl) | 3B | 1x A6000 |
|
18 |
+
| [Flan-Alpaca-XXL](https://huggingface.co/declare-lab/flan-alpaca-xxl) | 11B | 4x A6000 (FSDP) |
|
19 |
|
20 |
### Why?
|
21 |
|