Update README
Browse files
README.md
CHANGED
@@ -10,14 +10,11 @@ datasets:
|
|
10 |
|
11 |
# TAPAS base model fine-tuned on WikiSQL (in a supervised fashion)
|
12 |
|
13 |
-
|
14 |
-
This model was pre-trained on MLM and an additional step which the authors call intermediate pre-training, and then fine-tuned on [SQA](https://www.microsoft.com/en-us/download/details.aspx?id=54253) and
|
15 |
-
|
16 |
-
|
17 |
-
|
18 |
-
- `revision="v3"`, which corresponds to `tapas_wikisql_sqa_inter_masklm_base` (intermediate pre-training, absolute position embeddings)
|
19 |
-
- `revision="v2"`, which corresponds to `tapas_wikisql_sqa_masklm_base_reset` (no intermediate pre-training, relative position embeddings)
|
20 |
-
- `revision="v1"`, which corresponds to `tapas_wikisql_sqa_masklm_base` (no intermediate pre-training, absolute position embeddings)
|
21 |
|
22 |
Disclaimer: The team releasing TAPAS did not write a model card for this model so this model card has been written by
|
23 |
the Hugging Face team and contributors.
|
|
|
10 |
|
11 |
# TAPAS base model fine-tuned on WikiSQL (in a supervised fashion)
|
12 |
|
13 |
+
his model has 2 versions which can be used. The default version corresponds to the `tapas_wikisql_sqa_inter_masklm_base_reset` checkpoint of the [original Github repository](https://github.com/google-research/tapas).
|
14 |
+
This model was pre-trained on MLM and an additional step which the authors call intermediate pre-training, and then fine-tuned in a chain on [SQA](https://www.microsoft.com/en-us/download/details.aspx?id=54253), and [WikiSQL](https://github.com/salesforce/WikiSQL). It uses relative position embeddings (i.e. resetting the position index at every cell of the table).
|
15 |
+
|
16 |
+
The other (non-default) version which can be used is:
|
17 |
+
- `no_reset`, which corresponds to `tapas_wikisql_sqa_inter_masklm_base_reset` (intermediate pre-training, absolute position embeddings).
|
|
|
|
|
|
|
18 |
|
19 |
Disclaimer: The team releasing TAPAS did not write a model card for this model so this model card has been written by
|
20 |
the Hugging Face team and contributors.
|