Fractalego
commited on
Commit
•
664e452
1
Parent(s):
75a48cb
deleted MD file
Browse files
README.MD
DELETED
@@ -1,69 +0,0 @@
|
|
1 |
-
## Introduction
|
2 |
-
Code for the paper [Exploring the zero-shot limit of FewRel](https://www.aclweb.org/anthology/2020.coling-main.124). This repository implements a zero-shot relation extractor.
|
3 |
-
|
4 |
-
## Dataset
|
5 |
-
The dataset FewRel 1.0 has been created in the paper
|
6 |
-
[ FewRel: A Large-Scale Few-Shot Relation Classification Dataset with State-of-the-Art Evaluation](https://www.aclweb.org/anthology/D18-1514.pdf)
|
7 |
-
and is available [here](https://github.com/thunlp/FewRel).
|
8 |
-
|
9 |
-
## Run the Extractor from the notebook
|
10 |
-
An example relation extraction is in this [notebook](/notebooks/extractor_examples.ipynb).
|
11 |
-
The extractor needs a list of candidate relations in English
|
12 |
-
```python
|
13 |
-
relations = ['noble title', 'founding date', 'occupation of a person']
|
14 |
-
extractor = RelationExtractor(model, tokenizer, relations)
|
15 |
-
```
|
16 |
-
Then the model ranks the surface forms by the belief that the relation
|
17 |
-
connects the entities in the text
|
18 |
-
```python
|
19 |
-
extractor.rank(text='John Smith received an OBE', head='John Smith', tail='OBE')
|
20 |
-
|
21 |
-
[('noble title', 0.9690611883997917),
|
22 |
-
('occupation of a person', 0.0012609362602233887),
|
23 |
-
('founding date', 0.00024014711380004883)]
|
24 |
-
```
|
25 |
-
|
26 |
-
## Training
|
27 |
-
This repository contains 4 training scripts related to the 4 models in the paper.
|
28 |
-
```bash
|
29 |
-
train_bert_large_with_squad.py
|
30 |
-
train_bert_large_without_squad.py
|
31 |
-
train_distillbert_with_squad.py
|
32 |
-
train_distillbert_without_squad.py
|
33 |
-
```
|
34 |
-
|
35 |
-
## Validation
|
36 |
-
There are also 4 scripts for validation
|
37 |
-
```bash
|
38 |
-
test_bert_large_with_squad.py
|
39 |
-
test_bert_large_without_squad.py
|
40 |
-
test_distillbert_with_squad.py
|
41 |
-
test_distillbert_without_squad.py
|
42 |
-
```
|
43 |
-
|
44 |
-
The results as in the paper are
|
45 |
-
|
46 |
-
| Model | 0-shot 5-ways | 0-shot 10-ways |
|
47 |
-
|------------------------|--------------|----------------|
|
48 |
-
|(1) Distillbert |70.1±0.5 | 55.9±0.6 |
|
49 |
-
|(2) Bert Large |80.8±0.4 | 69.6±0.5 |
|
50 |
-
|(3) Distillbert + SQUAD |81.3±0.4 | 70.0±0.2 |
|
51 |
-
|(4) Bert Large + SQUAD |86.0±0.6 | 76.2±0.4 |
|
52 |
-
|
53 |
-
## Cite as
|
54 |
-
```bibtex
|
55 |
-
@inproceedings{cetoli-2020-exploring,
|
56 |
-
title = "Exploring the zero-shot limit of {F}ew{R}el",
|
57 |
-
author = "Cetoli, Alberto",
|
58 |
-
booktitle = "Proceedings of the 28th International Conference on Computational Linguistics",
|
59 |
-
month = dec,
|
60 |
-
year = "2020",
|
61 |
-
address = "Barcelona, Spain (Online)",
|
62 |
-
publisher = "International Committee on Computational Linguistics",
|
63 |
-
url = "https://www.aclweb.org/anthology/2020.coling-main.124",
|
64 |
-
doi = "10.18653/v1/2020.coling-main.124",
|
65 |
-
pages = "1447--1451",
|
66 |
-
abstract = "This paper proposes a general purpose relation extractor that uses Wikidata descriptions to represent the relation{'}s surface form. The results are tested on the FewRel 1.0 dataset, which provides an excellent framework for training and evaluating the proposed zero-shot learning system in English. This relation extractor architecture exploits the implicit knowledge of a language model through a question-answering approach.",
|
67 |
-
}
|
68 |
-
```
|
69 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
README.md
CHANGED
@@ -1,8 +1,7 @@
|
|
1 |
## Introduction
|
2 |
This is a zero-shot relation extractor based on the paper [Exploring the zero-shot limit of FewRel](https://www.aclweb.org/anthology/2020.coling-main.124).
|
3 |
|
4 |
-
##
|
5 |
-
Installation
|
6 |
```bash
|
7 |
$ pip install zero-shot-re
|
8 |
```
|
|
|
1 |
## Introduction
|
2 |
This is a zero-shot relation extractor based on the paper [Exploring the zero-shot limit of FewRel](https://www.aclweb.org/anthology/2020.coling-main.124).
|
3 |
|
4 |
+
## Installation
|
|
|
5 |
```bash
|
6 |
$ pip install zero-shot-re
|
7 |
```
|