Update README.md
Browse files
README.md
CHANGED
@@ -8,6 +8,8 @@ metrics:
|
|
8 |
- accuracy
|
9 |
tags:
|
10 |
- medical
|
|
|
|
|
11 |
pipeline_tag: question-answering
|
12 |
widget:
|
13 |
- text: >-
|
@@ -19,23 +21,21 @@ widget:
|
|
19 |
not harm the patient, as he does not want to make the patient worry
|
20 |
unnecessarily. He tells the resident to leave this complication out of the
|
21 |
operative report. Which of the following is the correct next action for the
|
22 |
-
resident to take?
|
23 |
-
|
24 |
-
|
25 |
-
|
26 |
-
D. Refuse to dictate the operative reporty.
|
27 |
context: >-
|
28 |
-
|
29 |
-
|
30 |
-
|
31 |
-
|
32 |
-
|
33 |
-
this as per ethical guidelines, is mandatory
|
34 |
example_title: Example 1
|
35 |
---
|
36 |
# Model Card for MedGENIE-fid-flan-t5-base-medqa
|
37 |
|
38 |
-
MedGENIE comprises a collection of language models designed to utilize generated contexts, rather than retrieved ones, for addressing multiple-choice open-domain questions in the medical domain. Specifically, **MedGENIE-fid-flan-t5-base-medqa** is a *fusion-in-decoder* (FID) model based on [flan-t5-base](https://huggingface.co/google/flan-t5-base)
|
39 |
|
40 |
## Model description
|
41 |
|
@@ -47,7 +47,7 @@ MedGENIE comprises a collection of language models designed to utilize generated
|
|
47 |
|
48 |
## Performance
|
49 |
|
50 |
-
At the time of release, **MedGENIE-fid-flan-t5-base-medqa** is a new lightweight SOTA model on MedQA-USMLE benchmark:
|
51 |
|
52 |
| Model | Ground (Source) | Learning | Params | Accuracy (↓) |
|
53 |
|----------------------------------|--------------------|---------------------------|-----------------|-------------------------------|
|
|
|
8 |
- accuracy
|
9 |
tags:
|
10 |
- medical
|
11 |
+
- question-answering
|
12 |
+
- fusion-in-decoder
|
13 |
pipeline_tag: question-answering
|
14 |
widget:
|
15 |
- text: >-
|
|
|
21 |
not harm the patient, as he does not want to make the patient worry
|
22 |
unnecessarily. He tells the resident to leave this complication out of the
|
23 |
operative report. Which of the following is the correct next action for the
|
24 |
+
resident to take? A. Disclose the error to the patient and put it in the
|
25 |
+
operative report B. Tell the attending that he cannot fail to disclose this
|
26 |
+
mistake C. Report the physician to the ethics committee D. Refuse to dictate
|
27 |
+
the operative reporty.
|
|
|
28 |
context: >-
|
29 |
+
Inadvertent Cutting of Tendon is a complication, it should be in the
|
30 |
+
Operative Reports The resident must put this complication in the operative
|
31 |
+
report and disscuss it with the patient. If there was no harm to the patent
|
32 |
+
and correction was done then theres nothing major for worry. But disclosing
|
33 |
+
this as per ethical guidelines, is mandatory
|
|
|
34 |
example_title: Example 1
|
35 |
---
|
36 |
# Model Card for MedGENIE-fid-flan-t5-base-medqa
|
37 |
|
38 |
+
MedGENIE comprises a collection of language models designed to utilize generated contexts, rather than retrieved ones, for addressing multiple-choice open-domain questions in the medical domain. Specifically, **MedGENIE-fid-flan-t5-base-medqa** is a *fusion-in-decoder* (FID) model based on [flan-t5-base](https://huggingface.co/google/flan-t5-base), trained on the [MedQA-USMLE](https://huggingface.co/datasets/disi-unibo-nlp/medqa-5-opt-MedGENIE) dataset and grounded on artificial contexts generated by [PMC-LLaMA-13B](https://huggingface.co/axiong/PMC_LLaMA_13B). This model achieves a new *state-of-the-art* (SOTA) performance over the corresponding test set.
|
39 |
|
40 |
## Model description
|
41 |
|
|
|
47 |
|
48 |
## Performance
|
49 |
|
50 |
+
At the time of release (February 2024), **MedGENIE-fid-flan-t5-base-medqa** is a new lightweight SOTA model on MedQA-USMLE benchmark:
|
51 |
|
52 |
| Model | Ground (Source) | Learning | Params | Accuracy (↓) |
|
53 |
|----------------------------------|--------------------|---------------------------|-----------------|-------------------------------|
|