giacomo-frisoni commited on
Commit
9f78c04
·
verified ·
1 Parent(s): 2c63823

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -13
README.md CHANGED
@@ -8,6 +8,8 @@ metrics:
8
  - accuracy
9
  tags:
10
  - medical
 
 
11
  pipeline_tag: question-answering
12
  widget:
13
  - text: >-
@@ -19,23 +21,21 @@ widget:
19
  not harm the patient, as he does not want to make the patient worry
20
  unnecessarily. He tells the resident to leave this complication out of the
21
  operative report. Which of the following is the correct next action for the
22
- resident to take?
23
- A. Disclose the error to the patient and put it in the operative report
24
- B. Tell the attending that he cannot fail to disclose this mistake
25
- C. Report the physician to the ethics committee
26
- D. Refuse to dictate the operative reporty.
27
  context: >-
28
- Inadvertent Cutting of Tendon is a complication, it should be in the
29
- Operative Reports
30
- The resident must put this complication in the operative report and
31
- disscuss it with the patient. If there was no harm to the patent and
32
- correction was done then theres nothing major for worry. But disclosing
33
- this as per ethical guidelines, is mandatory
34
  example_title: Example 1
35
  ---
36
  # Model Card for MedGENIE-fid-flan-t5-base-medqa
37
 
38
- MedGENIE comprises a collection of language models designed to utilize generated contexts, rather than retrieved ones, for addressing multiple-choice open-domain questions in the medical domain. Specifically, **MedGENIE-fid-flan-t5-base-medqa** is a *fusion-in-decoder* (FID) model based on [flan-t5-base](https://huggingface.co/google/flan-t5-base) architecture, trained on the [MedQA-USMLE](https://huggingface.co/datasets/disi-unibo-nlp/medqa-5-opt-MedGENIE) dataset augmented with artificially generated contexts from [PMC-LLaMA-13B](https://huggingface.co/axiong/PMC_LLaMA_13B). This model achieves a new *state-of-the-art* (SOTA) performance over the corresponding test set.
39
 
40
  ## Model description
41
 
@@ -47,7 +47,7 @@ MedGENIE comprises a collection of language models designed to utilize generated
47
 
48
  ## Performance
49
 
50
- At the time of release, **MedGENIE-fid-flan-t5-base-medqa** is a new lightweight SOTA model on MedQA-USMLE benchmark:
51
 
52
  | Model | Ground (Source) | Learning | Params | Accuracy (↓) |
53
  |----------------------------------|--------------------|---------------------------|-----------------|-------------------------------|
 
8
  - accuracy
9
  tags:
10
  - medical
11
+ - question-answering
12
+ - fusion-in-decoder
13
  pipeline_tag: question-answering
14
  widget:
15
  - text: >-
 
21
  not harm the patient, as he does not want to make the patient worry
22
  unnecessarily. He tells the resident to leave this complication out of the
23
  operative report. Which of the following is the correct next action for the
24
+ resident to take? A. Disclose the error to the patient and put it in the
25
+ operative report B. Tell the attending that he cannot fail to disclose this
26
+ mistake C. Report the physician to the ethics committee D. Refuse to dictate
27
+ the operative reporty.
 
28
  context: >-
29
+ Inadvertent Cutting of Tendon is a complication, it should be in the
30
+ Operative Reports The resident must put this complication in the operative
31
+ report and disscuss it with the patient. If there was no harm to the patent
32
+ and correction was done then theres nothing major for worry. But disclosing
33
+ this as per ethical guidelines, is mandatory
 
34
  example_title: Example 1
35
  ---
36
  # Model Card for MedGENIE-fid-flan-t5-base-medqa
37
 
38
+ MedGENIE comprises a collection of language models designed to utilize generated contexts, rather than retrieved ones, for addressing multiple-choice open-domain questions in the medical domain. Specifically, **MedGENIE-fid-flan-t5-base-medqa** is a *fusion-in-decoder* (FID) model based on [flan-t5-base](https://huggingface.co/google/flan-t5-base), trained on the [MedQA-USMLE](https://huggingface.co/datasets/disi-unibo-nlp/medqa-5-opt-MedGENIE) dataset and grounded on artificial contexts generated by [PMC-LLaMA-13B](https://huggingface.co/axiong/PMC_LLaMA_13B). This model achieves a new *state-of-the-art* (SOTA) performance over the corresponding test set.
39
 
40
  ## Model description
41
 
 
47
 
48
  ## Performance
49
 
50
+ At the time of release (February 2024), **MedGENIE-fid-flan-t5-base-medqa** is a new lightweight SOTA model on MedQA-USMLE benchmark:
51
 
52
  | Model | Ground (Source) | Learning | Params | Accuracy (↓) |
53
  |----------------------------------|--------------------|---------------------------|-----------------|-------------------------------|