hbeadles commited on
Commit
cf9a941
1 Parent(s): 93faf03

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -0
README.md CHANGED
@@ -1,3 +1,22 @@
1
  ---
2
  license: mit
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
+ datasets:
4
+ - qiaojin/PubMedQA
5
+ language:
6
+ - en
7
+ pipeline_tag: text2text-generation
8
+ tags:
9
+ - medical
10
  ---
11
+
12
+ *Author - Hayden Beadles*
13
+
14
+ This model is meant to evaluate the results of creating an Encoder / Decoder generative model using SciBERT. The model is then finetuned on 30000 samples of the PubMedQA dataset. Instead of being finetuned
15
+ on the columns **question** and **final_answer**, where **final_answer** is a set of yes / no answers, we instead fine tune on the more challenging **long_answer** column, which gives a short answer
16
+ to the question.
17
+
18
+ The model was fine-tuned over 3 epochs, using the Adam learning rate scheduler, with a max length of 128 tokens.
19
+
20
+ The results are to help gauge SciBERT's abilities to answer (generate an answer) directly to a question, with no context provided. It is meant to evaluate the overall models training and attention towards
21
+ a more focused topic, to see if SciBERTs base training gives it any advantages.
22
+