AmelieSchreiber commited on
Commit
a912e2f
1 Parent(s): 692f69c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -8,7 +8,7 @@ In this model, we wanted to see how the performance metrics were effected by ada
8
  shown to be the most important hyperparameter for improvement in performance metrics by far, whereas hyperparameters such as rank and scaling
9
  factor were shown to be negligible in importance, with lower rank being just as good as higher rank. So, we decided to test the difference between
10
  simply using the query, key, and value weight matrix adapters to using adapters for all possible weight matrices. The comparison for the
11
- first epoch can be seen below. Note the minor performance improvements for the model using every possible weight matrix.
12
 
13
  ### This model
14
 
 
8
  shown to be the most important hyperparameter for improvement in performance metrics by far, whereas hyperparameters such as rank and scaling
9
  factor were shown to be negligible in importance, with lower rank being just as good as higher rank. So, we decided to test the difference between
10
  simply using the query, key, and value weight matrix adapters to using adapters for all possible weight matrices. The comparison for the
11
+ first epoch can be seen below. Note the minor performance improvements for the model using every possible weight matrix (this model).
12
 
13
  ### This model
14