lsmille commited on
Commit
57bf945
1 Parent(s): 3d4393c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -1
README.md CHANGED
@@ -20,7 +20,15 @@ It achieves the following results on the evaluation set:
20
 
21
  ## Model description
22
 
23
- More information needed
 
 
 
 
 
 
 
 
24
 
25
  ## Intended uses & limitations
26
 
 
20
 
21
  ## Model description
22
 
23
+ lora_alpha = 32
24
+ lora_dropout = 0.05
25
+ lora_r = 16
26
+ epochs = 3
27
+ learning rate = 3e-4
28
+ warmup_steps=0.5
29
+ gradient_accumulation_steps = 8
30
+ train_batch = 1
31
+ eval_batch = 1
32
 
33
  ## Intended uses & limitations
34