m-biriuchinskii commited on
Commit
3a4402a
β€’
1 Parent(s): 635e5db

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +29 -0
README.md CHANGED
@@ -7,6 +7,35 @@ tags: []
7
 
8
  <!-- Provide a quick summary of what the model is/does. -->
9
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
 
11
 
12
  ## Model Details
 
7
 
8
  <!-- Provide a quick summary of what the model is/does. -->
9
 
10
+ ```
11
+ wandb: Run history:
12
+ wandb: eval/loss β–ˆβ–…β–„β–„β–‚β–β–β–β–β–β–
13
+ wandb: eval/runtime β–„β–‡β–ˆβ–†β–„β–β–…β–†β–ˆβ–ˆβ–†
14
+ wandb: eval/samples_per_second β–…β–‚β–β–ƒβ–…β–ˆβ–„β–ƒβ–β–β–ƒ
15
+ wandb: eval/steps_per_second β–…β–ƒβ–β–ƒβ–…β–ˆβ–„β–ƒβ–β–β–ƒ
16
+ wandb: train/epoch β–β–β–β–‚β–‚β–‚β–ƒβ–ƒβ–ƒβ–ƒβ–„β–„β–„β–…β–…β–…β–…β–†β–†β–†β–†β–‡β–‡β–‡β–‡β–ˆβ–ˆβ–ˆ
17
+ wandb: train/global_step β–β–β–β–‚β–‚β–‚β–ƒβ–ƒβ–ƒβ–ƒβ–„β–„β–„β–…β–…β–…β–…β–†β–†β–†β–†β–‡β–‡β–‡β–‡β–ˆβ–ˆβ–ˆ
18
+ wandb: train/grad_norm β–ˆβ–‚β–β–β–‚β–‚β–…β–‚β–β–‚β–β–β–‚β–‚β–‚β–‚
19
+ wandb: train/learning_rate β–ˆβ–ˆβ–‡β–‡β–†β–†β–…β–…β–„β–„β–ƒβ–ƒβ–‚β–‚β–β–
20
+ wandb: train/loss β–ˆβ–‚β–‚β–‚β–‚β–‚β–β–β–β–β–β–β–β–β–β–
21
+ wandb:
22
+ wandb: Run summary:
23
+ wandb: eval/loss 0.51836
24
+ wandb: eval/runtime 24.4996
25
+ wandb: eval/samples_per_second 13.714
26
+ wandb: eval/steps_per_second 4.571
27
+ wandb: total_flos 1.1922809488797696e+16
28
+ wandb: train/epoch 4.04908
29
+ wandb: train/global_step 330
30
+ wandb: train/grad_norm 0.55083
31
+ wandb: train/learning_rate 1e-05
32
+ wandb: train/loss 0.4739
33
+ wandb: train_loss 0.68432
34
+ wandb: train_runtime 680.5617
35
+ wandb: train_samples_per_second 4.775
36
+ wandb: train_steps_per_second 0.595
37
+
38
+ ```
39
 
40
 
41
  ## Model Details