Hugging Face's logo

Diogo-V
/
results-59994c68117e

English
Model card Files Community
1
Diogo-V commited on
Commit
16956e0
•
1 Parent(s): a973c74

Upload 2 files

Browse files
Files changed (2) hide show
  1. results.tsv +198 -0
  2. results.txt +0 -0
results.tsv CHANGED
@@ -1,4 +1,99 @@
1
  accuracy bits clip dataset method model params peak_mem_alloc_mb peak_mem_reserv_mb perplexity time_ms wer
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  0.0031746034510433 8 0.0 wikitext comb_5 phi ones_naive 4394.006528 4697.62048 1.1135467290878296 39.240111 0.0
3
  0.0031746034510433 7 0.0 wikitext comb_5 phi ones_naive 4394.006528 4697.62048 1.1135467290878296 39.294473 0.0
4
  0.0031746034510433 5 0.0 wikitext comb_5 phi ones_naive 4394.006528 4697.62048 1.1135467290878296 39.415238 0.0
@@ -933,6 +1028,101 @@ accuracy bits clip dataset method model params peak_mem_alloc_mb peak_mem_reserv
933
  0.0 6 0.0 librispeech comb_2 wav2vec ones_naive 368.001024 1572.864 0.0 0.068564 1.0
934
  0.0 7 0.0 librispeech comb_2 wav2vec ones_naive 368.001024 1572.864 0.0 0.068564 1.0
935
  0.0 8 0.0 librispeech comb_2 wav2vec ones_naive 368.001024 1572.864 0.0 0.068564 1.0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
936
  0.2965889573097229 4 0.0 wikitext ao_woq opt fixed 268.126208 740.294656 8.768630981445312 16.713258 0.0
937
  0.3245187401771545 7 0.0 wikitext woq opt fixed 670.234624 765.46048 7.905444145202637 21.34634 0.0
938
  0.3248564898967743 8 0.0 wikitext woq opt fixed 670.234624 782.237696 7.916111469268799 21.146683 0.0
@@ -972,3 +1162,11 @@ accuracy bits clip dataset method model params peak_mem_alloc_mb peak_mem_reserv
972
  0.0 6 0.0 librispeech woq wav2vec fixed 658.092544 4764.729344 0.0 96.317889 0.0234031339094832
973
  0.0 8 0.0 librispeech ao_woq wav2vec fixed 658.017792 4890.558464 0.0 94.874683 0.0239712250945444
974
  0.0 32 0.0 librispeech base wav2vec ---- 1564.76928 5620.36736 0.0 18.11403 0.0239473509600023
 
 
 
 
 
 
 
 
 
1
  accuracy bits clip dataset method model params peak_mem_alloc_mb peak_mem_reserv_mb perplexity time_ms wer
2
+ 0.0 4 0.0 wikitext comb_9 llama3 rnd_naive 14178.745344 15367.929856 1.1270830631256104 68.61207 0.0
3
+ 0.0 5 0.0 wikitext comb_9 llama3 rnd_naive 14178.745344 15367.929856 1.1270830631256104 68.61207 0.0
4
+ 0.0 6 0.0 wikitext comb_9 llama3 rnd_naive 14178.745344 15367.929856 1.1270830631256104 68.61207 0.0
5
+ 0.0 7 0.0 wikitext comb_9 llama3 rnd_naive 14178.745344 15367.929856 1.1270830631256104 68.61207 0.0
6
+ 0.0 8 0.0 wikitext comb_9 llama3 rnd_naive 14178.745344 15367.929856 1.1270830631256104 68.61207 0.0
7
+ 0.0 4 0.0 wikitext comb_0 llama3 rnd_naive 14178.745344 15367.929856 1.124814510345459 121.180847 0.0
8
+ 0.0 5 0.0 wikitext comb_0 llama3 rnd_naive 14178.745344 15367.929856 1.124814510345459 121.180847 0.0
9
+ 0.0 6 0.0 wikitext comb_0 llama3 rnd_naive 14178.745344 15367.929856 1.124814510345459 121.180847 0.0
10
+ 0.0 7 0.0 wikitext comb_0 llama3 rnd_naive 14178.745344 15367.929856 1.124814510345459 121.180847 0.0
11
+ 0.0 8 0.0 wikitext comb_0 llama3 rnd_naive 14178.745344 15367.929856 1.124814510345459 121.180847 0.0
12
+ 0.0 4 0.0 wikitext comb_14 llama3 rnd_naive 14178.745344 15367.929856 1.1248141527175903 146.000912 0.0
13
+ 0.0 5 0.0 wikitext comb_14 llama3 rnd_naive 14178.745344 15367.929856 1.1248141527175903 146.000912 0.0
14
+ 0.0 6 0.0 wikitext comb_14 llama3 rnd_naive 14178.745344 15367.929856 1.1248141527175903 146.000912 0.0
15
+ 0.0 7 0.0 wikitext comb_14 llama3 rnd_naive 14178.745344 15367.929856 1.1248141527175903 146.000912 0.0
16
+ 0.0 8 0.0 wikitext comb_14 llama3 rnd_naive 14178.745344 15367.929856 1.1248141527175903 146.000912 0.0
17
+ 0.0 4 0.0 wikitext comb_7 llama3 rnd_naive 14185.276416 15374.221312 inf 147.533869 0.0
18
+ 0.0 5 0.0 wikitext comb_7 llama3 rnd_naive 14185.276416 15374.221312 inf 147.533869 0.0
19
+ 0.0 6 0.0 wikitext comb_7 llama3 rnd_naive 14185.276416 15374.221312 inf 147.533869 0.0
20
+ 0.0 7 0.0 wikitext comb_7 llama3 rnd_naive 14185.276416 15374.221312 inf 147.533869 0.0
21
+ 0.0 8 0.0 wikitext comb_7 llama3 rnd_naive 14185.276416 15374.221312 inf 147.533869 0.0
22
+ 0.0 4 0.0 wikitext comb_8 llama3 rnd_naive 14185.276416 15374.221312 1.1312761306762695 147.605425 0.0
23
+ 0.0 5 0.0 wikitext comb_8 llama3 rnd_naive 14185.276416 15374.221312 1.1312761306762695 147.605425 0.0
24
+ 0.0 6 0.0 wikitext comb_8 llama3 rnd_naive 14185.276416 15374.221312 1.1312761306762695 147.605425 0.0
25
+ 0.0 7 0.0 wikitext comb_8 llama3 rnd_naive 14185.276416 15374.221312 1.1312761306762695 147.605425 0.0
26
+ 0.0 8 0.0 wikitext comb_8 llama3 rnd_naive 14185.276416 15374.221312 1.1312761306762695 147.605425 0.0
27
+ 0.0 4 0.0 wikitext comb_3 llama3 rnd_naive 14185.276416 15374.221312 inf 147.673844 0.0
28
+ 0.0 5 0.0 wikitext comb_3 llama3 rnd_naive 14185.276416 15374.221312 inf 147.673844 0.0
29
+ 0.0 6 0.0 wikitext comb_3 llama3 rnd_naive 14185.276416 15374.221312 inf 147.673844 0.0
30
+ 0.0 7 0.0 wikitext comb_3 llama3 rnd_naive 14185.276416 15374.221312 inf 147.673844 0.0
31
+ 0.0 8 0.0 wikitext comb_3 llama3 rnd_naive 14185.276416 15374.221312 inf 147.673844 0.0
32
+ 0.0047619054093956 8 0.0 wikitext comb_16 llama3 rnd_naive 14185.276416 15374.221312 1.1271474361419678 147.675717 0.0
33
+ 0.0 4 0.0 wikitext comb_16 llama3 rnd_naive 14185.276416 15374.221312 1.128304123878479 147.810892 0.0
34
+ 0.0 5 0.0 wikitext comb_16 llama3 rnd_naive 14185.276416 15374.221312 1.128304123878479 147.810892 0.0
35
+ 0.0 6 0.0 wikitext comb_16 llama3 rnd_naive 14185.276416 15374.221312 1.128304123878479 147.810892 0.0
36
+ 0.0 7 0.0 wikitext comb_16 llama3 rnd_naive 14185.276416 15374.221312 1.128304123878479 147.810892 0.0
37
+ 0.0 4 0.0 wikitext comb_15 llama3 rnd_naive 14185.276416 15374.221312 1.125555396080017 147.859648 0.0
38
+ 0.0 5 0.0 wikitext comb_15 llama3 rnd_naive 14185.276416 15374.221312 1.125555396080017 147.859648 0.0
39
+ 0.0 6 0.0 wikitext comb_15 llama3 rnd_naive 14185.276416 15374.221312 1.125555396080017 147.859648 0.0
40
+ 0.0 7 0.0 wikitext comb_15 llama3 rnd_naive 14185.276416 15374.221312 1.125555396080017 147.859648 0.0
41
+ 0.0 8 0.0 wikitext comb_15 llama3 rnd_naive 14185.276416 15374.221312 1.125555396080017 147.859648 0.0
42
+ 0.0 4 0.0 wikitext comb_11 llama3 rnd_naive 14185.276416 15374.221312 inf 148.119032 0.0
43
+ 0.0 5 0.0 wikitext comb_11 llama3 rnd_naive 14185.276416 15374.221312 inf 148.119032 0.0
44
+ 0.0 6 0.0 wikitext comb_11 llama3 rnd_naive 14185.276416 15374.221312 inf 148.119032 0.0
45
+ 0.0 7 0.0 wikitext comb_11 llama3 rnd_naive 14185.276416 15374.221312 inf 148.119032 0.0
46
+ 0.0 8 0.0 wikitext comb_11 llama3 rnd_naive 14185.276416 15374.221312 inf 148.119032 0.0
47
+ 0.0 4 0.0 wikitext comb_18 llama3 rnd_naive 14185.276416 15374.221312 1.127842903137207 148.305734 0.0
48
+ 0.0 5 0.0 wikitext comb_18 llama3 rnd_naive 14185.276416 15374.221312 1.127842903137207 148.305734 0.0
49
+ 0.0 6 0.0 wikitext comb_18 llama3 rnd_naive 14185.276416 15374.221312 1.127842903137207 148.305734 0.0
50
+ 0.0 7 0.0 wikitext comb_18 llama3 rnd_naive 14185.276416 15374.221312 1.127842903137207 148.305734 0.0
51
+ 0.0 8 0.0 wikitext comb_18 llama3 rnd_naive 14185.276416 15374.221312 1.127842903137207 148.305734 0.0
52
+ 0.0 4 0.0 wikitext comb_10 llama3 rnd_naive 14185.276416 15374.221312 1.1280388832092283 175.315905 0.0
53
+ 0.0 5 0.0 wikitext comb_10 llama3 rnd_naive 14185.276416 15374.221312 1.1280388832092283 175.315905 0.0
54
+ 0.0 6 0.0 wikitext comb_10 llama3 rnd_naive 14185.276416 15374.221312 1.1280388832092283 175.315905 0.0
55
+ 0.0 7 0.0 wikitext comb_10 llama3 rnd_naive 14185.276416 15374.221312 1.1280388832092283 175.315905 0.0
56
+ 0.0 8 0.0 wikitext comb_10 llama3 rnd_naive 14185.276416 15374.221312 1.1280388832092283 175.315905 0.0
57
+ 0.0 4 0.0 wikitext comb_13 llama3 rnd_naive 14185.276416 15374.221312 1.132457256317139 201.674953 0.0
58
+ 0.0 5 0.0 wikitext comb_13 llama3 rnd_naive 14185.276416 15374.221312 1.132457256317139 201.674953 0.0
59
+ 0.0 6 0.0 wikitext comb_13 llama3 rnd_naive 14185.276416 15374.221312 1.132457256317139 201.674953 0.0
60
+ 0.0 7 0.0 wikitext comb_13 llama3 rnd_naive 14185.276416 15374.221312 1.132457256317139 201.674953 0.0
61
+ 0.0 8 0.0 wikitext comb_13 llama3 rnd_naive 14185.276416 15374.221312 1.132457256317139 201.674953 0.0
62
+ 0.0 4 0.0 wikitext comb_4 llama3 rnd_naive 14185.276416 15374.221312 inf 201.791741 0.0
63
+ 0.0 5 0.0 wikitext comb_4 llama3 rnd_naive 14185.276416 15374.221312 inf 201.791741 0.0
64
+ 0.0 6 0.0 wikitext comb_4 llama3 rnd_naive 14185.276416 15374.221312 inf 201.791741 0.0
65
+ 0.0 7 0.0 wikitext comb_4 llama3 rnd_naive 14185.276416 15374.221312 inf 201.791741 0.0
66
+ 0.0 8 0.0 wikitext comb_4 llama3 rnd_naive 14185.276416 15374.221312 inf 201.791741 0.0
67
+ 0.0 4 0.0 wikitext comb_6 llama3 rnd_naive 14185.276416 15374.221312 inf 201.913845 0.0
68
+ 0.0 5 0.0 wikitext comb_6 llama3 rnd_naive 14185.276416 15374.221312 inf 201.913845 0.0
69
+ 0.0 6 0.0 wikitext comb_6 llama3 rnd_naive 14185.276416 15374.221312 inf 201.913845 0.0
70
+ 0.0 7 0.0 wikitext comb_6 llama3 rnd_naive 14185.276416 15374.221312 inf 201.913845 0.0
71
+ 0.0 8 0.0 wikitext comb_6 llama3 rnd_naive 14185.276416 15374.221312 inf 201.913845 0.0
72
+ 0.0 4 0.0 wikitext comb_5 llama3 rnd_naive 11051.945984 18748.53888 inf 4.401662 0.0
73
+ 0.0 5 0.0 wikitext comb_5 llama3 rnd_naive 11051.945984 18748.53888 inf 4.401662 0.0
74
+ 0.0 6 0.0 wikitext comb_5 llama3 rnd_naive 11051.945984 18748.53888 inf 4.401662 0.0
75
+ 0.0 7 0.0 wikitext comb_5 llama3 rnd_naive 11051.945984 18748.53888 inf 4.401662 0.0
76
+ 0.0 8 0.0 wikitext comb_5 llama3 rnd_naive 11051.945984 18748.53888 inf 4.401662 0.0
77
+ 0.0 4 0.0 wikitext comb_2 llama3 rnd_naive 11051.945984 18748.53888 1.3248157501220703 4.419077 0.0
78
+ 0.0 5 0.0 wikitext comb_2 llama3 rnd_naive 11051.945984 18748.53888 1.3248157501220703 4.419077 0.0
79
+ 0.0 6 0.0 wikitext comb_2 llama3 rnd_naive 11051.945984 18748.53888 1.3248157501220703 4.419077 0.0
80
+ 0.0 7 0.0 wikitext comb_2 llama3 rnd_naive 11051.945984 18748.53888 1.3248157501220703 4.419077 0.0
81
+ 0.0 8 0.0 wikitext comb_2 llama3 rnd_naive 11051.945984 18748.53888 1.3248157501220703 4.419077 0.0
82
+ 0.0 4 0.0 wikitext comb_17 llama3 rnd_naive 16811.959808 19811.794944 1.245055079460144 426.203733 0.0
83
+ 0.0 5 0.0 wikitext comb_17 llama3 rnd_naive 16811.959808 19811.794944 1.245055079460144 426.203733 0.0
84
+ 0.0 6 0.0 wikitext comb_17 llama3 rnd_naive 16811.959808 19811.794944 1.245055079460144 426.203733 0.0
85
+ 0.0 7 0.0 wikitext comb_17 llama3 rnd_naive 16811.959808 19811.794944 1.245055079460144 426.203733 0.0
86
+ 0.0 8 0.0 wikitext comb_17 llama3 rnd_naive 16811.959808 19811.794944 1.245055079460144 426.203733 0.0
87
+ 0.0 4 0.0 wikitext comb_1 llama3 rnd_naive 11051.945984 23420.993536 inf 3.968299 0.0
88
+ 0.0 5 0.0 wikitext comb_1 llama3 rnd_naive 11051.945984 23420.993536 inf 3.968299 0.0
89
+ 0.0 6 0.0 wikitext comb_1 llama3 rnd_naive 11051.945984 23420.993536 inf 3.968299 0.0
90
+ 0.0 7 0.0 wikitext comb_1 llama3 rnd_naive 11051.945984 23420.993536 inf 3.968299 0.0
91
+ 0.0 8 0.0 wikitext comb_1 llama3 rnd_naive 11051.945984 23420.993536 inf 3.968299 0.0
92
+ 0.0 4 0.0 wikitext comb_12 llama3 rnd_naive 11051.945984 23420.993536 inf 4.029179 0.0
93
+ 0.0 5 0.0 wikitext comb_12 llama3 rnd_naive 11051.945984 23420.993536 inf 4.029179 0.0
94
+ 0.0 6 0.0 wikitext comb_12 llama3 rnd_naive 11051.945984 23420.993536 inf 4.029179 0.0
95
+ 0.0 7 0.0 wikitext comb_12 llama3 rnd_naive 11051.945984 23420.993536 inf 4.029179 0.0
96
+ 0.0 8 0.0 wikitext comb_12 llama3 rnd_naive 11051.945984 23420.993536 inf 4.029179 0.0
97
  0.0031746034510433 8 0.0 wikitext comb_5 phi ones_naive 4394.006528 4697.62048 1.1135467290878296 39.240111 0.0
98
  0.0031746034510433 7 0.0 wikitext comb_5 phi ones_naive 4394.006528 4697.62048 1.1135467290878296 39.294473 0.0
99
  0.0031746034510433 5 0.0 wikitext comb_5 phi ones_naive 4394.006528 4697.62048 1.1135467290878296 39.415238 0.0
 
1028
  0.0 6 0.0 librispeech comb_2 wav2vec ones_naive 368.001024 1572.864 0.0 0.068564 1.0
1029
  0.0 7 0.0 librispeech comb_2 wav2vec ones_naive 368.001024 1572.864 0.0 0.068564 1.0
1030
  0.0 8 0.0 librispeech comb_2 wav2vec ones_naive 368.001024 1572.864 0.0 0.068564 1.0
1031
+ 0.0 4 0.0 wikitext comb_5 llama3 ones_naive 14178.745344 15367.929856 1.1248141527175903 68.780319 0.0
1032
+ 0.0 5 0.0 wikitext comb_5 llama3 ones_naive 14178.745344 15367.929856 1.1248141527175903 68.780319 0.0
1033
+ 0.0 6 0.0 wikitext comb_5 llama3 ones_naive 14178.745344 15367.929856 1.1248141527175903 68.780319 0.0
1034
+ 0.0 7 0.0 wikitext comb_5 llama3 ones_naive 14178.745344 15367.929856 1.1248141527175903 68.780319 0.0
1035
+ 0.0 8 0.0 wikitext comb_5 llama3 ones_naive 14178.745344 15367.929856 1.1248141527175903 68.780319 0.0
1036
+ 0.0 4 0.0 wikitext comb_1 llama3 ones_naive 14178.745344 15367.929856 1.1248141527175903 121.336042 0.0
1037
+ 0.0 5 0.0 wikitext comb_1 llama3 ones_naive 14178.745344 15367.929856 1.1248141527175903 121.336042 0.0
1038
+ 0.0 6 0.0 wikitext comb_1 llama3 ones_naive 14178.745344 15367.929856 1.1248141527175903 121.336042 0.0
1039
+ 0.0 7 0.0 wikitext comb_1 llama3 ones_naive 14178.745344 15367.929856 1.1248141527175903 121.336042 0.0
1040
+ 0.0 8 0.0 wikitext comb_1 llama3 ones_naive 14178.745344 15367.929856 1.1248141527175903 121.336042 0.0
1041
+ 0.0 4 0.0 wikitext comb_8 llama3 ones_naive 14178.745344 15367.929856 1.1248141527175903 146.361352 0.0
1042
+ 0.0 5 0.0 wikitext comb_8 llama3 ones_naive 14178.745344 15367.929856 1.1248141527175903 146.361352 0.0
1043
+ 0.0 6 0.0 wikitext comb_8 llama3 ones_naive 14178.745344 15367.929856 1.1248141527175903 146.361352 0.0
1044
+ 0.0 7 0.0 wikitext comb_8 llama3 ones_naive 14178.745344 15367.929856 1.1248141527175903 146.361352 0.0
1045
+ 0.0 8 0.0 wikitext comb_8 llama3 ones_naive 14178.745344 15367.929856 1.1248141527175903 146.361352 0.0
1046
+ 0.0 4 0.0 wikitext comb_13 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 147.521419 0.0
1047
+ 0.0 5 0.0 wikitext comb_13 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 147.521419 0.0
1048
+ 0.0 6 0.0 wikitext comb_13 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 147.521419 0.0
1049
+ 0.0 7 0.0 wikitext comb_13 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 147.521419 0.0
1050
+ 0.0 8 0.0 wikitext comb_13 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 147.521419 0.0
1051
+ 0.0 4 0.0 wikitext comb_10 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 147.585522 0.0
1052
+ 0.0 5 0.0 wikitext comb_10 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 147.585522 0.0
1053
+ 0.0 6 0.0 wikitext comb_10 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 147.585522 0.0
1054
+ 0.0 7 0.0 wikitext comb_10 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 147.585522 0.0
1055
+ 0.0 8 0.0 wikitext comb_10 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 147.585522 0.0
1056
+ 0.0 4 0.0 wikitext comb_4 llama3 ones_naive 14185.276416 15374.221312 1.645280838012695 147.826534 0.0
1057
+ 0.0 5 0.0 wikitext comb_4 llama3 ones_naive 14185.276416 15374.221312 1.645280838012695 147.826534 0.0
1058
+ 0.0 6 0.0 wikitext comb_4 llama3 ones_naive 14185.276416 15374.221312 1.645280838012695 147.826534 0.0
1059
+ 0.0 7 0.0 wikitext comb_4 llama3 ones_naive 14185.276416 15374.221312 1.645280838012695 147.826534 0.0
1060
+ 0.0 8 0.0 wikitext comb_4 llama3 ones_naive 14185.276416 15374.221312 1.645280838012695 147.826534 0.0
1061
+ 0.0 4 0.0 wikitext comb_11 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 147.891384 0.0
1062
+ 0.0 5 0.0 wikitext comb_11 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 147.891384 0.0
1063
+ 0.0 6 0.0 wikitext comb_11 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 147.891384 0.0
1064
+ 0.0 7 0.0 wikitext comb_11 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 147.891384 0.0
1065
+ 0.0 8 0.0 wikitext comb_11 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 147.891384 0.0
1066
+ 0.0 4 0.0 wikitext comb_0 llama3 ones_naive 14185.276416 15374.221312 1.4672420024871826 148.085272 0.0
1067
+ 0.0 5 0.0 wikitext comb_0 llama3 ones_naive 14185.276416 15374.221312 1.4672420024871826 148.085272 0.0
1068
+ 0.0 6 0.0 wikitext comb_0 llama3 ones_naive 14185.276416 15374.221312 1.4672420024871826 148.085272 0.0
1069
+ 0.0 7 0.0 wikitext comb_0 llama3 ones_naive 14185.276416 15374.221312 1.4672420024871826 148.085272 0.0
1070
+ 0.0 8 0.0 wikitext comb_0 llama3 ones_naive 14185.276416 15374.221312 1.4672420024871826 148.085272 0.0
1071
+ 0.0 4 0.0 wikitext comb_6 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 148.454214 0.0
1072
+ 0.0 5 0.0 wikitext comb_6 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 148.454214 0.0
1073
+ 0.0 6 0.0 wikitext comb_6 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 148.454214 0.0
1074
+ 0.0 7 0.0 wikitext comb_6 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 148.454214 0.0
1075
+ 0.0 8 0.0 wikitext comb_6 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 148.454214 0.0
1076
+ 0.0 4 0.0 wikitext comb_16 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 148.469213 0.0
1077
+ 0.0 5 0.0 wikitext comb_16 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 148.469213 0.0
1078
+ 0.0 6 0.0 wikitext comb_16 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 148.469213 0.0
1079
+ 0.0 7 0.0 wikitext comb_16 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 148.469213 0.0
1080
+ 0.0 8 0.0 wikitext comb_16 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 148.469213 0.0
1081
+ 0.0 4 0.0 wikitext comb_17 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 175.427792 0.0
1082
+ 0.0 5 0.0 wikitext comb_17 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 175.427792 0.0
1083
+ 0.0 6 0.0 wikitext comb_17 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 175.427792 0.0
1084
+ 0.0 7 0.0 wikitext comb_17 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 175.427792 0.0
1085
+ 0.0 8 0.0 wikitext comb_17 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 175.427792 0.0
1086
+ 0.0 4 0.0 wikitext comb_15 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 201.319148 0.0
1087
+ 0.0 5 0.0 wikitext comb_15 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 201.319148 0.0
1088
+ 0.0 6 0.0 wikitext comb_15 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 201.319148 0.0
1089
+ 0.0 7 0.0 wikitext comb_15 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 201.319148 0.0
1090
+ 0.0 8 0.0 wikitext comb_15 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 201.319148 0.0
1091
+ 0.0 4 0.0 wikitext comb_7 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 201.327619 0.0
1092
+ 0.0 5 0.0 wikitext comb_7 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 201.327619 0.0
1093
+ 0.0 6 0.0 wikitext comb_7 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 201.327619 0.0
1094
+ 0.0 7 0.0 wikitext comb_7 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 201.327619 0.0
1095
+ 0.0 8 0.0 wikitext comb_7 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 201.327619 0.0
1096
+ 0.0 4 0.0 wikitext comb_18 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 202.069355 0.0
1097
+ 0.0 5 0.0 wikitext comb_18 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 202.069355 0.0
1098
+ 0.0 6 0.0 wikitext comb_18 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 202.069355 0.0
1099
+ 0.0 7 0.0 wikitext comb_18 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 202.069355 0.0
1100
+ 0.0 8 0.0 wikitext comb_18 llama3 ones_naive 14185.276416 15374.221312 1.1248141527175903 202.069355 0.0
1101
+ 0.0 4 0.0 wikitext comb_14 llama3 ones_naive 11051.945984 18748.53888 1.12481427192688 4.410446 0.0
1102
+ 0.0 5 0.0 wikitext comb_14 llama3 ones_naive 11051.945984 18748.53888 1.12481427192688 4.410446 0.0
1103
+ 0.0 6 0.0 wikitext comb_14 llama3 ones_naive 11051.945984 18748.53888 1.12481427192688 4.410446 0.0
1104
+ 0.0 7 0.0 wikitext comb_14 llama3 ones_naive 11051.945984 18748.53888 1.12481427192688 4.410446 0.0
1105
+ 0.0 8 0.0 wikitext comb_14 llama3 ones_naive 11051.945984 18748.53888 1.12481427192688 4.410446 0.0
1106
+ 0.0 4 0.0 wikitext comb_9 llama3 ones_naive 11051.945984 18748.53888 1.6231656074523926 4.412567 0.0
1107
+ 0.0 5 0.0 wikitext comb_9 llama3 ones_naive 11051.945984 18748.53888 1.6231656074523926 4.412567 0.0
1108
+ 0.0 6 0.0 wikitext comb_9 llama3 ones_naive 11051.945984 18748.53888 1.6231656074523926 4.412567 0.0
1109
+ 0.0 7 0.0 wikitext comb_9 llama3 ones_naive 11051.945984 18748.53888 1.6231656074523926 4.412567 0.0
1110
+ 0.0 8 0.0 wikitext comb_9 llama3 ones_naive 11051.945984 18748.53888 1.6231656074523926 4.412567 0.0
1111
+ 0.0 4 0.0 wikitext comb_3 llama3 ones_naive 16811.959808 19811.794944 1.1248141527175903 426.501441 0.0
1112
+ 0.0 5 0.0 wikitext comb_3 llama3 ones_naive 16811.959808 19811.794944 1.1248141527175903 426.501441 0.0
1113
+ 0.0 6 0.0 wikitext comb_3 llama3 ones_naive 16811.959808 19811.794944 1.1248141527175903 426.501441 0.0
1114
+ 0.0 7 0.0 wikitext comb_3 llama3 ones_naive 16811.959808 19811.794944 1.1248141527175903 426.501441 0.0
1115
+ 0.0 8 0.0 wikitext comb_3 llama3 ones_naive 16811.959808 19811.794944 1.1248141527175903 426.501441 0.0
1116
+ 0.0 4 0.0 wikitext comb_2 llama3 ones_naive 11051.945984 23420.993536 1.1248141527175903 4.036888 0.0
1117
+ 0.0 5 0.0 wikitext comb_2 llama3 ones_naive 11051.945984 23420.993536 1.1248141527175903 4.036888 0.0
1118
+ 0.0 6 0.0 wikitext comb_2 llama3 ones_naive 11051.945984 23420.993536 1.1248141527175903 4.036888 0.0
1119
+ 0.0 7 0.0 wikitext comb_2 llama3 ones_naive 11051.945984 23420.993536 1.1248141527175903 4.036888 0.0
1120
+ 0.0 8 0.0 wikitext comb_2 llama3 ones_naive 11051.945984 23420.993536 1.1248141527175903 4.036888 0.0
1121
+ 0.0 4 0.0 wikitext comb_12 llama3 ones_naive 11051.945984 23420.993536 1.1248141527175903 4.044599 0.0
1122
+ 0.0 5 0.0 wikitext comb_12 llama3 ones_naive 11051.945984 23420.993536 1.1248141527175903 4.044599 0.0
1123
+ 0.0 6 0.0 wikitext comb_12 llama3 ones_naive 11051.945984 23420.993536 1.1248141527175903 4.044599 0.0
1124
+ 0.0 7 0.0 wikitext comb_12 llama3 ones_naive 11051.945984 23420.993536 1.1248141527175903 4.044599 0.0
1125
+ 0.0 8 0.0 wikitext comb_12 llama3 ones_naive 11051.945984 23420.993536 1.1248141527175903 4.044599 0.0
1126
  0.2965889573097229 4 0.0 wikitext ao_woq opt fixed 268.126208 740.294656 8.768630981445312 16.713258 0.0
1127
  0.3245187401771545 7 0.0 wikitext woq opt fixed 670.234624 765.46048 7.905444145202637 21.34634 0.0
1128
  0.3248564898967743 8 0.0 wikitext woq opt fixed 670.234624 782.237696 7.916111469268799 21.146683 0.0
 
1162
  0.0 6 0.0 librispeech woq wav2vec fixed 658.092544 4764.729344 0.0 96.317889 0.0234031339094832
1163
  0.0 8 0.0 librispeech ao_woq wav2vec fixed 658.017792 4890.558464 0.0 94.874683 0.0239712250945444
1164
  0.0 32 0.0 librispeech base wav2vec ---- 1564.76928 5620.36736 0.0 18.11403 0.0239473509600023
1165
+ 0.4277946949005127 4 0.0 wikitext ao_woq llama3 fixed 5542.3616 7163.871232 5.3583574295043945 39.050602 0.0
1166
+ 0.4437352418899536 8 0.0 wikitext ao_woq llama3 fixed 12110.375936 14040.43264 5.208643436431885 52.36158 0.0
1167
+ 0.3797703683376312 4 0.0 wikitext woq llama3 fixed 14179.331584 15367.929856 6.163248062133789 95.615827 0.0
1168
+ 0.4355623126029968 5 0.0 wikitext woq llama3 fixed 14179.331584 15367.929856 5.448963165283203 95.618313 0.0
1169
+ 0.443870335817337 8 0.0 wikitext woq llama3 fixed 14179.331584 15367.929856 5.208242893218994 95.65331 0.0
1170
+ 0.4409320950508117 6 0.0 wikitext woq llama3 fixed 14179.331584 15367.929856 5.193300724029541 95.732171 0.0
1171
+ 0.4427558183670044 7 0.0 wikitext woq llama3 fixed 14179.331584 15367.929856 5.248887062072754 95.895658 0.0
1172
+ 0.4436677098274231 32 0.0 wikitext base llama3 ---- 33003.526656 33155.97312 5.223813056945801 26.70374 0.0
results.txt CHANGED
The diff for this file is too large to render. See raw diff