Hugging Face's logo

Diogo-V
/
llama3-rnd-naive-127d0024f968

English
Model card Files Community
Diogo-V commited on
Commit
22d8d60
•
1 Parent(s): d30dcfd

Upload results for llama3

Browse files
Files changed (2) hide show
  1. results/df.tsv +104 -0
  2. results/results.txt +105 -0
results/df.tsv ADDED
@@ -0,0 +1,104 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ accuracy bits clip dataset method model params peak_mem_alloc_mb peak_mem_reserv_mb perplexity time_ms wer
2
+ 0.4277946949005127 4 0.0 wikitext ao_woq llama3 fixed 5542.3616 7163.871232 5.3583574295043945 39.154068 0.0
3
+ 0.0 4 0.0 wikitext comb_3 llama3 rnd_naive_t 14178.745344 15367.929856 1.2404378652572632 121.290098 0.0
4
+ 0.0 4 0.0 wikitext comb_7 llama3 rnd_naive_t 14178.745344 15367.929856 1.1248141527175903 145.772117 0.0
5
+ 0.4107396304607391 4 0.0 wikitext comb_15 llama3 rnd_naive_t 14179.216384 15367.929856 6.022488594055176 68.566352 0.0
6
+ 0.3797703683376312 4 0.0 wikitext woq llama3 fixed 14179.331584 15367.929856 6.163248062133789 95.443849 0.0
7
+ 0.0 4 0.0 wikitext comb_5 llama3 rnd_naive_t 14185.276416 15374.221312 1.1396069526672363 147.453751 0.0
8
+ 0.0 4 0.0 wikitext comb_4 llama3 rnd_naive_t 14185.276416 15374.221312 1.5296999216079712 147.613955 0.0
9
+ 0.0 4 0.0 wikitext comb_16 llama3 rnd_naive_t 14185.276416 15374.221312 1.502220869064331 148.156039 0.0
10
+ 0.0 4 0.0 wikitext comb_2 llama3 rnd_naive_t 14185.276416 15374.221312 21.74924087524414 201.14667 0.0
11
+ 0.0 4 0.0 wikitext comb_8 llama3 rnd_naive_t 14185.276416 15374.221312 1.4967589378356934 201.532075 0.0
12
+ 0.3953056633472442 4 0.0 wikitext comb_18 llama3 rnd_naive_t 14185.747456 15374.221312 6.411113262176514 147.345354 0.0
13
+ 0.3990544080734253 4 0.0 wikitext comb_17 llama3 rnd_naive_t 14185.747456 15374.221312 6.3313703536987305 147.383344 0.0
14
+ 0.4024316072463989 4 0.0 wikitext comb_11 llama3 rnd_naive_t 14185.747456 15374.221312 6.022574424743652 147.728652 0.0
15
+ 0.388787567615509 4 0.0 wikitext comb_1 llama3 rnd_naive_t 14185.747456 15374.221312 5.833009243011475 147.793208 0.0
16
+ 0.3959810733795166 4 0.0 wikitext comb_6 llama3 rnd_naive_t 14185.747456 15374.221312 6.2105631828308105 175.214864 0.0
17
+ 0.3873016238212585 4 0.0 wikitext comb_9 llama3 rnd_naive_t 14185.747456 15374.221312 6.1514811515808105 200.883484 0.0
18
+ 0.0 4 0.0 wikitext comb_14 llama3 rnd_naive_t 11051.945984 18748.53888 1.135580062866211 4.399678 0.0
19
+ 0.0 4 0.0 wikitext comb_10 llama3 rnd_naive_t 11051.945984 18748.53888 1.1248141527175903 4.400117 0.0
20
+ 0.0 4 0.0 wikitext comb_13 llama3 rnd_naive_t 16811.959808 19811.794944 1.144245147705078 426.279196 0.0
21
+ 0.0 4 0.0 wikitext comb_12 llama3 rnd_naive_t 11051.945984 23420.993536 1.138749122619629 4.01402 0.0
22
+ 0.0 4 0.0 wikitext comb_0 llama3 rnd_naive_t 11051.945984 23420.993536 1.1816351413726809 4.025989 0.0
23
+ 0.0 7 0.0 wikitext comb_3 llama3 rnd_naive_t 14178.745344 15367.929856 1.1227006912231443 121.386031 0.0
24
+ 0.0 7 0.0 wikitext comb_7 llama3 rnd_naive_t 14178.745344 15367.929856 1.1248141527175903 146.377814 0.0
25
+ 0.4432624578475952 7 0.0 wikitext comb_15 llama3 rnd_naive_t 14179.216384 15367.929856 5.235913276672363 68.703939 0.0
26
+ 0.4427558183670044 7 0.0 wikitext woq llama3 fixed 14179.331584 15367.929856 5.248887062072754 95.670905 0.0
27
+ 0.0 7 0.0 wikitext comb_4 llama3 rnd_naive_t 14185.276416 15374.221312 1.1265883445739746 147.647926 0.0
28
+ 0.0 7 0.0 wikitext comb_5 llama3 rnd_naive_t 14185.276416 15374.221312 1.134555697441101 147.818936 0.0
29
+ 0.0 7 0.0 wikitext comb_16 llama3 rnd_naive_t 14185.276416 15374.221312 1.6100807189941406 148.150411 0.0
30
+ 0.0 7 0.0 wikitext comb_2 llama3 rnd_naive_t 14185.276416 15374.221312 305326.53125 201.57199 0.0
31
+ 0.0 7 0.0 wikitext comb_8 llama3 rnd_naive_t 14185.276416 15374.221312 1.3429579734802246 201.75892 0.0
32
+ 0.4156703650951385 7 0.0 wikitext comb_18 llama3 rnd_naive_t 14185.747456 15374.221312 6.077569961547852 147.720173 0.0
33
+ 0.4396150112152099 7 0.0 wikitext comb_11 llama3 rnd_naive_t 14185.747456 15374.221312 5.204619407653809 147.977388 0.0
34
+ 0.4156028926372528 7 0.0 wikitext comb_17 llama3 rnd_naive_t 14185.747456 15374.221312 5.868364810943604 148.034391 0.0
35
+ 0.4362377822399139 7 0.0 wikitext comb_1 llama3 rnd_naive_t 14185.747456 15374.221312 5.477419376373291 148.295521 0.0
36
+ 0.4371158480644226 7 0.0 wikitext comb_6 llama3 rnd_naive_t 14185.747456 15374.221312 5.248127460479736 175.323026 0.0
37
+ 0.4374873340129852 7 0.0 wikitext comb_9 llama3 rnd_naive_t 14185.747456 15374.221312 5.352088928222656 200.983819 0.0
38
+ 0.0 7 0.0 wikitext comb_14 llama3 rnd_naive_t 11051.945984 18748.53888 1.127060055732727 4.403608 0.0
39
+ 0.0 7 0.0 wikitext comb_10 llama3 rnd_naive_t 11051.945984 18748.53888 1.1248141527175903 4.405668 0.0
40
+ 0.0 7 0.0 wikitext comb_13 llama3 rnd_naive_t 16811.959808 19811.794944 1.1423985958099363 426.054909 0.0
41
+ 0.0 7 0.0 wikitext comb_0 llama3 rnd_naive_t 11051.945984 23420.993536 1.1909852027893066 4.024472 0.0
42
+ 0.0 7 0.0 wikitext comb_12 llama3 rnd_naive_t 11051.945984 23420.993536 1.127308964729309 4.030326 0.0
43
+ 0.0 6 0.0 wikitext comb_3 llama3 rnd_naive_t 14178.745344 15367.929856 1.145577907562256 121.302916 0.0
44
+ 0.0 6 0.0 wikitext comb_7 llama3 rnd_naive_t 14178.745344 15367.929856 1.1248141527175903 146.050978 0.0
45
+ 0.443161129951477 6 0.0 wikitext comb_15 llama3 rnd_naive_t 14179.216384 15367.929856 5.194876670837402 68.708925 0.0
46
+ 0.4409320950508117 6 0.0 wikitext woq llama3 fixed 14179.331584 15367.929856 5.193300724029541 95.490851 0.0
47
+ 0.0 6 0.0 wikitext comb_4 llama3 rnd_naive_t 14185.276416 15374.221312 1.2937060594558716 147.411785 0.0
48
+ 0.0 6 0.0 wikitext comb_5 llama3 rnd_naive_t 14185.276416 15374.221312 1.141523838043213 147.570098 0.0
49
+ 0.0 6 0.0 wikitext comb_16 llama3 rnd_naive_t 14185.276416 15374.221312 1.300376534461975 148.724139 0.0
50
+ 0.0 6 0.0 wikitext comb_2 llama3 rnd_naive_t 14185.276416 15374.221312 2.067946672439575 201.272722 0.0
51
+ 0.0 6 0.0 wikitext comb_8 llama3 rnd_naive_t 14185.276416 15374.221312 1.771620273590088 201.507388 0.0
52
+ 0.4347180128097534 6 0.0 wikitext comb_18 llama3 rnd_naive_t 14185.747456 15374.221312 5.35822868347168 147.317057 0.0
53
+ 0.4288753867149353 6 0.0 wikitext comb_11 llama3 rnd_naive_t 14185.747456 15374.221312 5.33641242980957 147.43148 0.0
54
+ 0.4362377822399139 6 0.0 wikitext comb_17 llama3 rnd_naive_t 14185.747456 15374.221312 5.243466377258301 147.668644 0.0
55
+ 0.4360688924789428 6 0.0 wikitext comb_1 llama3 rnd_naive_t 14185.747456 15374.221312 5.1930460929870605 148.370921 0.0
56
+ 0.4387707114219665 6 0.0 wikitext comb_6 llama3 rnd_naive_t 14185.747456 15374.221312 5.194973468780518 175.111382 0.0
57
+ 0.4374535679817199 6 0.0 wikitext comb_9 llama3 rnd_naive_t 14185.747456 15374.221312 5.248212814331055 200.905055 0.0
58
+ 0.0 6 0.0 wikitext comb_14 llama3 rnd_naive_t 11051.945984 18748.53888 1.1353554725646973 4.393878 0.0
59
+ 0.0 6 0.0 wikitext comb_10 llama3 rnd_naive_t 11051.945984 18748.53888 1.1248141527175903 4.396846 0.0
60
+ 0.0 6 0.0 wikitext comb_13 llama3 rnd_naive_t 16811.959808 19811.794944 1.136775016784668 426.2148 0.0
61
+ 0.0 6 0.0 wikitext comb_0 llama3 rnd_naive_t 11051.945984 23420.993536 1.2187374830245972 4.02457 0.0
62
+ 0.0 6 0.0 wikitext comb_12 llama3 rnd_naive_t 11051.945984 23420.993536 1.1379443407058716 4.02468 0.0
63
+ 0.4437352418899536 8 0.0 wikitext ao_woq llama3 fixed 12110.375936 14040.43264 5.208643436431885 52.436687 0.0
64
+ 0.0 8 0.0 wikitext comb_3 llama3 rnd_naive_t 14178.745344 15367.929856 1.1235297918319702 121.229835 0.0
65
+ 0.0 8 0.0 wikitext comb_7 llama3 rnd_naive_t 14178.745344 15367.929856 1.1248141527175903 145.654011 0.0
66
+ 0.4431273639202118 8 0.0 wikitext comb_15 llama3 rnd_naive_t 14179.216384 15367.929856 5.207856178283691 68.526143 0.0
67
+ 0.443870335817337 8 0.0 wikitext woq llama3 fixed 14179.331584 15367.929856 5.208242893218994 95.50655 0.0
68
+ 0.0 8 0.0 wikitext comb_4 llama3 rnd_naive_t 14185.276416 15374.221312 1.1249163150787354 147.482189 0.0
69
+ 0.0 8 0.0 wikitext comb_5 llama3 rnd_naive_t 14185.276416 15374.221312 1.1490358114242554 147.536769 0.0
70
+ 0.0 8 0.0 wikitext comb_16 llama3 rnd_naive_t 14185.276416 15374.221312 2.0685019493103027 147.812832 0.0
71
+ 0.0 8 0.0 wikitext comb_8 llama3 rnd_naive_t 14185.276416 15374.221312 2.070951223373413 201.286745 0.0
72
+ 0.0 8 0.0 wikitext comb_2 llama3 rnd_naive_t 14185.276416 15374.221312 2.802328824996948 201.343578 0.0
73
+ 0.4376562237739563 8 0.0 wikitext comb_18 llama3 rnd_naive_t 14185.747456 15374.221312 5.276397705078125 147.449105 0.0
74
+ 0.4404930770397186 8 0.0 wikitext comb_17 llama3 rnd_naive_t 14185.747456 15374.221312 5.351640701293945 147.472212 0.0
75
+ 0.4364066123962402 8 0.0 wikitext comb_11 llama3 rnd_naive_t 14185.747456 15374.221312 5.43122148513794 147.864195 0.0
76
+ 0.4338061809539795 8 0.0 wikitext comb_1 llama3 rnd_naive_t 14185.747456 15374.221312 5.481295108795166 147.988197 0.0
77
+ 0.4386018216609955 8 0.0 wikitext comb_6 llama3 rnd_naive_t 14185.747456 15374.221312 5.411445617675781 174.891771 0.0
78
+ 0.438331663608551 8 0.0 wikitext comb_9 llama3 rnd_naive_t 14185.747456 15374.221312 5.40258264541626 201.034157 0.0
79
+ 0.0 8 0.0 wikitext comb_10 llama3 rnd_naive_t 11051.945984 18748.53888 1.1248141527175903 4.388327 0.0
80
+ 0.0 8 0.0 wikitext comb_14 llama3 rnd_naive_t 11051.945984 18748.53888 1.1406238079071045 4.393068 0.0
81
+ 0.0 8 0.0 wikitext comb_13 llama3 rnd_naive_t 16811.959808 19811.794944 1.2057172060012815 426.278868 0.0
82
+ 0.0 8 0.0 wikitext comb_12 llama3 rnd_naive_t 11051.945984 23420.993536 1.1392604112625122 4.0152 0.0
83
+ 0.0 8 0.0 wikitext comb_0 llama3 rnd_naive_t 11051.945984 23420.993536 1.2072761058807373 4.02671 0.0
84
+ 0.0 5 0.0 wikitext comb_3 llama3 rnd_naive_t 14178.745344 15367.929856 1.2200177907943726 121.552862 0.0
85
+ 0.0 5 0.0 wikitext comb_7 llama3 rnd_naive_t 14178.745344 15367.929856 1.1248141527175903 146.011549 0.0
86
+ 0.4348531067371368 5 0.0 wikitext comb_15 llama3 rnd_naive_t 14179.216384 15367.929856 5.277651309967041 68.664574 0.0
87
+ 0.4355623126029968 5 0.0 wikitext woq llama3 fixed 14179.331584 15367.929856 5.448963165283203 95.562035 0.0
88
+ 0.0 5 0.0 wikitext comb_4 llama3 rnd_naive_t 14185.276416 15374.221312 1.125428557395935 147.495816 0.0
89
+ 0.0 5 0.0 wikitext comb_5 llama3 rnd_naive_t 14185.276416 15374.221312 1.135644555091858 147.618679 0.0
90
+ 0.0 5 0.0 wikitext comb_16 llama3 rnd_naive_t 14185.276416 15374.221312 1.932867169380188 147.785244 0.0
91
+ 0.0 5 0.0 wikitext comb_2 llama3 rnd_naive_t 14185.276416 15374.221312 202.6715850830078 201.198429 0.0
92
+ 0.0 5 0.0 wikitext comb_8 llama3 rnd_naive_t 14185.276416 15374.221312 1.154691457748413 201.250427 0.0
93
+ 0.4258696436882019 5 0.0 wikitext comb_18 llama3 rnd_naive_t 14185.747456 15374.221312 5.412376403808594 147.421883 0.0
94
+ 0.4286052286624908 5 0.0 wikitext comb_17 llama3 rnd_naive_t 14185.747456 15374.221312 5.181597232818604 147.842579 0.0
95
+ 0.4327254593372345 5 0.0 wikitext comb_11 llama3 rnd_naive_t 14185.747456 15374.221312 5.356659889221191 147.88072 0.0
96
+ 0.4307666420936584 5 0.0 wikitext comb_1 llama3 rnd_naive_t 14185.747456 15374.221312 5.254064083099365 148.198991 0.0
97
+ 0.4310706257820129 5 0.0 wikitext comb_6 llama3 rnd_naive_t 14185.747456 15374.221312 5.283512115478516 175.096273 0.0
98
+ 0.4291793406009674 5 0.0 wikitext comb_9 llama3 rnd_naive_t 14185.747456 15374.221312 5.304575443267822 200.922341 0.0
99
+ 0.0 5 0.0 wikitext comb_14 llama3 rnd_naive_t 11051.945984 18748.53888 1.140650987625122 4.391318 0.0
100
+ 0.0 5 0.0 wikitext comb_10 llama3 rnd_naive_t 11051.945984 18748.53888 1.1248141527175903 4.401699 0.0
101
+ 0.0 5 0.0 wikitext comb_13 llama3 rnd_naive_t 16811.959808 19811.794944 1.1501007080078125 425.964862 0.0
102
+ 0.0 5 0.0 wikitext comb_0 llama3 rnd_naive_t 11051.945984 23420.993536 1.2129395008087158 3.9972 0.0
103
+ 0.0 5 0.0 wikitext comb_12 llama3 rnd_naive_t 11051.945984 23420.993536 1.1247973442077637 4.030701 0.0
104
+ 0.4436677098274231 32 0.0 wikitext base llama3 ---- 33003.526656 33155.97312 5.223813056945801 26.150784 0.0
results/results.txt ADDED
@@ -0,0 +1,105 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ | | accuracy | bits | clip | dataset | method | model | params | peak_mem_alloc_mb | peak_mem_reserv_mb | perplexity | time_ms | wer |
2
+ |---:|-----------:|-------:|-------:|:----------|:---------|:--------|:------------|--------------------:|---------------------:|-------------:|----------:|------:|
3
+ | 0 | 0.4278 | 4 | 0 | wikitext | ao_woq | llama3 | fixed | 5542.36 | 7163.87 | 5.3584 | 39.1541 | 0 |
4
+ | 1 | 0 | 4 | 0 | wikitext | comb_3 | llama3 | rnd_naive_t | 14178.7 | 15367.9 | 1.2404 | 121.29 | 0 |
5
+ | 2 | 0 | 4 | 0 | wikitext | comb_7 | llama3 | rnd_naive_t | 14178.7 | 15367.9 | 1.1248 | 145.772 | 0 |
6
+ | 3 | 0.4107 | 4 | 0 | wikitext | comb_15 | llama3 | rnd_naive_t | 14179.2 | 15367.9 | 6.0225 | 68.5664 | 0 |
7
+ | 4 | 0.3798 | 4 | 0 | wikitext | woq | llama3 | fixed | 14179.3 | 15367.9 | 6.1632 | 95.4438 | 0 |
8
+ | 5 | 0 | 4 | 0 | wikitext | comb_5 | llama3 | rnd_naive_t | 14185.3 | 15374.2 | 1.1396 | 147.454 | 0 |
9
+ | 6 | 0 | 4 | 0 | wikitext | comb_4 | llama3 | rnd_naive_t | 14185.3 | 15374.2 | 1.5297 | 147.614 | 0 |
10
+ | 7 | 0 | 4 | 0 | wikitext | comb_16 | llama3 | rnd_naive_t | 14185.3 | 15374.2 | 1.5022 | 148.156 | 0 |
11
+ | 8 | 0 | 4 | 0 | wikitext | comb_2 | llama3 | rnd_naive_t | 14185.3 | 15374.2 | 21.7492 | 201.147 | 0 |
12
+ | 9 | 0 | 4 | 0 | wikitext | comb_8 | llama3 | rnd_naive_t | 14185.3 | 15374.2 | 1.4968 | 201.532 | 0 |
13
+ | 10 | 0.3953 | 4 | 0 | wikitext | comb_18 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 6.4111 | 147.345 | 0 |
14
+ | 11 | 0.3991 | 4 | 0 | wikitext | comb_17 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 6.3314 | 147.383 | 0 |
15
+ | 12 | 0.4024 | 4 | 0 | wikitext | comb_11 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 6.0226 | 147.729 | 0 |
16
+ | 13 | 0.3888 | 4 | 0 | wikitext | comb_1 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 5.833 | 147.793 | 0 |
17
+ | 14 | 0.396 | 4 | 0 | wikitext | comb_6 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 6.2106 | 175.215 | 0 |
18
+ | 15 | 0.3873 | 4 | 0 | wikitext | comb_9 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 6.1515 | 200.883 | 0 |
19
+ | 16 | 0 | 4 | 0 | wikitext | comb_14 | llama3 | rnd_naive_t | 11051.9 | 18748.5 | 1.1356 | 4.3997 | 0 |
20
+ | 17 | 0 | 4 | 0 | wikitext | comb_10 | llama3 | rnd_naive_t | 11051.9 | 18748.5 | 1.1248 | 4.4001 | 0 |
21
+ | 18 | 0 | 4 | 0 | wikitext | comb_13 | llama3 | rnd_naive_t | 16812 | 19811.8 | 1.1442 | 426.279 | 0 |
22
+ | 19 | 0 | 4 | 0 | wikitext | comb_12 | llama3 | rnd_naive_t | 11051.9 | 23421 | 1.1387 | 4.014 | 0 |
23
+ | 20 | 0 | 4 | 0 | wikitext | comb_0 | llama3 | rnd_naive_t | 11051.9 | 23421 | 1.1816 | 4.026 | 0 |
24
+ | 0 | 0 | 7 | 0 | wikitext | comb_3 | llama3 | rnd_naive_t | 14178.7 | 15367.9 | 1.1227 | 121.386 | 0 |
25
+ | 1 | 0 | 7 | 0 | wikitext | comb_7 | llama3 | rnd_naive_t | 14178.7 | 15367.9 | 1.1248 | 146.378 | 0 |
26
+ | 2 | 0.4433 | 7 | 0 | wikitext | comb_15 | llama3 | rnd_naive_t | 14179.2 | 15367.9 | 5.2359 | 68.7039 | 0 |
27
+ | 3 | 0.4428 | 7 | 0 | wikitext | woq | llama3 | fixed | 14179.3 | 15367.9 | 5.2489 | 95.6709 | 0 |
28
+ | 4 | 0 | 7 | 0 | wikitext | comb_4 | llama3 | rnd_naive_t | 14185.3 | 15374.2 | 1.1266 | 147.648 | 0 |
29
+ | 5 | 0 | 7 | 0 | wikitext | comb_5 | llama3 | rnd_naive_t | 14185.3 | 15374.2 | 1.1346 | 147.819 | 0 |
30
+ | 6 | 0 | 7 | 0 | wikitext | comb_16 | llama3 | rnd_naive_t | 14185.3 | 15374.2 | 1.6101 | 148.15 | 0 |
31
+ | 7 | 0 | 7 | 0 | wikitext | comb_2 | llama3 | rnd_naive_t | 14185.3 | 15374.2 | 305327 | 201.572 | 0 |
32
+ | 8 | 0 | 7 | 0 | wikitext | comb_8 | llama3 | rnd_naive_t | 14185.3 | 15374.2 | 1.343 | 201.759 | 0 |
33
+ | 9 | 0.4157 | 7 | 0 | wikitext | comb_18 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 6.0776 | 147.72 | 0 |
34
+ | 10 | 0.4396 | 7 | 0 | wikitext | comb_11 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 5.2046 | 147.977 | 0 |
35
+ | 11 | 0.4156 | 7 | 0 | wikitext | comb_17 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 5.8684 | 148.034 | 0 |
36
+ | 12 | 0.4362 | 7 | 0 | wikitext | comb_1 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 5.4774 | 148.296 | 0 |
37
+ | 13 | 0.4371 | 7 | 0 | wikitext | comb_6 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 5.2481 | 175.323 | 0 |
38
+ | 14 | 0.4375 | 7 | 0 | wikitext | comb_9 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 5.3521 | 200.984 | 0 |
39
+ | 15 | 0 | 7 | 0 | wikitext | comb_14 | llama3 | rnd_naive_t | 11051.9 | 18748.5 | 1.1271 | 4.4036 | 0 |
40
+ | 16 | 0 | 7 | 0 | wikitext | comb_10 | llama3 | rnd_naive_t | 11051.9 | 18748.5 | 1.1248 | 4.4057 | 0 |
41
+ | 17 | 0 | 7 | 0 | wikitext | comb_13 | llama3 | rnd_naive_t | 16812 | 19811.8 | 1.1424 | 426.055 | 0 |
42
+ | 18 | 0 | 7 | 0 | wikitext | comb_0 | llama3 | rnd_naive_t | 11051.9 | 23421 | 1.191 | 4.0245 | 0 |
43
+ | 19 | 0 | 7 | 0 | wikitext | comb_12 | llama3 | rnd_naive_t | 11051.9 | 23421 | 1.1273 | 4.0303 | 0 |
44
+ | 0 | 0 | 6 | 0 | wikitext | comb_3 | llama3 | rnd_naive_t | 14178.7 | 15367.9 | 1.1456 | 121.303 | 0 |
45
+ | 1 | 0 | 6 | 0 | wikitext | comb_7 | llama3 | rnd_naive_t | 14178.7 | 15367.9 | 1.1248 | 146.051 | 0 |
46
+ | 2 | 0.4432 | 6 | 0 | wikitext | comb_15 | llama3 | rnd_naive_t | 14179.2 | 15367.9 | 5.1949 | 68.7089 | 0 |
47
+ | 3 | 0.4409 | 6 | 0 | wikitext | woq | llama3 | fixed | 14179.3 | 15367.9 | 5.1933 | 95.4909 | 0 |
48
+ | 4 | 0 | 6 | 0 | wikitext | comb_4 | llama3 | rnd_naive_t | 14185.3 | 15374.2 | 1.2937 | 147.412 | 0 |
49
+ | 5 | 0 | 6 | 0 | wikitext | comb_5 | llama3 | rnd_naive_t | 14185.3 | 15374.2 | 1.1415 | 147.57 | 0 |
50
+ | 6 | 0 | 6 | 0 | wikitext | comb_16 | llama3 | rnd_naive_t | 14185.3 | 15374.2 | 1.3004 | 148.724 | 0 |
51
+ | 7 | 0 | 6 | 0 | wikitext | comb_2 | llama3 | rnd_naive_t | 14185.3 | 15374.2 | 2.0679 | 201.273 | 0 |
52
+ | 8 | 0 | 6 | 0 | wikitext | comb_8 | llama3 | rnd_naive_t | 14185.3 | 15374.2 | 1.7716 | 201.507 | 0 |
53
+ | 9 | 0.4347 | 6 | 0 | wikitext | comb_18 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 5.3582 | 147.317 | 0 |
54
+ | 10 | 0.4289 | 6 | 0 | wikitext | comb_11 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 5.3364 | 147.431 | 0 |
55
+ | 11 | 0.4362 | 6 | 0 | wikitext | comb_17 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 5.2435 | 147.669 | 0 |
56
+ | 12 | 0.4361 | 6 | 0 | wikitext | comb_1 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 5.193 | 148.371 | 0 |
57
+ | 13 | 0.4388 | 6 | 0 | wikitext | comb_6 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 5.195 | 175.111 | 0 |
58
+ | 14 | 0.4375 | 6 | 0 | wikitext | comb_9 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 5.2482 | 200.905 | 0 |
59
+ | 15 | 0 | 6 | 0 | wikitext | comb_14 | llama3 | rnd_naive_t | 11051.9 | 18748.5 | 1.1354 | 4.3939 | 0 |
60
+ | 16 | 0 | 6 | 0 | wikitext | comb_10 | llama3 | rnd_naive_t | 11051.9 | 18748.5 | 1.1248 | 4.3968 | 0 |
61
+ | 17 | 0 | 6 | 0 | wikitext | comb_13 | llama3 | rnd_naive_t | 16812 | 19811.8 | 1.1368 | 426.215 | 0 |
62
+ | 18 | 0 | 6 | 0 | wikitext | comb_0 | llama3 | rnd_naive_t | 11051.9 | 23421 | 1.2187 | 4.0246 | 0 |
63
+ | 19 | 0 | 6 | 0 | wikitext | comb_12 | llama3 | rnd_naive_t | 11051.9 | 23421 | 1.1379 | 4.0247 | 0 |
64
+ | 0 | 0.4437 | 8 | 0 | wikitext | ao_woq | llama3 | fixed | 12110.4 | 14040.4 | 5.2086 | 52.4367 | 0 |
65
+ | 1 | 0 | 8 | 0 | wikitext | comb_3 | llama3 | rnd_naive_t | 14178.7 | 15367.9 | 1.1235 | 121.23 | 0 |
66
+ | 2 | 0 | 8 | 0 | wikitext | comb_7 | llama3 | rnd_naive_t | 14178.7 | 15367.9 | 1.1248 | 145.654 | 0 |
67
+ | 3 | 0.4431 | 8 | 0 | wikitext | comb_15 | llama3 | rnd_naive_t | 14179.2 | 15367.9 | 5.2079 | 68.5261 | 0 |
68
+ | 4 | 0.4439 | 8 | 0 | wikitext | woq | llama3 | fixed | 14179.3 | 15367.9 | 5.2082 | 95.5066 | 0 |
69
+ | 5 | 0 | 8 | 0 | wikitext | comb_4 | llama3 | rnd_naive_t | 14185.3 | 15374.2 | 1.1249 | 147.482 | 0 |
70
+ | 6 | 0 | 8 | 0 | wikitext | comb_5 | llama3 | rnd_naive_t | 14185.3 | 15374.2 | 1.149 | 147.537 | 0 |
71
+ | 7 | 0 | 8 | 0 | wikitext | comb_16 | llama3 | rnd_naive_t | 14185.3 | 15374.2 | 2.0685 | 147.813 | 0 |
72
+ | 8 | 0 | 8 | 0 | wikitext | comb_8 | llama3 | rnd_naive_t | 14185.3 | 15374.2 | 2.071 | 201.287 | 0 |
73
+ | 9 | 0 | 8 | 0 | wikitext | comb_2 | llama3 | rnd_naive_t | 14185.3 | 15374.2 | 2.8023 | 201.344 | 0 |
74
+ | 10 | 0.4377 | 8 | 0 | wikitext | comb_18 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 5.2764 | 147.449 | 0 |
75
+ | 11 | 0.4405 | 8 | 0 | wikitext | comb_17 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 5.3516 | 147.472 | 0 |
76
+ | 12 | 0.4364 | 8 | 0 | wikitext | comb_11 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 5.4312 | 147.864 | 0 |
77
+ | 13 | 0.4338 | 8 | 0 | wikitext | comb_1 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 5.4813 | 147.988 | 0 |
78
+ | 14 | 0.4386 | 8 | 0 | wikitext | comb_6 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 5.4114 | 174.892 | 0 |
79
+ | 15 | 0.4383 | 8 | 0 | wikitext | comb_9 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 5.4026 | 201.034 | 0 |
80
+ | 16 | 0 | 8 | 0 | wikitext | comb_10 | llama3 | rnd_naive_t | 11051.9 | 18748.5 | 1.1248 | 4.3883 | 0 |
81
+ | 17 | 0 | 8 | 0 | wikitext | comb_14 | llama3 | rnd_naive_t | 11051.9 | 18748.5 | 1.1406 | 4.3931 | 0 |
82
+ | 18 | 0 | 8 | 0 | wikitext | comb_13 | llama3 | rnd_naive_t | 16812 | 19811.8 | 1.2057 | 426.279 | 0 |
83
+ | 19 | 0 | 8 | 0 | wikitext | comb_12 | llama3 | rnd_naive_t | 11051.9 | 23421 | 1.1393 | 4.0152 | 0 |
84
+ | 20 | 0 | 8 | 0 | wikitext | comb_0 | llama3 | rnd_naive_t | 11051.9 | 23421 | 1.2073 | 4.0267 | 0 |
85
+ | 0 | 0 | 5 | 0 | wikitext | comb_3 | llama3 | rnd_naive_t | 14178.7 | 15367.9 | 1.22 | 121.553 | 0 |
86
+ | 1 | 0 | 5 | 0 | wikitext | comb_7 | llama3 | rnd_naive_t | 14178.7 | 15367.9 | 1.1248 | 146.012 | 0 |
87
+ | 2 | 0.4349 | 5 | 0 | wikitext | comb_15 | llama3 | rnd_naive_t | 14179.2 | 15367.9 | 5.2777 | 68.6646 | 0 |
88
+ | 3 | 0.4356 | 5 | 0 | wikitext | woq | llama3 | fixed | 14179.3 | 15367.9 | 5.449 | 95.562 | 0 |
89
+ | 4 | 0 | 5 | 0 | wikitext | comb_4 | llama3 | rnd_naive_t | 14185.3 | 15374.2 | 1.1254 | 147.496 | 0 |
90
+ | 5 | 0 | 5 | 0 | wikitext | comb_5 | llama3 | rnd_naive_t | 14185.3 | 15374.2 | 1.1356 | 147.619 | 0 |
91
+ | 6 | 0 | 5 | 0 | wikitext | comb_16 | llama3 | rnd_naive_t | 14185.3 | 15374.2 | 1.9329 | 147.785 | 0 |
92
+ | 7 | 0 | 5 | 0 | wikitext | comb_2 | llama3 | rnd_naive_t | 14185.3 | 15374.2 | 202.672 | 201.198 | 0 |
93
+ | 8 | 0 | 5 | 0 | wikitext | comb_8 | llama3 | rnd_naive_t | 14185.3 | 15374.2 | 1.1547 | 201.25 | 0 |
94
+ | 9 | 0.4259 | 5 | 0 | wikitext | comb_18 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 5.4124 | 147.422 | 0 |
95
+ | 10 | 0.4286 | 5 | 0 | wikitext | comb_17 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 5.1816 | 147.843 | 0 |
96
+ | 11 | 0.4327 | 5 | 0 | wikitext | comb_11 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 5.3567 | 147.881 | 0 |
97
+ | 12 | 0.4308 | 5 | 0 | wikitext | comb_1 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 5.2541 | 148.199 | 0 |
98
+ | 13 | 0.4311 | 5 | 0 | wikitext | comb_6 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 5.2835 | 175.096 | 0 |
99
+ | 14 | 0.4292 | 5 | 0 | wikitext | comb_9 | llama3 | rnd_naive_t | 14185.7 | 15374.2 | 5.3046 | 200.922 | 0 |
100
+ | 15 | 0 | 5 | 0 | wikitext | comb_14 | llama3 | rnd_naive_t | 11051.9 | 18748.5 | 1.1407 | 4.3913 | 0 |
101
+ | 16 | 0 | 5 | 0 | wikitext | comb_10 | llama3 | rnd_naive_t | 11051.9 | 18748.5 | 1.1248 | 4.4017 | 0 |
102
+ | 17 | 0 | 5 | 0 | wikitext | comb_13 | llama3 | rnd_naive_t | 16812 | 19811.8 | 1.1501 | 425.965 | 0 |
103
+ | 18 | 0 | 5 | 0 | wikitext | comb_0 | llama3 | rnd_naive_t | 11051.9 | 23421 | 1.2129 | 3.9972 | 0 |
104
+ | 19 | 0 | 5 | 0 | wikitext | comb_12 | llama3 | rnd_naive_t | 11051.9 | 23421 | 1.1248 | 4.0307 | 0 |
105
+ | 21 | 0.4437 | 32 | 0 | wikitext | base | llama3 | ---- | 33003.5 | 33156 | 5.2238 | 26.1508 | 0 |