accuracy bits clip dataset method model params peak_mem_alloc_mb peak_mem_reserv_mb perplexity time_ms wer 0.0 4 0.0 wikitext comb_2 llama3 rnd_search 14178.745344 15367.929856 1.3576891422271729 122.134433 0.0 0.0 5 0.0 wikitext comb_2 llama3 rnd_search 14178.745344 15367.929856 1.3576891422271729 122.134433 0.0 0.0 6 0.0 wikitext comb_2 llama3 rnd_search 14178.745344 15367.929856 1.3576891422271729 122.134433 0.0 0.0 7 0.0 wikitext comb_2 llama3 rnd_search 14178.745344 15367.929856 1.3576891422271729 122.134433 0.0 0.0 8 0.0 wikitext comb_2 llama3 rnd_search 14178.745344 15367.929856 1.3576891422271729 122.134433 0.0 0.0 4 0.0 wikitext comb_10 llama3 rnd_search 14178.745344 15367.929856 1.1248141527175903 145.978955 0.0 0.0 5 0.0 wikitext comb_10 llama3 rnd_search 14178.745344 15367.929856 1.1248141527175903 145.978955 0.0 0.0 6 0.0 wikitext comb_10 llama3 rnd_search 14178.745344 15367.929856 1.1248141527175903 145.978955 0.0 0.0 7 0.0 wikitext comb_10 llama3 rnd_search 14178.745344 15367.929856 1.1248141527175903 145.978955 0.0 0.0 8 0.0 wikitext comb_10 llama3 rnd_search 14178.745344 15367.929856 1.1248141527175903 145.978955 0.0 0.4428571462631225 7 0.0 wikitext comb_6 llama3 rnd_search 14179.216384 15367.929856 5.2481889724731445 68.646232 0.0 0.4437352418899536 8 0.0 wikitext comb_6 llama3 rnd_search 14179.216384 15367.929856 5.208643436431885 68.731517 0.0 0.380108118057251 4 0.0 wikitext comb_6 llama3 rnd_search 14179.216384 15367.929856 6.15098762512207 68.746042 0.0 0.4404930770397186 6 0.0 wikitext comb_6 llama3 rnd_search 14179.216384 15367.929856 5.199138641357422 68.797421 0.0 0.435663640499115 5 0.0 wikitext comb_6 llama3 rnd_search 14179.216384 15367.929856 5.449023246765137 68.818481 0.0 0.0 4 0.0 wikitext comb_11 llama3 rnd_search 14185.276416 15374.221312 1.1702104806900024 147.730771 0.0 0.0158730167895555 5 0.0 wikitext comb_11 llama3 rnd_search 14185.276416 15374.221312 1.121153712272644 147.832291 0.0 0.0 4 0.0 wikitext comb_0 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 147.8579 0.0 0.0 5 0.0 wikitext comb_0 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 147.8579 0.0 0.0 6 0.0 wikitext comb_0 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 147.8579 0.0 0.0 7 0.0 wikitext comb_0 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 147.8579 0.0 0.0 8 0.0 wikitext comb_0 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 147.8579 0.0 0.0 4 0.0 wikitext comb_13 llama3 rnd_search 14185.276416 15374.221312 1.156484603881836 147.911795 0.0 0.0 5 0.0 wikitext comb_13 llama3 rnd_search 14185.276416 15374.221312 1.156484603881836 147.911795 0.0 0.0 6 0.0 wikitext comb_13 llama3 rnd_search 14185.276416 15374.221312 1.156484603881836 147.911795 0.0 0.0 7 0.0 wikitext comb_13 llama3 rnd_search 14185.276416 15374.221312 1.156484603881836 147.911795 0.0 0.0 8 0.0 wikitext comb_13 llama3 rnd_search 14185.276416 15374.221312 1.156484603881836 147.911795 0.0 0.0 4 0.0 wikitext comb_18 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 147.947496 0.0 0.0 5 0.0 wikitext comb_18 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 147.947496 0.0 0.0 6 0.0 wikitext comb_18 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 147.947496 0.0 0.0 7 0.0 wikitext comb_18 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 147.947496 0.0 0.0 8 0.0 wikitext comb_18 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 147.947496 0.0 0.0 4 0.0 wikitext comb_14 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 148.055885 0.0 0.0 5 0.0 wikitext comb_14 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 148.055885 0.0 0.0 6 0.0 wikitext comb_14 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 148.055885 0.0 0.0 7 0.0 wikitext comb_14 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 148.055885 0.0 0.0 8 0.0 wikitext comb_14 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 148.055885 0.0 0.0 4 0.0 wikitext comb_4 llama3 rnd_search 14185.276416 15374.221312 1.1346908807754517 148.064629 0.0 0.0 5 0.0 wikitext comb_4 llama3 rnd_search 14185.276416 15374.221312 1.1346908807754517 148.064629 0.0 0.0 6 0.0 wikitext comb_4 llama3 rnd_search 14185.276416 15374.221312 1.1346908807754517 148.064629 0.0 0.0 7 0.0 wikitext comb_4 llama3 rnd_search 14185.276416 15374.221312 1.1346908807754517 148.064629 0.0 0.0 8 0.0 wikitext comb_4 llama3 rnd_search 14185.276416 15374.221312 1.1346908807754517 148.064629 0.0 0.0 4 0.0 wikitext comb_12 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 148.166922 0.0 0.0 5 0.0 wikitext comb_12 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 148.166922 0.0 0.0 6 0.0 wikitext comb_12 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 148.166922 0.0 0.0 7 0.0 wikitext comb_12 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 148.166922 0.0 0.0 8 0.0 wikitext comb_12 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 148.166922 0.0 0.0 4 0.0 wikitext comb_16 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 175.021802 0.0 0.0 5 0.0 wikitext comb_16 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 175.021802 0.0 0.0 6 0.0 wikitext comb_16 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 175.021802 0.0 0.0 7 0.0 wikitext comb_16 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 175.021802 0.0 0.0 8 0.0 wikitext comb_16 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 175.021802 0.0 0.0 4 0.0 wikitext comb_9 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 201.647965 0.0 0.0 5 0.0 wikitext comb_9 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 201.647965 0.0 0.0 6 0.0 wikitext comb_9 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 201.647965 0.0 0.0 7 0.0 wikitext comb_9 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 201.647965 0.0 0.0 8 0.0 wikitext comb_9 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 201.647965 0.0 0.0 4 0.0 wikitext comb_5 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 201.680032 0.0 0.0 5 0.0 wikitext comb_5 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 201.680032 0.0 0.0 6 0.0 wikitext comb_5 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 201.680032 0.0 0.0 7 0.0 wikitext comb_5 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 201.680032 0.0 0.0 8 0.0 wikitext comb_5 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 201.680032 0.0 0.0 4 0.0 wikitext comb_8 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 201.681588 0.0 0.0 5 0.0 wikitext comb_8 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 201.681588 0.0 0.0 6 0.0 wikitext comb_8 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 201.681588 0.0 0.0 7 0.0 wikitext comb_8 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 201.681588 0.0 0.0 8 0.0 wikitext comb_8 llama3 rnd_search 14185.276416 15374.221312 1.1248141527175903 201.681588 0.0 0.4198919236660003 7 0.0 wikitext comb_11 llama3 rnd_search 14185.747456 15374.221312 5.461452007293701 147.546442 0.0 0.3234042525291443 6 0.0 wikitext comb_11 llama3 rnd_search 14185.747456 15374.221312 7.318746566772461 147.635021 0.0 0.4387369155883789 8 0.0 wikitext comb_11 llama3 rnd_search 14185.747456 15374.221312 5.270962715148926 147.638916 0.0 0.0 4 0.0 wikitext comb_1 llama3 rnd_search 11051.945984 18748.53888 1.1342324018478394 4.343888 0.0 0.0 5 0.0 wikitext comb_1 llama3 rnd_search 11051.945984 18748.53888 1.1342324018478394 4.343888 0.0 0.0 6 0.0 wikitext comb_1 llama3 rnd_search 11051.945984 18748.53888 1.1342324018478394 4.343888 0.0 0.0 7 0.0 wikitext comb_1 llama3 rnd_search 11051.945984 18748.53888 1.1342324018478394 4.343888 0.0 0.0 8 0.0 wikitext comb_1 llama3 rnd_search 11051.945984 18748.53888 1.1342324018478394 4.343888 0.0 0.0 4 0.0 wikitext comb_7 llama3 rnd_search 11051.945984 18748.53888 1.142811894416809 4.416078 0.0 0.0 5 0.0 wikitext comb_7 llama3 rnd_search 11051.945984 18748.53888 1.142811894416809 4.416078 0.0 0.0 6 0.0 wikitext comb_7 llama3 rnd_search 11051.945984 18748.53888 1.142811894416809 4.416078 0.0 0.0 7 0.0 wikitext comb_7 llama3 rnd_search 11051.945984 18748.53888 1.142811894416809 4.416078 0.0 0.0 8 0.0 wikitext comb_7 llama3 rnd_search 11051.945984 18748.53888 1.142811894416809 4.416078 0.0 0.0 4 0.0 wikitext comb_17 llama3 rnd_search 16811.959808 19811.794944 1.1248141527175903 426.480785 0.0 0.0 5 0.0 wikitext comb_17 llama3 rnd_search 16811.959808 19811.794944 1.1248141527175903 426.480785 0.0 0.0 6 0.0 wikitext comb_17 llama3 rnd_search 16811.959808 19811.794944 1.1248141527175903 426.480785 0.0 0.0 7 0.0 wikitext comb_17 llama3 rnd_search 16811.959808 19811.794944 1.1248141527175903 426.480785 0.0 0.0 8 0.0 wikitext comb_17 llama3 rnd_search 16811.959808 19811.794944 1.1248141527175903 426.480785 0.0 0.0 4 0.0 wikitext comb_2 tinyllama rnd_search 1895.561216 2157.969408 1.3021647930145264 19.692755 0.0 0.0 5 0.0 wikitext comb_2 tinyllama rnd_search 1895.561216 2157.969408 1.3021647930145264 19.692755 0.0 0.0 6 0.0 wikitext comb_2 tinyllama rnd_search 1895.561216 2157.969408 1.3021647930145264 19.692755 0.0 0.0 7 0.0 wikitext comb_2 tinyllama rnd_search 1895.561216 2157.969408 1.3021647930145264 19.692755 0.0 0.0 8 0.0 wikitext comb_2 tinyllama rnd_search 1895.561216 2157.969408 1.3021647930145264 19.692755 0.0 0.0 4 0.0 wikitext comb_10 tinyllama rnd_search 1895.561216 2157.969408 1.1093071699142456 25.936806 0.0 0.0 5 0.0 wikitext comb_10 tinyllama rnd_search 1895.561216 2157.969408 1.1093071699142456 25.936806 0.0 0.0 6 0.0 wikitext comb_10 tinyllama rnd_search 1895.561216 2157.969408 1.1093071699142456 25.936806 0.0 0.0 7 0.0 wikitext comb_10 tinyllama rnd_search 1895.561216 2157.969408 1.1093071699142456 25.936806 0.0 0.0 8 0.0 wikitext comb_10 tinyllama rnd_search 1895.561216 2157.969408 1.1093071699142456 25.936806 0.0 0.3680175542831421 5 0.0 wikitext comb_6 tinyllama rnd_search 1896.032256 2157.969408 6.965248107910156 15.067295 0.0 0.3785883486270904 6 0.0 wikitext comb_6 tinyllama rnd_search 1896.032256 2157.969408 6.5001301765441895 15.189231 0.0 0.3469773828983307 4 0.0 wikitext comb_6 tinyllama rnd_search 1896.032256 2157.969408 7.644235134124756 15.202199 0.0 0.3765282034873962 7 0.0 wikitext comb_6 tinyllama rnd_search 1896.032256 2157.969408 6.658954620361328 15.226179 0.0 0.3771361112594604 8 0.0 wikitext comb_6 tinyllama rnd_search 1896.032256 2157.969408 6.605966091156006 15.834359 0.0 0.0 4 0.0 wikitext comb_14 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 27.292141 0.0 0.0 5 0.0 wikitext comb_14 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 27.292141 0.0 0.0 6 0.0 wikitext comb_14 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 27.292141 0.0 0.0 7 0.0 wikitext comb_14 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 27.292141 0.0 0.0 8 0.0 wikitext comb_14 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 27.292141 0.0 0.0 4 0.0 wikitext comb_0 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 27.336605 0.0 0.0 5 0.0 wikitext comb_0 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 27.336605 0.0 0.0 6 0.0 wikitext comb_0 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 27.336605 0.0 0.0 7 0.0 wikitext comb_0 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 27.336605 0.0 0.0 8 0.0 wikitext comb_0 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 27.336605 0.0 0.0 4 0.0 wikitext comb_12 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 27.486278 0.0 0.0 5 0.0 wikitext comb_12 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 27.486278 0.0 0.0 6 0.0 wikitext comb_12 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 27.486278 0.0 0.0 7 0.0 wikitext comb_12 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 27.486278 0.0 0.0 8 0.0 wikitext comb_12 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 27.486278 0.0 0.0 4 0.0 wikitext comb_13 tinyllama rnd_search 1897.394176 2160.06656 1.1184241771697998 27.493969 0.0 0.0 5 0.0 wikitext comb_13 tinyllama rnd_search 1897.394176 2160.06656 1.1184241771697998 27.493969 0.0 0.0 6 0.0 wikitext comb_13 tinyllama rnd_search 1897.394176 2160.06656 1.1184241771697998 27.493969 0.0 0.0 7 0.0 wikitext comb_13 tinyllama rnd_search 1897.394176 2160.06656 1.1184241771697998 27.493969 0.0 0.0 8 0.0 wikitext comb_13 tinyllama rnd_search 1897.394176 2160.06656 1.1184241771697998 27.493969 0.0 0.0 4 0.0 wikitext comb_18 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 27.506823 0.0 0.0 5 0.0 wikitext comb_18 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 27.506823 0.0 0.0 6 0.0 wikitext comb_18 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 27.506823 0.0 0.0 7 0.0 wikitext comb_18 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 27.506823 0.0 0.0 8 0.0 wikitext comb_18 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 27.506823 0.0 0.0 4 0.0 wikitext comb_4 tinyllama rnd_search 1897.394176 2160.06656 1.1095309257507324 27.560142 0.0 0.0 5 0.0 wikitext comb_4 tinyllama rnd_search 1897.394176 2160.06656 1.1095309257507324 27.560142 0.0 0.0 6 0.0 wikitext comb_4 tinyllama rnd_search 1897.394176 2160.06656 1.1095309257507324 27.560142 0.0 0.0 7 0.0 wikitext comb_4 tinyllama rnd_search 1897.394176 2160.06656 1.1095309257507324 27.560142 0.0 0.0 8 0.0 wikitext comb_4 tinyllama rnd_search 1897.394176 2160.06656 1.1095309257507324 27.560142 0.0 0.0 4 0.0 wikitext comb_16 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 34.640174 0.0 0.0 5 0.0 wikitext comb_16 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 34.640174 0.0 0.0 6 0.0 wikitext comb_16 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 34.640174 0.0 0.0 7 0.0 wikitext comb_16 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 34.640174 0.0 0.0 8 0.0 wikitext comb_16 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 34.640174 0.0 0.0 4 0.0 wikitext comb_9 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 40.764844 0.0 0.0 5 0.0 wikitext comb_9 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 40.764844 0.0 0.0 6 0.0 wikitext comb_9 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 40.764844 0.0 0.0 7 0.0 wikitext comb_9 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 40.764844 0.0 0.0 8 0.0 wikitext comb_9 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 40.764844 0.0 0.0 4 0.0 wikitext comb_8 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 40.907191 0.0 0.0 5 0.0 wikitext comb_8 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 40.907191 0.0 0.0 6 0.0 wikitext comb_8 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 40.907191 0.0 0.0 7 0.0 wikitext comb_8 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 40.907191 0.0 0.0 8 0.0 wikitext comb_8 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 40.907191 0.0 0.0 4 0.0 wikitext comb_5 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 40.997291 0.0 0.0 5 0.0 wikitext comb_5 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 40.997291 0.0 0.0 6 0.0 wikitext comb_5 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 40.997291 0.0 0.0 7 0.0 wikitext comb_5 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 40.997291 0.0 0.0 8 0.0 wikitext comb_5 tinyllama rnd_search 1897.394176 2160.06656 1.1093063354492188 40.997291 0.0 0.3742316663265228 8 0.0 wikitext comb_11 tinyllama rnd_search 1897.865216 2160.06656 6.918959140777588 27.807653 0.0 0.3514015674591064 7 0.0 wikitext comb_11 tinyllama rnd_search 1897.865216 2160.06656 7.256360530853271 27.872433 0.0 0.0 4 0.0 wikitext comb_7 tinyllama rnd_search 1381.170176 2487.222272 1.1274745464324951 0.527124 0.0 0.0 5 0.0 wikitext comb_7 tinyllama rnd_search 1381.170176 2487.222272 1.1274745464324951 0.527124 0.0 0.0 6 0.0 wikitext comb_7 tinyllama rnd_search 1381.170176 2487.222272 1.1274745464324951 0.527124 0.0 0.0 7 0.0 wikitext comb_7 tinyllama rnd_search 1381.170176 2487.222272 1.1274745464324951 0.527124 0.0 0.0 8 0.0 wikitext comb_7 tinyllama rnd_search 1381.170176 2487.222272 1.1274745464324951 0.527124 0.0 0.0 4 0.0 wikitext comb_1 tinyllama rnd_search 1381.170176 2487.222272 1.1105608940124512 0.560938 0.0 0.0 5 0.0 wikitext comb_1 tinyllama rnd_search 1381.170176 2487.222272 1.1105608940124512 0.560938 0.0 0.0 6 0.0 wikitext comb_1 tinyllama rnd_search 1381.170176 2487.222272 1.1105608940124512 0.560938 0.0 0.0 7 0.0 wikitext comb_1 tinyllama rnd_search 1381.170176 2487.222272 1.1105608940124512 0.560938 0.0 0.0 8 0.0 wikitext comb_1 tinyllama rnd_search 1381.170176 2487.222272 1.1105608940124512 0.560938 0.0 0.0 4 0.0 wikitext comb_17 tinyllama rnd_search 2225.074688 2747.26912 1.1093063354492188 99.853775 0.0 0.0 5 0.0 wikitext comb_17 tinyllama rnd_search 2225.074688 2747.26912 1.1093063354492188 99.853775 0.0 0.0 6 0.0 wikitext comb_17 tinyllama rnd_search 2225.074688 2747.26912 1.1093063354492188 99.853775 0.0 0.0 7 0.0 wikitext comb_17 tinyllama rnd_search 2225.074688 2747.26912 1.1093063354492188 99.853775 0.0 0.0 8 0.0 wikitext comb_17 tinyllama rnd_search 2225.074688 2747.26912 1.1093063354492188 99.853775 0.0 0.0031746034510433 6 0.0 wikitext comb_2 phi rnd_search 4394.006528 4697.62048 1.1422514915466309 71.976376 0.0 0.0015873017255216 5 0.0 wikitext comb_2 phi rnd_search 4394.006528 4697.62048 1.1327569484710691 71.9841 0.0 0.0031746034510433 8 0.0 wikitext comb_2 phi rnd_search 4394.006528 4697.62048 1.1494650840759275 72.051981 0.0 0.0031746034510433 7 0.0 wikitext comb_2 phi rnd_search 4394.006528 4697.62048 1.1514719724655151 72.102991 0.0 0.0 4 0.0 wikitext comb_2 phi rnd_search 4394.006528 4697.62048 1.1224465370178225 72.110813 0.0 0.0084656095132231 4 0.0 wikitext comb_10 phi rnd_search 4394.011648 4697.62048 1.175023317337036 94.591337 0.0 0.0084656095132231 8 0.0 wikitext comb_10 phi rnd_search 4394.011648 4697.62048 1.1750259399414062 94.647213 0.0 0.0084656095132231 5 0.0 wikitext comb_10 phi rnd_search 4394.011648 4697.62048 1.1750246286392212 94.707273 0.0 0.0084656095132231 7 0.0 wikitext comb_10 phi rnd_search 4394.011648 4697.62048 1.1750258207321167 94.747911 0.0 0.0084656095132231 6 0.0 wikitext comb_10 phi rnd_search 4394.011648 4697.62048 1.1750253438949585 95.922558 0.0 0.3780141770839691 6 0.0 wikitext comb_6 phi rnd_search 4394.477568 4697.62048 5.946701526641846 32.855011 0.0 0.3541033267974853 4 0.0 wikitext comb_6 phi rnd_search 4394.477568 4697.62048 6.471925735473633 32.915028 0.0 0.3753462135791778 5 0.0 wikitext comb_6 phi rnd_search 4394.477568 4697.62048 5.971085548400879 32.944623 0.0 0.3786896169185638 7 0.0 wikitext comb_6 phi rnd_search 4394.477568 4697.62048 5.902470111846924 32.950868 0.0 0.3804458081722259 8 0.0 wikitext comb_6 phi rnd_search 4394.477568 4697.62048 5.907134056091309 33.011417 0.0 0.0031746034510433 5 0.0 wikitext comb_14 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 90.129075 0.0 0.0031746034510433 5 0.0 wikitext comb_18 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 90.130742 0.0 0.0031746034510433 6 0.0 wikitext comb_14 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 90.168541 0.0 0.0031746034510433 8 0.0 wikitext comb_18 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 90.171478 0.0 0.0031746034510433 7 0.0 wikitext comb_18 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 90.176876 0.0 0.0031746034510433 8 0.0 wikitext comb_12 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 90.190247 0.0 0.0031746034510433 7 0.0 wikitext comb_14 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 90.193986 0.0 0.0031746034510433 8 0.0 wikitext comb_0 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 90.198949 0.0 0.0031746034510433 5 0.0 wikitext comb_0 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 90.215757 0.0 0.0031746034510433 4 0.0 wikitext comb_0 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 90.220551 0.0 0.0031746034510433 8 0.0 wikitext comb_14 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 90.234685 0.0 0.0 4 0.0 wikitext comb_12 phi rnd_search 4397.365248 4699.717632 1.1136603355407717 90.236106 0.0 0.0 5 0.0 wikitext comb_12 phi rnd_search 4397.365248 4699.717632 1.1136603355407717 90.236106 0.0 0.0 6 0.0 wikitext comb_12 phi rnd_search 4397.365248 4699.717632 1.1136603355407717 90.236106 0.0 0.0031746034510433 4 0.0 wikitext comb_14 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 90.251381 0.0 0.0031746034510433 7 0.0 wikitext comb_12 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 90.300779 0.0 0.0 4 0.0 wikitext comb_4 phi rnd_search 4397.365248 4699.717632 1.1136689186096191 90.318372 0.0 0.0 5 0.0 wikitext comb_4 phi rnd_search 4397.365248 4699.717632 1.1136689186096191 90.318372 0.0 0.0 6 0.0 wikitext comb_4 phi rnd_search 4397.365248 4699.717632 1.1136689186096191 90.318372 0.0 0.0 7 0.0 wikitext comb_4 phi rnd_search 4397.365248 4699.717632 1.1136689186096191 90.318372 0.0 0.0 8 0.0 wikitext comb_4 phi rnd_search 4397.365248 4699.717632 1.1136689186096191 90.318372 0.0 0.0 4 0.0 wikitext comb_13 phi rnd_search 4397.365248 4699.717632 1.11750066280365 90.351166 0.0 0.0 5 0.0 wikitext comb_13 phi rnd_search 4397.365248 4699.717632 1.11750066280365 90.351166 0.0 0.0 6 0.0 wikitext comb_13 phi rnd_search 4397.365248 4699.717632 1.11750066280365 90.351166 0.0 0.0 7 0.0 wikitext comb_13 phi rnd_search 4397.365248 4699.717632 1.11750066280365 90.351166 0.0 0.0 8 0.0 wikitext comb_13 phi rnd_search 4397.365248 4699.717632 1.11750066280365 90.351166 0.0 0.023809527978301 5 0.0 wikitext comb_11 phi rnd_search 4397.365248 4699.717632 1.0873867273330688 90.361673 0.0 0.0 4 0.0 wikitext comb_11 phi rnd_search 4397.365248 4699.717632 1.31498122215271 90.366054 0.0 0.0031746034510433 7 0.0 wikitext comb_0 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 90.407107 0.0 0.0031746034510433 4 0.0 wikitext comb_18 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 90.410462 0.0 0.0031746034510433 6 0.0 wikitext comb_0 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 90.410494 0.0 0.0031746034510433 6 0.0 wikitext comb_18 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 91.867446 0.0 0.0031746034510433 8 0.0 wikitext comb_16 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 112.356243 0.0 0.0031746034510433 5 0.0 wikitext comb_16 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 112.37268 0.0 0.0031746034510433 7 0.0 wikitext comb_16 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 112.472816 0.0 0.0031746034510433 6 0.0 wikitext comb_16 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 112.61971 0.0 0.0031746034510433 6 0.0 wikitext comb_9 phi rnd_search 4397.365248 4699.717632 1.1135464906692505 137.362622 0.0 0.0 4 0.0 wikitext comb_9 phi rnd_search 4397.365248 4699.717632 1.1155335903167725 137.37771 0.0 0.0031746034510433 5 0.0 wikitext comb_9 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 137.480487 0.0 0.0031746034510433 5 0.0 wikitext comb_5 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 137.499132 0.0 0.0031746034510433 7 0.0 wikitext comb_5 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 137.509518 0.0 0.0031746034510433 4 0.0 wikitext comb_5 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 137.531691 0.0 0.0031746034510433 6 0.0 wikitext comb_8 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 137.534285 0.0 0.0031746034510433 7 0.0 wikitext comb_9 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 137.555181 0.0 0.0031746034510433 8 0.0 wikitext comb_9 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 137.555816 0.0 0.0031746034510433 6 0.0 wikitext comb_5 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 137.571496 0.0 0.0031746034510433 8 0.0 wikitext comb_5 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 137.631837 0.0 0.0031746034510433 4 0.0 wikitext comb_8 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 137.6434 0.0 0.0031746034510433 5 0.0 wikitext comb_8 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 137.705755 0.0 0.0031746034510433 8 0.0 wikitext comb_8 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 137.725863 0.0 0.0031746034510433 7 0.0 wikitext comb_8 phi rnd_search 4397.365248 4699.717632 1.1135467290878296 137.896861 0.0 0.368794322013855 7 0.0 wikitext comb_11 phi rnd_search 4397.836288 4699.717632 6.139892101287842 90.757354 0.0 0.3236069083213806 6 0.0 wikitext comb_11 phi rnd_search 4397.836288 4699.717632 7.163529396057129 90.810683 0.0 0.378216803073883 8 0.0 wikitext comb_11 phi rnd_search 4397.836288 4699.717632 5.9109368324279785 90.911166 0.0 0.0 4 0.0 wikitext comb_7 phi rnd_search 3361.675264 5358.22336 1.1089000701904297 1.676915 0.0 0.0 5 0.0 wikitext comb_7 phi rnd_search 3361.675264 5358.22336 1.1089000701904297 1.676915 0.0 0.0 6 0.0 wikitext comb_7 phi rnd_search 3361.675264 5358.22336 1.1089000701904297 1.676915 0.0 0.0 7 0.0 wikitext comb_7 phi rnd_search 3361.675264 5358.22336 1.1089000701904297 1.676915 0.0 0.0 8 0.0 wikitext comb_7 phi rnd_search 3361.675264 5358.22336 1.1089000701904297 1.676915 0.0 0.0 4 0.0 wikitext comb_1 phi rnd_search 3361.675264 5358.22336 1.1058108806610107 1.703924 0.0 0.0 5 0.0 wikitext comb_1 phi rnd_search 3361.675264 5358.22336 1.1058108806610107 1.703924 0.0 0.0 6 0.0 wikitext comb_1 phi rnd_search 3361.675264 5358.22336 1.1058108806610107 1.703924 0.0 0.0 7 0.0 wikitext comb_1 phi rnd_search 3361.675264 5358.22336 1.1058108806610107 1.703924 0.0 0.0 8 0.0 wikitext comb_1 phi rnd_search 3361.675264 5358.22336 1.1058108806610107 1.703924 0.0 0.0031746034510433 6 0.0 wikitext comb_17 phi rnd_search 5052.72576 5880.414208 1.1135467290878296 328.459282 0.0 0.0031746034510433 8 0.0 wikitext comb_17 phi rnd_search 5052.72576 5880.414208 1.1135467290878296 328.492297 0.0 0.0031746034510433 5 0.0 wikitext comb_17 phi rnd_search 5052.72576 5880.414208 1.1135467290878296 328.572316 0.0 0.0031746034510433 4 0.0 wikitext comb_17 phi rnd_search 5052.72576 5880.414208 1.1135467290878296 328.607702 0.0 0.0031746034510433 7 0.0 wikitext comb_17 phi rnd_search 5052.72576 5880.414208 1.1135467290878296 328.698036 0.0 0.0 4 0.0 imagenet comb_2 vit rnd_search 357.020672 381.681664 0.0 24.448197 0.0 0.0 5 0.0 imagenet comb_2 vit rnd_search 357.020672 381.681664 0.0 24.448197 0.0 0.0 6 0.0 imagenet comb_2 vit rnd_search 357.020672 381.681664 0.0 24.448197 0.0 0.0 7 0.0 imagenet comb_2 vit rnd_search 357.020672 381.681664 0.0 24.448197 0.0 0.0 8 0.0 imagenet comb_2 vit rnd_search 357.020672 381.681664 0.0 24.448197 0.0 0.0 4 0.0 imagenet comb_10 vit rnd_search 357.020672 381.681664 0.0 25.092947 0.0 0.0 5 0.0 imagenet comb_10 vit rnd_search 357.020672 381.681664 0.0 25.092947 0.0 0.0 6 0.0 imagenet comb_10 vit rnd_search 357.020672 381.681664 0.0 25.092947 0.0 0.0 7 0.0 imagenet comb_10 vit rnd_search 357.020672 381.681664 0.0 25.092947 0.0 0.0 8 0.0 imagenet comb_10 vit rnd_search 357.020672 381.681664 0.0 25.092947 0.0 0.7995889186859131 7 0.0 imagenet comb_6 vit rnd_search 357.513728 381.681664 0.0 27.524662 0.0 0.7903391718864441 4 0.0 imagenet comb_6 vit rnd_search 357.513728 381.681664 0.0 35.73088 0.0 0.7995889186859131 5 0.0 imagenet comb_6 vit rnd_search 357.513728 381.681664 0.0 36.156648 0.0 0.8057554364204407 6 0.0 imagenet comb_6 vit rnd_search 357.513728 381.681664 0.0 41.782813 0.0 0.8016444444656372 8 0.0 imagenet comb_6 vit rnd_search 357.513728 381.681664 0.0 46.242996 0.0 0.0 4 0.0 imagenet comb_14 vit rnd_search 357.9136 381.681664 0.0 31.135807 0.0 0.0 5 0.0 imagenet comb_14 vit rnd_search 357.9136 381.681664 0.0 31.135807 0.0 0.0 6 0.0 imagenet comb_14 vit rnd_search 357.9136 381.681664 0.0 31.135807 0.0 0.0 7 0.0 imagenet comb_14 vit rnd_search 357.9136 381.681664 0.0 31.135807 0.0 0.0 8 0.0 imagenet comb_14 vit rnd_search 357.9136 381.681664 0.0 31.135807 0.0 0.0 4 0.0 imagenet comb_0 vit rnd_search 357.9136 381.681664 0.0 31.838783 0.0 0.0 5 0.0 imagenet comb_0 vit rnd_search 357.9136 381.681664 0.0 31.838783 0.0 0.0 6 0.0 imagenet comb_0 vit rnd_search 357.9136 381.681664 0.0 31.838783 0.0 0.0 7 0.0 imagenet comb_0 vit rnd_search 357.9136 381.681664 0.0 31.838783 0.0 0.0 8 0.0 imagenet comb_0 vit rnd_search 357.9136 381.681664 0.0 31.838783 0.0 0.0 4 0.0 imagenet comb_12 vit rnd_search 357.9136 381.681664 0.0 33.203171 0.0 0.0 5 0.0 imagenet comb_12 vit rnd_search 357.9136 381.681664 0.0 33.203171 0.0 0.0 6 0.0 imagenet comb_12 vit rnd_search 357.9136 381.681664 0.0 33.203171 0.0 0.0 7 0.0 imagenet comb_12 vit rnd_search 357.9136 381.681664 0.0 33.203171 0.0 0.0 8 0.0 imagenet comb_12 vit rnd_search 357.9136 381.681664 0.0 33.203171 0.0 0.0 4 0.0 imagenet comb_16 vit rnd_search 357.9136 381.681664 0.0 34.171731 0.0 0.0 5 0.0 imagenet comb_16 vit rnd_search 357.9136 381.681664 0.0 34.171731 0.0 0.0 6 0.0 imagenet comb_16 vit rnd_search 357.9136 381.681664 0.0 34.171731 0.0 0.0 7 0.0 imagenet comb_16 vit rnd_search 357.9136 381.681664 0.0 34.171731 0.0 0.0 8 0.0 imagenet comb_16 vit rnd_search 357.9136 381.681664 0.0 34.171731 0.0 0.0 4 0.0 imagenet comb_5 vit rnd_search 357.9136 381.681664 0.0 36.502111 0.0 0.0 5 0.0 imagenet comb_5 vit rnd_search 357.9136 381.681664 0.0 36.502111 0.0 0.0 6 0.0 imagenet comb_5 vit rnd_search 357.9136 381.681664 0.0 36.502111 0.0 0.0 7 0.0 imagenet comb_5 vit rnd_search 357.9136 381.681664 0.0 36.502111 0.0 0.0 8 0.0 imagenet comb_5 vit rnd_search 357.9136 381.681664 0.0 36.502111 0.0 0.0 4 0.0 imagenet comb_8 vit rnd_search 357.9136 381.681664 0.0 38.814725 0.0 0.0 5 0.0 imagenet comb_8 vit rnd_search 357.9136 381.681664 0.0 38.814725 0.0 0.0 6 0.0 imagenet comb_8 vit rnd_search 357.9136 381.681664 0.0 38.814725 0.0 0.0 7 0.0 imagenet comb_8 vit rnd_search 357.9136 381.681664 0.0 38.814725 0.0 0.0 8 0.0 imagenet comb_8 vit rnd_search 357.9136 381.681664 0.0 38.814725 0.0 0.0 4 0.0 imagenet comb_11 vit rnd_search 357.9136 381.681664 0.0 54.320897 0.0 0.0 4 0.0 imagenet comb_13 vit rnd_search 357.9136 381.681664 0.0 54.393749 0.0 0.0 5 0.0 imagenet comb_13 vit rnd_search 357.9136 381.681664 0.0 54.393749 0.0 0.0 6 0.0 imagenet comb_13 vit rnd_search 357.9136 381.681664 0.0 54.393749 0.0 0.0 7 0.0 imagenet comb_13 vit rnd_search 357.9136 381.681664 0.0 54.393749 0.0 0.0 8 0.0 imagenet comb_13 vit rnd_search 357.9136 381.681664 0.0 54.393749 0.0 0.0 4 0.0 imagenet comb_9 vit rnd_search 357.9136 381.681664 0.0 56.36386 0.0 0.0 5 0.0 imagenet comb_9 vit rnd_search 357.9136 381.681664 0.0 56.36386 0.0 0.0 6 0.0 imagenet comb_9 vit rnd_search 357.9136 381.681664 0.0 56.36386 0.0 0.0 7 0.0 imagenet comb_9 vit rnd_search 357.9136 381.681664 0.0 56.36386 0.0 0.0 8 0.0 imagenet comb_9 vit rnd_search 357.9136 381.681664 0.0 56.36386 0.0 0.0 4 0.0 imagenet comb_18 vit rnd_search 357.9136 381.681664 0.0 66.767654 0.0 0.0 5 0.0 imagenet comb_18 vit rnd_search 357.9136 381.681664 0.0 66.767654 0.0 0.0 6 0.0 imagenet comb_18 vit rnd_search 357.9136 381.681664 0.0 66.767654 0.0 0.0 7 0.0 imagenet comb_18 vit rnd_search 357.9136 381.681664 0.0 66.767654 0.0 0.0 8 0.0 imagenet comb_18 vit rnd_search 357.9136 381.681664 0.0 66.767654 0.0 0.0 4 0.0 imagenet comb_4 vit rnd_search 357.9136 381.681664 0.0 73.436259 0.0 0.0 5 0.0 imagenet comb_4 vit rnd_search 357.9136 381.681664 0.0 73.436259 0.0 0.0 6 0.0 imagenet comb_4 vit rnd_search 357.9136 381.681664 0.0 73.436259 0.0 0.0 7 0.0 imagenet comb_4 vit rnd_search 357.9136 381.681664 0.0 73.436259 0.0 0.0 8 0.0 imagenet comb_4 vit rnd_search 357.9136 381.681664 0.0 73.436259 0.0 0.7852004170417786 6 0.0 imagenet comb_11 vit rnd_search 358.406656 383.778816 0.0 32.347425 0.0 0.6628983020782471 5 0.0 imagenet comb_11 vit rnd_search 358.406656 383.778816 0.0 38.414141 0.0 0.7965056896209717 8 0.0 imagenet comb_11 vit rnd_search 358.406656 383.778816 0.0 51.941874 0.0 0.7934224605560303 7 0.0 imagenet comb_11 vit rnd_search 358.406656 383.778816 0.0 53.343248 0.0 0.0 4 0.0 imagenet comb_17 vit rnd_search 378.885632 398.45888 0.0 67.943628 0.0 0.0 5 0.0 imagenet comb_17 vit rnd_search 378.885632 398.45888 0.0 67.943628 0.0 0.0 6 0.0 imagenet comb_17 vit rnd_search 378.885632 398.45888 0.0 67.943628 0.0 0.0 7 0.0 imagenet comb_17 vit rnd_search 378.885632 398.45888 0.0 67.943628 0.0 0.0 8 0.0 imagenet comb_17 vit rnd_search 378.885632 398.45888 0.0 67.943628 0.0 0.0 4 0.0 imagenet comb_7 vit rnd_search 325.22752 400.556032 0.0 0.115089 0.0 0.0 5 0.0 imagenet comb_7 vit rnd_search 325.22752 400.556032 0.0 0.115089 0.0 0.0 6 0.0 imagenet comb_7 vit rnd_search 325.22752 400.556032 0.0 0.115089 0.0 0.0 7 0.0 imagenet comb_7 vit rnd_search 325.22752 400.556032 0.0 0.115089 0.0 0.0 8 0.0 imagenet comb_7 vit rnd_search 325.22752 400.556032 0.0 0.115089 0.0 0.0 4 0.0 imagenet comb_1 vit rnd_search 325.22752 400.556032 0.0 0.116159 0.0 0.0 5 0.0 imagenet comb_1 vit rnd_search 325.22752 400.556032 0.0 0.116159 0.0 0.0 6 0.0 imagenet comb_1 vit rnd_search 325.22752 400.556032 0.0 0.116159 0.0 0.0 7 0.0 imagenet comb_1 vit rnd_search 325.22752 400.556032 0.0 0.116159 0.0 0.0 8 0.0 imagenet comb_1 vit rnd_search 325.22752 400.556032 0.0 0.116159 0.0 0.0 4 0.0 wikitext comb_2 opt rnd_search 669.68832 861.929472 1.1036932468414309 21.967927 0.0 0.0 5 0.0 wikitext comb_2 opt rnd_search 669.68832 861.929472 1.1036932468414309 21.967927 0.0 0.0 6 0.0 wikitext comb_2 opt rnd_search 669.68832 861.929472 1.1036932468414309 21.967927 0.0 0.0 7 0.0 wikitext comb_2 opt rnd_search 669.68832 861.929472 1.1036932468414309 21.967927 0.0 0.0 8 0.0 wikitext comb_2 opt rnd_search 669.68832 861.929472 1.1036932468414309 21.967927 0.0 0.0 4 0.0 wikitext comb_10 opt rnd_search 669.68832 861.929472 1.1143286228179932 25.208147 0.0 0.0 5 0.0 wikitext comb_10 opt rnd_search 669.68832 861.929472 1.1143286228179932 25.208147 0.0 0.0 6 0.0 wikitext comb_10 opt rnd_search 669.68832 861.929472 1.1143286228179932 25.208147 0.0 0.0 7 0.0 wikitext comb_10 opt rnd_search 669.68832 861.929472 1.1143286228179932 25.208147 0.0 0.0 8 0.0 wikitext comb_10 opt rnd_search 669.68832 861.929472 1.1143286228179932 25.208147 0.0 0.2894968092441559 4 0.0 wikitext comb_6 opt rnd_search 670.15936 861.929472 8.902691841125488 14.988074 0.0 0.3248226940631866 8 0.0 wikitext comb_6 opt rnd_search 670.15936 861.929472 7.916566848754883 15.037134 0.0 0.3169875144958496 5 0.0 wikitext comb_6 opt rnd_search 670.15936 861.929472 8.223234176635742 15.088096 0.0 0.3213103413581848 6 0.0 wikitext comb_6 opt rnd_search 670.15936 861.929472 7.80169153213501 15.145257 0.0 0.3246538341045379 7 0.0 wikitext comb_6 opt rnd_search 670.15936 861.929472 7.905251502990723 15.165377 0.0 0.0 4 0.0 wikitext comb_4 opt rnd_search 670.981632 861.929472 1.1180580854415894 24.258743 0.0 0.0 5 0.0 wikitext comb_4 opt rnd_search 670.981632 861.929472 1.1180580854415894 24.258743 0.0 0.0 6 0.0 wikitext comb_4 opt rnd_search 670.981632 861.929472 1.1180580854415894 24.258743 0.0 0.0 7 0.0 wikitext comb_4 opt rnd_search 670.981632 861.929472 1.1180580854415894 24.258743 0.0 0.0 8 0.0 wikitext comb_4 opt rnd_search 670.981632 861.929472 1.1180580854415894 24.258743 0.0 0.0 4 0.0 wikitext comb_12 opt rnd_search 670.981632 861.929472 1.1143286228179932 24.517067 0.0 0.0 5 0.0 wikitext comb_12 opt rnd_search 670.981632 861.929472 1.1143286228179932 24.517067 0.0 0.0 6 0.0 wikitext comb_12 opt rnd_search 670.981632 861.929472 1.1143286228179932 24.517067 0.0 0.0 7 0.0 wikitext comb_12 opt rnd_search 670.981632 861.929472 1.1143286228179932 24.517067 0.0 0.0 8 0.0 wikitext comb_12 opt rnd_search 670.981632 861.929472 1.1143286228179932 24.517067 0.0 0.0 4 0.0 wikitext comb_14 opt rnd_search 670.981632 861.929472 1.1143286228179932 24.594108 0.0 0.0 5 0.0 wikitext comb_14 opt rnd_search 670.981632 861.929472 1.1143286228179932 24.594108 0.0 0.0 6 0.0 wikitext comb_14 opt rnd_search 670.981632 861.929472 1.1143286228179932 24.594108 0.0 0.0 7 0.0 wikitext comb_14 opt rnd_search 670.981632 861.929472 1.1143286228179932 24.594108 0.0 0.0 8 0.0 wikitext comb_14 opt rnd_search 670.981632 861.929472 1.1143286228179932 24.594108 0.0 0.3139142096042633 8 0.0 wikitext comb_11 opt rnd_search 671.452672 861.929472 8.120327949523926 24.226411 0.0 0.0 4 0.0 librispeech comb_2 wav2vec rnd_search 534.74304 1692.401664 0.0 19.042782 1.0 0.0 5 0.0 librispeech comb_2 wav2vec rnd_search 534.74304 1692.401664 0.0 19.042782 1.0 0.0 6 0.0 librispeech comb_2 wav2vec rnd_search 534.74304 1692.401664 0.0 19.042782 1.0 0.0 7 0.0 librispeech comb_2 wav2vec rnd_search 534.74304 1692.401664 0.0 19.042782 1.0 0.0 8 0.0 librispeech comb_2 wav2vec rnd_search 534.74304 1692.401664 0.0 19.042782 1.0 0.0 4 0.0 librispeech comb_10 wav2vec rnd_search 534.74304 1692.401664 0.0 19.646985 1.0 0.0 5 0.0 librispeech comb_10 wav2vec rnd_search 534.74304 1692.401664 0.0 19.646985 1.0 0.0 6 0.0 librispeech comb_10 wav2vec rnd_search 534.74304 1692.401664 0.0 19.646985 1.0 0.0 7 0.0 librispeech comb_10 wav2vec rnd_search 534.74304 1692.401664 0.0 19.646985 1.0 0.0 8 0.0 librispeech comb_10 wav2vec rnd_search 534.74304 1692.401664 0.0 19.646985 1.0 0.0 4 0.0 librispeech comb_18 wav2vec rnd_search 535.632384 1692.401664 0.0 22.313042 1.0 0.0 5 0.0 librispeech comb_18 wav2vec rnd_search 535.632384 1692.401664 0.0 22.313042 1.0 0.0 6 0.0 librispeech comb_18 wav2vec rnd_search 535.632384 1692.401664 0.0 22.313042 1.0 0.0 7 0.0 librispeech comb_18 wav2vec rnd_search 535.632384 1692.401664 0.0 22.313042 1.0 0.0 8 0.0 librispeech comb_18 wav2vec rnd_search 535.632384 1692.401664 0.0 22.313042 1.0 0.0 4 0.0 librispeech comb_0 wav2vec rnd_search 535.632384 1692.401664 0.0 22.600344 1.0 0.0 5 0.0 librispeech comb_0 wav2vec rnd_search 535.632384 1692.401664 0.0 22.600344 1.0 0.0 6 0.0 librispeech comb_0 wav2vec rnd_search 535.632384 1692.401664 0.0 22.600344 1.0 0.0 7 0.0 librispeech comb_0 wav2vec rnd_search 535.632384 1692.401664 0.0 22.600344 1.0 0.0 8 0.0 librispeech comb_0 wav2vec rnd_search 535.632384 1692.401664 0.0 22.600344 1.0 0.0 4 0.0 librispeech comb_13 wav2vec rnd_search 535.632384 1692.401664 0.0 22.795695 1.0 0.0 5 0.0 librispeech comb_13 wav2vec rnd_search 535.632384 1692.401664 0.0 22.795695 1.0 0.0 6 0.0 librispeech comb_13 wav2vec rnd_search 535.632384 1692.401664 0.0 22.795695 1.0 0.0 7 0.0 librispeech comb_13 wav2vec rnd_search 535.632384 1692.401664 0.0 22.795695 1.0 0.0 8 0.0 librispeech comb_13 wav2vec rnd_search 535.632384 1692.401664 0.0 22.795695 1.0 0.0 4 0.0 librispeech comb_12 wav2vec rnd_search 535.632384 1692.401664 0.0 22.873822 1.0 0.0 5 0.0 librispeech comb_12 wav2vec rnd_search 535.632384 1692.401664 0.0 22.873822 1.0 0.0 6 0.0 librispeech comb_12 wav2vec rnd_search 535.632384 1692.401664 0.0 22.873822 1.0 0.0 7 0.0 librispeech comb_12 wav2vec rnd_search 535.632384 1692.401664 0.0 22.873822 1.0 0.0 8 0.0 librispeech comb_12 wav2vec rnd_search 535.632384 1692.401664 0.0 22.873822 1.0 0.0 4 0.0 librispeech comb_4 wav2vec rnd_search 535.632384 1692.401664 0.0 23.303888 1.0 0.0 5 0.0 librispeech comb_4 wav2vec rnd_search 535.632384 1692.401664 0.0 23.303888 1.0 0.0 6 0.0 librispeech comb_4 wav2vec rnd_search 535.632384 1692.401664 0.0 23.303888 1.0 0.0 7 0.0 librispeech comb_4 wav2vec rnd_search 535.632384 1692.401664 0.0 23.303888 1.0 0.0 8 0.0 librispeech comb_4 wav2vec rnd_search 535.632384 1692.401664 0.0 23.303888 1.0 0.0 4 0.0 librispeech comb_14 wav2vec rnd_search 535.632384 1692.401664 0.0 24.166937 1.0 0.0 5 0.0 librispeech comb_14 wav2vec rnd_search 535.632384 1692.401664 0.0 24.166937 1.0 0.0 6 0.0 librispeech comb_14 wav2vec rnd_search 535.632384 1692.401664 0.0 24.166937 1.0 0.0 7 0.0 librispeech comb_14 wav2vec rnd_search 535.632384 1692.401664 0.0 24.166937 1.0 0.0 8 0.0 librispeech comb_14 wav2vec rnd_search 535.632384 1692.401664 0.0 24.166937 1.0 0.0 4 0.0 librispeech comb_16 wav2vec rnd_search 535.632384 1692.401664 0.0 24.695199 1.0 0.0 5 0.0 librispeech comb_16 wav2vec rnd_search 535.632384 1692.401664 0.0 24.695199 1.0 0.0 6 0.0 librispeech comb_16 wav2vec rnd_search 535.632384 1692.401664 0.0 24.695199 1.0 0.0 7 0.0 librispeech comb_16 wav2vec rnd_search 535.632384 1692.401664 0.0 24.695199 1.0 0.0 8 0.0 librispeech comb_16 wav2vec rnd_search 535.632384 1692.401664 0.0 24.695199 1.0 0.0 4 0.0 librispeech comb_5 wav2vec rnd_search 535.632384 1692.401664 0.0 25.523009 1.0 0.0 5 0.0 librispeech comb_5 wav2vec rnd_search 535.632384 1692.401664 0.0 25.523009 1.0 0.0 6 0.0 librispeech comb_5 wav2vec rnd_search 535.632384 1692.401664 0.0 25.523009 1.0 0.0 7 0.0 librispeech comb_5 wav2vec rnd_search 535.632384 1692.401664 0.0 25.523009 1.0 0.0 8 0.0 librispeech comb_5 wav2vec rnd_search 535.632384 1692.401664 0.0 25.523009 1.0 0.0 4 0.0 librispeech comb_8 wav2vec rnd_search 535.632384 1692.401664 0.0 25.535462 1.0 0.0 5 0.0 librispeech comb_8 wav2vec rnd_search 535.632384 1692.401664 0.0 25.535462 1.0 0.0 6 0.0 librispeech comb_8 wav2vec rnd_search 535.632384 1692.401664 0.0 25.535462 1.0 0.0 7 0.0 librispeech comb_8 wav2vec rnd_search 535.632384 1692.401664 0.0 25.535462 1.0 0.0 8 0.0 librispeech comb_8 wav2vec rnd_search 535.632384 1692.401664 0.0 25.535462 1.0 0.0 4 0.0 librispeech comb_9 wav2vec rnd_search 535.632384 1692.401664 0.0 26.600447 1.0 0.0 5 0.0 librispeech comb_9 wav2vec rnd_search 535.632384 1692.401664 0.0 26.600447 1.0 0.0 6 0.0 librispeech comb_9 wav2vec rnd_search 535.632384 1692.401664 0.0 26.600447 1.0 0.0 7 0.0 librispeech comb_9 wav2vec rnd_search 535.632384 1692.401664 0.0 26.600447 1.0 0.0 8 0.0 librispeech comb_9 wav2vec rnd_search 535.632384 1692.401664 0.0 26.600447 1.0 0.0 4 0.0 librispeech comb_17 wav2vec rnd_search 535.632384 1692.401664 0.0 46.581125 1.0 0.0 5 0.0 librispeech comb_17 wav2vec rnd_search 535.632384 1692.401664 0.0 46.581125 1.0 0.0 6 0.0 librispeech comb_17 wav2vec rnd_search 535.632384 1692.401664 0.0 46.581125 1.0 0.0 7 0.0 librispeech comb_17 wav2vec rnd_search 535.632384 1692.401664 0.0 46.581125 1.0 0.0 8 0.0 librispeech comb_17 wav2vec rnd_search 535.632384 1692.401664 0.0 46.581125 1.0 0.0 4 0.0 librispeech comb_1 wav2vec rnd_search 368.001024 1698.69312 0.0 0.033688 1.0 0.0 5 0.0 librispeech comb_1 wav2vec rnd_search 368.001024 1698.69312 0.0 0.033688 1.0 0.0 6 0.0 librispeech comb_1 wav2vec rnd_search 368.001024 1698.69312 0.0 0.033688 1.0 0.0 7 0.0 librispeech comb_1 wav2vec rnd_search 368.001024 1698.69312 0.0 0.033688 1.0 0.0 8 0.0 librispeech comb_1 wav2vec rnd_search 368.001024 1698.69312 0.0 0.033688 1.0 0.0 4 0.0 librispeech comb_7 wav2vec rnd_search 368.001024 1698.69312 0.0 0.03507 1.0 0.0 5 0.0 librispeech comb_7 wav2vec rnd_search 368.001024 1698.69312 0.0 0.03507 1.0 0.0 6 0.0 librispeech comb_7 wav2vec rnd_search 368.001024 1698.69312 0.0 0.03507 1.0 0.0 7 0.0 librispeech comb_7 wav2vec rnd_search 368.001024 1698.69312 0.0 0.03507 1.0 0.0 8 0.0 librispeech comb_7 wav2vec rnd_search 368.001024 1698.69312 0.0 0.03507 1.0 0.0 7 0.0 librispeech comb_6 wav2vec rnd_search 658.017792 4888.461312 0.0 17.853169 0.0237246455158352 0.0 4 0.0 librispeech comb_6 wav2vec rnd_search 658.017792 4888.461312 0.0 18.168793 0.0270506203055363 0.0 5 0.0 librispeech comb_6 wav2vec rnd_search 658.017792 4888.461312 0.0 18.916229 0.0236871869471776 0.0 6 0.0 librispeech comb_6 wav2vec rnd_search 658.017792 4888.461312 0.0 19.369834 0.0236817450205943 0.0 8 0.0 librispeech comb_6 wav2vec rnd_search 658.017792 4888.461312 0.0 19.406292 0.0239712250945444 0.2965889573097229 4 0.0 wikitext ao_woq opt fixed 268.126208 740.294656 8.768630981445312 16.713258 0.0 0.3245187401771545 7 0.0 wikitext woq opt fixed 670.234624 765.46048 7.905444145202637 21.34634 0.0 0.3248564898967743 8 0.0 wikitext woq opt fixed 670.234624 782.237696 7.916111469268799 21.146683 0.0 0.3170213103294372 5 0.0 wikitext woq opt fixed 670.234624 782.237696 8.222683906555176 21.318598 0.0 0.2924012243747711 4 0.0 wikitext woq opt fixed 670.234624 786.432 8.903441429138184 21.231402 0.0 0.321073979139328 6 0.0 wikitext woq opt fixed 670.234624 786.432 7.8056864738464355 21.325525 0.0 0.3248226940631866 8 0.0 wikitext ao_woq opt fixed 580.071936 834.666496 7.916566848754883 15.291454 0.0 0.3243836760520935 32 0.0 wikitext base opt ---- 1359.398912 1402.994688 7.934948921203613 10.259793 0.0 0.3715636432170868 4 0.0 wikitext ao_woq phi fixed 1922.306048 2797.600768 5.994823932647705 29.916931 0.0 0.3804458081722259 8 0.0 wikitext ao_woq phi fixed 3885.39392 4292.870144 5.907138824462891 28.844547 0.0 0.353799432516098 4 0.0 wikitext woq phi fixed 4394.576384 4697.62048 6.483606815338135 62.256798 0.0 0.3787571489810943 7 0.0 wikitext woq phi fixed 4394.576384 4697.62048 5.903452396392822 62.260671 0.0 0.3752786219120025 5 0.0 wikitext woq phi fixed 4394.576384 4697.62048 5.969074726104736 62.28564 0.0 0.3804795742034912 8 0.0 wikitext woq phi fixed 4394.576384 4697.62048 5.9067816734313965 62.309245 0.0 0.3781155049800873 6 0.0 wikitext woq phi fixed 4394.576384 4697.62048 5.950102806091309 62.371786 0.0 0.3805133402347564 32 0.0 wikitext base phi ---- 11335.518208 11370.758144 5.909549236297607 18.803033 0.0 0.3641674816608429 4 0.0 wikitext ao_woq tinyllama fixed 741.692928 866.123776 7.043089866638184 21.504217 0.0 0.3771361112594604 8 0.0 wikitext ao_woq tinyllama fixed 1631.725568 1988.100096 6.605966091156006 19.289787 0.0 0.3785883486270904 6 0.0 wikitext woq tinyllama fixed 1898.208768 2151.677952 6.501583099365234 19.670746 0.0 0.3469773828983307 4 0.0 wikitext woq tinyllama fixed 1898.208768 2151.677952 7.655362606048584 20.13133 0.0 0.3763255476951599 7 0.0 wikitext woq tinyllama fixed 1898.208768 2151.677952 6.663349628448486 20.220846 0.0 0.3772712051868438 8 0.0 wikitext woq tinyllama fixed 1898.208768 2151.677952 6.604811191558838 20.271864 0.0 0.3676123023033142 5 0.0 wikitext woq tinyllama fixed 1898.208768 2151.677952 6.966304302215576 20.453174 0.0 0.3781492710113525 32 0.0 wikitext base tinyllama ---- 4470.547968 4485.808128 6.595952033996582 14.7146 0.0 0.7995889186859131 7 0.0 imagenet woq vit fixed 356.539392 406.847488 0.0 72.915762 0.0 0.789311408996582 4 0.0 imagenet woq vit fixed 356.539392 406.847488 0.0 79.459568 0.0 0.7995889186859131 5 0.0 imagenet woq vit fixed 356.539392 406.847488 0.0 80.755401 0.0 0.8016444444656372 8 0.0 imagenet woq vit fixed 356.539392 406.847488 0.0 84.771372 0.0 0.8057554364204407 6 0.0 imagenet woq vit fixed 356.539392 406.847488 0.0 87.505697 0.0 0.7954779267311096 4 0.0 imagenet ao_woq vit fixed 179.948032 503.31648 0.0 84.235943 0.0 0.8016444444656372 8 0.0 imagenet ao_woq vit fixed 341.330432 511.705088 0.0 70.219511 0.0 0.8006166815757751 32 0.0 imagenet base vit ---- 1235.241472 1256.194048 0.0 10.072652 0.0 0.0 4 0.0 librispeech woq wav2vec fixed 658.092544 4764.729344 0.0 25.254058 0.0268907930412973 0.0 7 0.0 librispeech woq wav2vec fixed 658.092544 4764.729344 0.0 87.311892 0.0236079788491685 0.0 5 0.0 librispeech woq wav2vec fixed 658.092544 4764.729344 0.0 88.949576 0.0237326414926321 0.0 8 0.0 librispeech woq wav2vec fixed 658.092544 4764.729344 0.0 93.252914 0.0239494859641096 0.0 6 0.0 librispeech woq wav2vec fixed 658.092544 4764.729344 0.0 96.317889 0.0234031339094832 0.0 8 0.0 librispeech ao_woq wav2vec fixed 658.017792 4890.558464 0.0 94.874683 0.0239712250945444 0.0 32 0.0 librispeech base wav2vec ---- 1564.76928 5620.36736 0.0 18.11403 0.0239473509600023 0.4277946949005127 4 0.0 wikitext ao_woq llama3 fixed 5542.3616 7163.871232 5.3583574295043945 39.050602 0.0 0.4437352418899536 8 0.0 wikitext ao_woq llama3 fixed 12110.375936 14040.43264 5.208643436431885 52.36158 0.0 0.3797703683376312 4 0.0 wikitext woq llama3 fixed 14179.331584 15367.929856 6.163248062133789 95.615827 0.0 0.4355623126029968 5 0.0 wikitext woq llama3 fixed 14179.331584 15367.929856 5.448963165283203 95.618313 0.0 0.443870335817337 8 0.0 wikitext woq llama3 fixed 14179.331584 15367.929856 5.208242893218994 95.65331 0.0 0.4409320950508117 6 0.0 wikitext woq llama3 fixed 14179.331584 15367.929856 5.193300724029541 95.732171 0.0 0.4427558183670044 7 0.0 wikitext woq llama3 fixed 14179.331584 15367.929856 5.248887062072754 95.895658 0.0 0.4436677098274231 32 0.0 wikitext base llama3 ---- 33003.526656 33155.97312 5.223813056945801 26.70374 0.0