Diogo-V's picture
Adds final graphs
48e27c5 verified
accuracy bits clip dataset method model params peak_mem_alloc_mb peak_mem_reserv_mb perplexity time_ms wer
0.0 4 0.0 imagenet comb_11 vit nlr 355.972096 511.705088 0.0 48.566363 0.0
0.0 5 0.0 imagenet comb_11 vit nlr 355.972096 511.705088 0.0 48.566363 0.0
0.0 6 0.0 imagenet comb_11 vit nlr 355.972096 511.705088 0.0 48.566363 0.0
0.0 7 0.0 imagenet comb_11 vit nlr 355.972096 511.705088 0.0 48.566363 0.0
0.0 8 0.0 imagenet comb_11 vit nlr 355.972096 511.705088 0.0 48.566363 0.0
0.0 4 0.0 imagenet comb_3 vit nlr 355.972096 511.705088 0.0 50.969263 0.0
0.0 5 0.0 imagenet comb_3 vit nlr 355.972096 511.705088 0.0 50.969263 0.0
0.0 6 0.0 imagenet comb_3 vit nlr 355.972096 511.705088 0.0 50.969263 0.0
0.0 7 0.0 imagenet comb_3 vit nlr 355.972096 511.705088 0.0 50.969263 0.0
0.0 8 0.0 imagenet comb_3 vit nlr 355.972096 511.705088 0.0 50.969263 0.0
0.8016444444656372 8 0.0 imagenet comb_6 vit nlr 356.465152 511.705088 0.0 31.360256 0.0
0.8057554364204407 6 0.0 imagenet comb_6 vit nlr 356.465152 511.705088 0.0 31.451741 0.0
0.7995889186859131 7 0.0 imagenet comb_6 vit nlr 356.465152 511.705088 0.0 32.509696 0.0
0.7995889186859131 5 0.0 imagenet comb_6 vit nlr 356.465152 511.705088 0.0 36.90318 0.0
0.8057554364204407 6 0.0 imagenet woq vit fixed 356.539392 511.705088 0.0 29.478689 0.0
0.7995889186859131 7 0.0 imagenet woq vit fixed 356.539392 511.705088 0.0 30.679443 0.0
0.7995889186859131 5 0.0 imagenet woq vit fixed 356.539392 511.705088 0.0 31.594656 0.0
0.8016444444656372 8 0.0 imagenet woq vit fixed 356.539392 511.705088 0.0 35.492065 0.0
0.789311408996582 4 0.0 imagenet woq vit fixed 356.539392 511.705088 0.0 36.486084 0.0
0.0 4 0.0 imagenet comb_15 vit nlr 356.865024 511.705088 0.0 48.298086 0.0
0.0 4 0.0 imagenet comb_5 vit nlr 356.865024 511.705088 0.0 49.382662 0.0
0.0 5 0.0 imagenet comb_5 vit nlr 356.865024 511.705088 0.0 49.382662 0.0
0.0 6 0.0 imagenet comb_5 vit nlr 356.865024 511.705088 0.0 49.382662 0.0
0.0 7 0.0 imagenet comb_5 vit nlr 356.865024 511.705088 0.0 49.382662 0.0
0.0 8 0.0 imagenet comb_5 vit nlr 356.865024 511.705088 0.0 49.382662 0.0
0.0 4 0.0 imagenet comb_13 vit nlr 356.865024 511.705088 0.0 49.55774 0.0
0.0 5 0.0 imagenet comb_13 vit nlr 356.865024 511.705088 0.0 49.55774 0.0
0.0 6 0.0 imagenet comb_13 vit nlr 356.865024 511.705088 0.0 49.55774 0.0
0.0 4 0.0 imagenet comb_8 vit nlr 356.865024 511.705088 0.0 59.329343 0.0
0.0 5 0.0 imagenet comb_8 vit nlr 356.865024 511.705088 0.0 59.329343 0.0
0.0 6 0.0 imagenet comb_8 vit nlr 356.865024 511.705088 0.0 59.329343 0.0
0.0 7 0.0 imagenet comb_8 vit nlr 356.865024 511.705088 0.0 59.329343 0.0
0.0 8 0.0 imagenet comb_8 vit nlr 356.865024 511.705088 0.0 59.329343 0.0
0.0 4 0.0 imagenet comb_10 vit nlr 356.865024 511.705088 0.0 70.759812 0.0
0.0 5 0.0 imagenet comb_10 vit nlr 356.865024 511.705088 0.0 70.759812 0.0
0.07692307978868484 8 0.0 imagenet comb_13 vit nlr 356.86656 511.705088 0.0 77.589117 0.0
0.1818181872367859 4 0.0 imagenet comb_17 vit nlr 356.8768 511.705088 0.0 46.661774 0.0
0.3947368562221527 7 0.0 imagenet comb_13 vit nlr 356.898816 511.705088 0.0 49.318043 0.0
0.0 4 0.0 imagenet comb_0 vit nlr 378.705408 511.705088 0.0 78.256459 0.0
0.0 5 0.0 imagenet comb_0 vit nlr 378.705408 511.705088 0.0 78.256459 0.0
0.0 6 0.0 imagenet comb_0 vit nlr 378.705408 511.705088 0.0 78.256459 0.0
0.0 7 0.0 imagenet comb_0 vit nlr 378.705408 511.705088 0.0 78.256459 0.0
0.0 8 0.0 imagenet comb_0 vit nlr 378.705408 511.705088 0.0 78.256459 0.0
0.0 4 0.0 imagenet comb_1 vit nlr 328.270848 513.80224 0.0 0.083496 0.0
0.0 5 0.0 imagenet comb_1 vit nlr 328.270848 513.80224 0.0 0.083496 0.0
0.0 6 0.0 imagenet comb_1 vit nlr 328.270848 513.80224 0.0 0.083496 0.0
0.0 7 0.0 imagenet comb_1 vit nlr 328.270848 513.80224 0.0 0.083496 0.0
0.0 8 0.0 imagenet comb_1 vit nlr 328.270848 513.80224 0.0 0.083496 0.0
0.7995889186859131 5 0.0 imagenet comb_15 vit nlr 357.35808 513.80224 0.0 45.367025 0.0
0.7965056896209717 5 0.0 imagenet comb_14 vit nlr 357.35808 513.80224 0.0 45.701981 0.0
0.7872559428215027 4 0.0 imagenet comb_14 vit nlr 357.35808 513.80224 0.0 46.712465 0.0
0.789311408996582 5 0.0 imagenet comb_17 vit nlr 357.35808 513.80224 0.0 47.861815 0.0
0.7975334525108337 6 0.0 imagenet comb_15 vit nlr 357.35808 513.80224 0.0 47.949818 0.0
0.8026722073554993 7 0.0 imagenet comb_15 vit nlr 357.35808 513.80224 0.0 48.477894 0.0
0.8016444444656372 8 0.0 imagenet comb_16 vit nlr 357.35808 513.80224 0.0 48.999992 0.0
0.8047276735305786 6 0.0 imagenet comb_16 vit nlr 357.35808 513.80224 0.0 49.066835 0.0
0.7995889186859131 8 0.0 imagenet comb_14 vit nlr 357.35808 513.80224 0.0 49.203667 0.0
0.8006166815757751 8 0.0 imagenet comb_15 vit nlr 357.35808 513.80224 0.0 49.35876 0.0
0.8016444444656372 5 0.0 imagenet comb_9 vit nlr 357.35808 513.80224 0.0 50.707572 0.0
0.8016444444656372 6 0.0 imagenet comb_14 vit nlr 357.35808 513.80224 0.0 50.762264 0.0
0.7975334525108337 7 0.0 imagenet comb_14 vit nlr 357.35808 513.80224 0.0 50.850867 0.0
0.7934224605560303 4 0.0 imagenet comb_9 vit nlr 357.35808 513.80224 0.0 51.506424 0.0
0.8016444444656372 7 0.0 imagenet comb_16 vit nlr 357.35808 513.80224 0.0 51.620139 0.0
0.8006166815757751 8 0.0 imagenet comb_4 vit nlr 357.35808 513.80224 0.0 51.661832 0.0
0.8026722073554993 8 0.0 imagenet comb_17 vit nlr 357.35808 513.80224 0.0 52.06544 0.0
0.8006166815757751 7 0.0 imagenet comb_4 vit nlr 357.35808 513.80224 0.0 54.929084 0.0
0.8006166815757751 7 0.0 imagenet comb_17 vit nlr 357.35808 513.80224 0.0 55.251156 0.0
0.8047276735305786 6 0.0 imagenet comb_9 vit nlr 357.35808 513.80224 0.0 56.922299 0.0
0.8036999106407166 8 0.0 imagenet comb_10 vit nlr 357.35808 513.80224 0.0 57.946418 0.0
0.8006166815757751 7 0.0 imagenet comb_9 vit nlr 357.35808 513.80224 0.0 58.265758 0.0
0.7975334525108337 5 0.0 imagenet comb_4 vit nlr 357.35808 513.80224 0.0 59.485985 0.0
0.7841727137565613 6 0.0 imagenet comb_10 vit nlr 357.35808 513.80224 0.0 60.366089 0.0
0.8016444444656372 7 0.0 imagenet comb_10 vit nlr 357.35808 513.80224 0.0 61.985628 0.0
0.8016444444656372 8 0.0 imagenet comb_9 vit nlr 357.35808 513.80224 0.0 66.681165 0.0
0.8026722073554993 6 0.0 imagenet comb_4 vit nlr 357.35808 513.80224 0.0 69.508004 0.0
0.8006166815757751 6 0.0 imagenet comb_17 vit nlr 357.35808 513.80224 0.0 79.515335 0.0
0.8006166815757751 32 0.0 imagenet base vit ---- 1235.241472 1256.194048 0.0 18.181087 0.0