Hugging Face's logo

Spaces:
TIGER-Lab
/
GenAI-Arena
Running on Zero

App Files Community
16
DongfuJiang commited on
Commit
6ae4297
•
1 Parent(s): 02a1352

Auto Daily Leaderboard udpate Tue Aug 13 12:00:22 PM EDT 2024

Browse files
Files changed (13) hide show
  1. arena_elo/elo_results_20240809.pkl +3 -0
  2. arena_elo/results/20240809/elo_results_image_editing.pkl +2 -2
  3. arena_elo/results/20240809/image_editing_leaderboard.csv +1 -1
  4. arena_elo/results/20240812/clean_battle_image_editing.json +0 -0
  5. arena_elo/results/20240812/clean_battle_t2i_generation.json +240 -0
  6. arena_elo/results/20240812/elo_results_t2i_generation.pkl +3 -0
  7. arena_elo/results/20240812/t2i_generation_leaderboard.csv +14 -0
  8. arena_elo/results/latest/clean_battle_image_editing.json +24 -0
  9. arena_elo/results/latest/clean_battle_t2i_generation.json +240 -0
  10. arena_elo/results/latest/elo_results_image_editing.pkl +2 -2
  11. arena_elo/results/latest/elo_results_t2i_generation.pkl +1 -1
  12. arena_elo/results/latest/image_editing_leaderboard.csv +1 -1
  13. arena_elo/results/latest/t2i_generation_leaderboard.csv +13 -13
arena_elo/elo_results_20240809.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b54d460d93f22ee6e2519ccc82e4ebd64ec81987505760c428b593ff91a13368
3
+ size 62455
arena_elo/results/20240809/elo_results_image_editing.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b54d460d93f22ee6e2519ccc82e4ebd64ec81987505760c428b593ff91a13368
3
- size 62455
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1da1e19486e987e18cf9bec79c36f1b71291a4f92490cf7d3af4edbc98628510
3
+ size 62482
arena_elo/results/20240809/image_editing_leaderboard.csv CHANGED
@@ -2,7 +2,7 @@ key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,
2
  MagicBrush,MagicBrush,1112.4518849527376,1116.3228088792275,CC-BY-4.0,"The Ohio State University, University of Waterloo",https://osu-nlp-group.github.io/MagicBrush
3
  InfEdit,InfEdit,1077.2249767545911,1077.0861206067664,CC BY-NC-ND 4.0,"University of Michigan, University of California, Berkeley",https://huggingface.co/spaces/sled-umich/InfEdit
4
  CosXLEdit,CosXLEdit,1064.682441262532,1065.599445502775,cosxl-nc-community,Stability AI,https://huggingface.co/spaces/multimodalart/cosxl
5
- InstructPix2Pix,InstructPix2Pix,1035.4054226880567,1033.2086681336118,"Copyright 2023 Timothy Brooks, Aleksander Holynski, Alexei A. Efros","University of California, Berkeley",https://www.timothybrooks.com/instruct-pix2pix
6
  PNP,PNP,1001.4916130267786,1006.0747389504991,-,Weizmann Institute of Science,https://github.com/MichalGeyer/plug-and-play
7
  Prompt2prompt,Prompt2prompt,990.9755779591587,992.0796321838297,Apache-2.0,"Google, Tel Aviv University",https://prompt-to-prompt.github.io
8
  CycleDiffusion,CycleDiffusion,938.5637450408492,931.6722574678079,X11,Carnegie Mellon University,https://github.com/ChenWu98/cycle-diffusion
 
2
  MagicBrush,MagicBrush,1112.4518849527376,1116.3228088792275,CC-BY-4.0,"The Ohio State University, University of Waterloo",https://osu-nlp-group.github.io/MagicBrush
3
  InfEdit,InfEdit,1077.2249767545911,1077.0861206067664,CC BY-NC-ND 4.0,"University of Michigan, University of California, Berkeley",https://huggingface.co/spaces/sled-umich/InfEdit
4
  CosXLEdit,CosXLEdit,1064.682441262532,1065.599445502775,cosxl-nc-community,Stability AI,https://huggingface.co/spaces/multimodalart/cosxl
5
+ InstructPix2Pix,InstructPix2Pix,1035.4054226880567,1033.208668133612,"Copyright 2023 Timothy Brooks, Aleksander Holynski, Alexei A. Efros","University of California, Berkeley",https://www.timothybrooks.com/instruct-pix2pix
6
  PNP,PNP,1001.4916130267786,1006.0747389504991,-,Weizmann Institute of Science,https://github.com/MichalGeyer/plug-and-play
7
  Prompt2prompt,Prompt2prompt,990.9755779591587,992.0796321838297,Apache-2.0,"Google, Tel Aviv University",https://prompt-to-prompt.github.io
8
  CycleDiffusion,CycleDiffusion,938.5637450408492,931.6722574678079,X11,Carnegie Mellon University,https://github.com/ChenWu98/cycle-diffusion
arena_elo/results/20240812/clean_battle_image_editing.json ADDED
The diff for this file is too large to render. See raw diff
 
arena_elo/results/20240812/clean_battle_t2i_generation.json CHANGED
@@ -50622,5 +50622,245 @@
50622
  "judge": "arena_user_10.16.12.147",
50623
  "anony": true,
50624
  "tstamp": 1723466162.8794
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
50625
  }
50626
  ]
 
50622
  "judge": "arena_user_10.16.12.147",
50623
  "anony": true,
50624
  "tstamp": 1723466162.8794
50625
+ },
50626
+ {
50627
+ "model_a": "FluxGuidance",
50628
+ "model_b": "OpenJourney",
50629
+ "winner": "model_a",
50630
+ "judge": "arena_user_10.16.45.228",
50631
+ "anony": true,
50632
+ "tstamp": 1723480776.3318
50633
+ },
50634
+ {
50635
+ "model_a": "SD3",
50636
+ "model_b": "StableCascade",
50637
+ "winner": "model_a",
50638
+ "judge": "arena_user_10.16.36.191",
50639
+ "anony": true,
50640
+ "tstamp": 1723481690.3525
50641
+ },
50642
+ {
50643
+ "model_a": "FluxGuidance",
50644
+ "model_b": "FluxTimestep",
50645
+ "winner": "model_a",
50646
+ "judge": "arena_user_10.16.45.228",
50647
+ "anony": true,
50648
+ "tstamp": 1723483962.3361
50649
+ },
50650
+ {
50651
+ "model_a": "SDXLTurbo",
50652
+ "model_b": "Kolors",
50653
+ "winner": "model_a",
50654
+ "judge": "arena_user_10.16.12.147",
50655
+ "anony": true,
50656
+ "tstamp": 1723510064.126
50657
+ },
50658
+ {
50659
+ "model_a": "FluxGuidance",
50660
+ "model_b": "SDXLTurbo",
50661
+ "winner": "model_b",
50662
+ "judge": "arena_user_10.16.17.24",
50663
+ "anony": true,
50664
+ "tstamp": 1723510079.0831
50665
+ },
50666
+ {
50667
+ "model_a": "PixArtAlpha",
50668
+ "model_b": "FluxTimestep",
50669
+ "winner": "tie (bothbad)",
50670
+ "judge": "arena_user_10.16.22.62",
50671
+ "anony": true,
50672
+ "tstamp": 1723510097.2051
50673
+ },
50674
+ {
50675
+ "model_a": "OpenJourney",
50676
+ "model_b": "PlayGround V2.5",
50677
+ "winner": "model_b",
50678
+ "judge": "arena_user_10.16.17.24",
50679
+ "anony": true,
50680
+ "tstamp": 1723510110.1062
50681
+ },
50682
+ {
50683
+ "model_a": "PixArtSigma",
50684
+ "model_b": "SDXL",
50685
+ "winner": "model_b",
50686
+ "judge": "arena_user_10.16.36.191",
50687
+ "anony": true,
50688
+ "tstamp": 1723510130.9627
50689
+ },
50690
+ {
50691
+ "model_a": "StableCascade",
50692
+ "model_b": "Kolors",
50693
+ "winner": "model_b",
50694
+ "judge": "arena_user_10.16.22.62",
50695
+ "anony": true,
50696
+ "tstamp": 1723510153.5137
50697
+ },
50698
+ {
50699
+ "model_a": "HunyuanDiT",
50700
+ "model_b": "FluxGuidance",
50701
+ "winner": "model_b",
50702
+ "judge": "arena_user_10.16.22.62",
50703
+ "anony": true,
50704
+ "tstamp": 1723510162.6681
50705
+ },
50706
+ {
50707
+ "model_a": "SDXLTurbo",
50708
+ "model_b": "SD3",
50709
+ "winner": "tie",
50710
+ "judge": "arena_user_10.16.17.24",
50711
+ "anony": true,
50712
+ "tstamp": 1723510177.3092
50713
+ },
50714
+ {
50715
+ "model_a": "OpenJourney",
50716
+ "model_b": "SDXLTurbo",
50717
+ "winner": "tie",
50718
+ "judge": "arena_user_10.16.17.24",
50719
+ "anony": true,
50720
+ "tstamp": 1723510190.7916
50721
+ },
50722
+ {
50723
+ "model_a": "PixArtAlpha",
50724
+ "model_b": "SD3",
50725
+ "winner": "tie (bothbad)",
50726
+ "judge": "arena_user_10.16.17.24",
50727
+ "anony": true,
50728
+ "tstamp": 1723510202.1981
50729
+ },
50730
+ {
50731
+ "model_a": "PlayGround V2.5",
50732
+ "model_b": "SDXL",
50733
+ "winner": "model_a",
50734
+ "judge": "arena_user_10.16.17.24",
50735
+ "anony": true,
50736
+ "tstamp": 1723510214.4232
50737
+ },
50738
+ {
50739
+ "model_a": "SDXL",
50740
+ "model_b": "SD3",
50741
+ "winner": "tie (bothbad)",
50742
+ "judge": "arena_user_10.16.45.228",
50743
+ "anony": true,
50744
+ "tstamp": 1723510222.8229
50745
+ },
50746
+ {
50747
+ "model_a": "PixArtAlpha",
50748
+ "model_b": "PlayGround V2.5",
50749
+ "winner": "model_b",
50750
+ "judge": "arena_user_10.16.36.191",
50751
+ "anony": true,
50752
+ "tstamp": 1723520652.9892
50753
+ },
50754
+ {
50755
+ "model_a": "HunyuanDiT",
50756
+ "model_b": "AuraFlow",
50757
+ "winner": "tie (bothbad)",
50758
+ "judge": "arena_user_10.16.12.147",
50759
+ "anony": true,
50760
+ "tstamp": 1723521784.4526
50761
+ },
50762
+ {
50763
+ "model_a": "PixArtSigma",
50764
+ "model_b": "PixArtAlpha",
50765
+ "winner": "tie",
50766
+ "judge": "arena_user_10.16.22.62",
50767
+ "anony": true,
50768
+ "tstamp": 1723521805.5654
50769
+ },
50770
+ {
50771
+ "model_a": "FluxTimestep",
50772
+ "model_b": "StableCascade",
50773
+ "winner": "model_a",
50774
+ "judge": "arena_user_10.16.12.147",
50775
+ "anony": true,
50776
+ "tstamp": 1723521815.6295
50777
+ },
50778
+ {
50779
+ "model_a": "SDXL",
50780
+ "model_b": "FluxGuidance",
50781
+ "winner": "model_b",
50782
+ "judge": "arena_user_10.16.36.191",
50783
+ "anony": true,
50784
+ "tstamp": 1723526528.1654
50785
+ },
50786
+ {
50787
+ "model_a": "AuraFlow",
50788
+ "model_b": "FluxGuidance",
50789
+ "winner": "model_b",
50790
+ "judge": "arena_user_10.16.45.228",
50791
+ "anony": true,
50792
+ "tstamp": 1723526540.4757
50793
+ },
50794
+ {
50795
+ "model_a": "PixArtAlpha",
50796
+ "model_b": "SDXLLightning",
50797
+ "winner": "tie (bothbad)",
50798
+ "judge": "arena_user_10.16.22.62",
50799
+ "anony": true,
50800
+ "tstamp": 1723526571.6821
50801
+ },
50802
+ {
50803
+ "model_a": "SDXLTurbo",
50804
+ "model_b": "HunyuanDiT",
50805
+ "winner": "model_a",
50806
+ "judge": "arena_user_10.16.17.24",
50807
+ "anony": true,
50808
+ "tstamp": 1723526595.2422
50809
+ },
50810
+ {
50811
+ "model_a": "HunyuanDiT",
50812
+ "model_b": "OpenJourney",
50813
+ "winner": "model_a",
50814
+ "judge": "arena_user_10.16.17.24",
50815
+ "anony": true,
50816
+ "tstamp": 1723526609.3918
50817
+ },
50818
+ {
50819
+ "model_a": "SDXLTurbo",
50820
+ "model_b": "SDXL",
50821
+ "winner": "model_a",
50822
+ "judge": "arena_user_10.16.45.228",
50823
+ "anony": true,
50824
+ "tstamp": 1723526669.1413
50825
+ },
50826
+ {
50827
+ "model_a": "Kolors",
50828
+ "model_b": "HunyuanDiT",
50829
+ "winner": "tie (bothbad)",
50830
+ "judge": "arena_user_10.16.22.62",
50831
+ "anony": true,
50832
+ "tstamp": 1723526680.4748
50833
+ },
50834
+ {
50835
+ "model_a": "OpenJourney",
50836
+ "model_b": "SD3",
50837
+ "winner": "model_a",
50838
+ "judge": "arena_user_10.16.22.62",
50839
+ "anony": true,
50840
+ "tstamp": 1723526700.7469
50841
+ },
50842
+ {
50843
+ "model_a": "PixArtSigma",
50844
+ "model_b": "SDXL",
50845
+ "winner": "tie",
50846
+ "judge": "arena_user_10.16.12.147",
50847
+ "anony": true,
50848
+ "tstamp": 1723526723.0377
50849
+ },
50850
+ {
50851
+ "model_a": "FluxTimestep",
50852
+ "model_b": "PlayGround V2.5",
50853
+ "winner": "model_a",
50854
+ "judge": "arena_user_10.16.17.24",
50855
+ "anony": true,
50856
+ "tstamp": 1723526731.8865
50857
+ },
50858
+ {
50859
+ "model_a": "Kolors",
50860
+ "model_b": "SDXLTurbo",
50861
+ "winner": "model_a",
50862
+ "judge": "arena_user_10.16.32.123",
50863
+ "anony": true,
50864
+ "tstamp": 1723531289.9185
50865
  }
50866
  ]
arena_elo/results/20240812/elo_results_t2i_generation.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:894b421ff17c034ec61f976ce4d3723d955afaacfb7e940eb7969a3cef2fe16f
3
+ size 73808
arena_elo/results/20240812/t2i_generation_leaderboard.csv ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ PlayGround V2.5,PlayGround V2.5,1150.7499504793323,1152.7978802461676,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
3
+ PlayGround V2,PlayGround V2,1092.3480876880844,1091.4337824871766,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
4
+ HunyuanDiT,HunyuanDiT,1060.6873964481285,1045.9410086686644,tencent-hunyuan-community,Tencent,https://huggingface.co/Tencent-Hunyuan/HunyuanDiT
5
+ StableCascade,StableCascade,1056.3562779615977,1060.3758908816894,stable-cascade-nc-community (other),Stability AI,https://huggingface.co/stabilityai/stable-cascade
6
+ SDXLLightning,SDXLLightning,1042.034415021577,1047.0881390453108,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
7
+ PixArtAlpha,PixArtAlpha,1040.36338481613,1030.9701625079067,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
8
+ PixArtSigma,PixArtSigma,1038.8231055672843,1039.053677673613,openrail++,PixArt-alpha,https://fal.ai/models/fal-ai/pixart-sigma
9
+ SD3,SD3,1020.87196084551,1014.8093007374721,stabilityai-nc-research-community,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-3-medium
10
+ SDXL,SDXL,986.6245892228262,987.0772066294832,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
11
+ SDXLTurbo,SDXLTurbo,930.0223715992644,927.9777399457049,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
12
+ LCM(v1.5/XL),LCM(v1.5/XL),924.9150421473538,918.899224709552,openrail++,Latent Consistency,https://fal.ai/models/fal-ai/fast-lcm-diffusion/api
13
+ OpenJourney,OpenJourney,847.4428420514181,842.2406737877131,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
14
+ LCM,LCM,808.7605761514947,822.71297437185,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
arena_elo/results/latest/clean_battle_image_editing.json CHANGED
@@ -9406,5 +9406,29 @@
9406
  "judge": "arena_user_10.16.17.24",
9407
  "anony": true,
9408
  "tstamp": 1723211880.79
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9409
  }
9410
  ]
 
9406
  "judge": "arena_user_10.16.17.24",
9407
  "anony": true,
9408
  "tstamp": 1723211880.79
9409
+ },
9410
+ {
9411
+ "model_a": "CosXLEdit",
9412
+ "model_b": "UltraEdit",
9413
+ "winner": "model_b",
9414
+ "judge": "arena_user_10.16.22.62",
9415
+ "anony": true,
9416
+ "tstamp": 1723521854.5354
9417
+ },
9418
+ {
9419
+ "model_a": "UltraEdit",
9420
+ "model_b": "InstructPix2Pix",
9421
+ "winner": "tie (bothbad)",
9422
+ "judge": "arena_user_10.16.36.191",
9423
+ "anony": true,
9424
+ "tstamp": 1723521873.8369
9425
+ },
9426
+ {
9427
+ "model_a": "UltraEdit",
9428
+ "model_b": "Pix2PixZero",
9429
+ "winner": "model_a",
9430
+ "judge": "arena_user_10.16.36.191",
9431
+ "anony": true,
9432
+ "tstamp": 1723521907.3049
9433
  }
9434
  ]
arena_elo/results/latest/clean_battle_t2i_generation.json CHANGED
@@ -50622,5 +50622,245 @@
50622
  "judge": "arena_user_10.16.12.147",
50623
  "anony": true,
50624
  "tstamp": 1723466162.8794
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
50625
  }
50626
  ]
 
50622
  "judge": "arena_user_10.16.12.147",
50623
  "anony": true,
50624
  "tstamp": 1723466162.8794
50625
+ },
50626
+ {
50627
+ "model_a": "FluxGuidance",
50628
+ "model_b": "OpenJourney",
50629
+ "winner": "model_a",
50630
+ "judge": "arena_user_10.16.45.228",
50631
+ "anony": true,
50632
+ "tstamp": 1723480776.3318
50633
+ },
50634
+ {
50635
+ "model_a": "SD3",
50636
+ "model_b": "StableCascade",
50637
+ "winner": "model_a",
50638
+ "judge": "arena_user_10.16.36.191",
50639
+ "anony": true,
50640
+ "tstamp": 1723481690.3525
50641
+ },
50642
+ {
50643
+ "model_a": "FluxGuidance",
50644
+ "model_b": "FluxTimestep",
50645
+ "winner": "model_a",
50646
+ "judge": "arena_user_10.16.45.228",
50647
+ "anony": true,
50648
+ "tstamp": 1723483962.3361
50649
+ },
50650
+ {
50651
+ "model_a": "SDXLTurbo",
50652
+ "model_b": "Kolors",
50653
+ "winner": "model_a",
50654
+ "judge": "arena_user_10.16.12.147",
50655
+ "anony": true,
50656
+ "tstamp": 1723510064.126
50657
+ },
50658
+ {
50659
+ "model_a": "FluxGuidance",
50660
+ "model_b": "SDXLTurbo",
50661
+ "winner": "model_b",
50662
+ "judge": "arena_user_10.16.17.24",
50663
+ "anony": true,
50664
+ "tstamp": 1723510079.0831
50665
+ },
50666
+ {
50667
+ "model_a": "PixArtAlpha",
50668
+ "model_b": "FluxTimestep",
50669
+ "winner": "tie (bothbad)",
50670
+ "judge": "arena_user_10.16.22.62",
50671
+ "anony": true,
50672
+ "tstamp": 1723510097.2051
50673
+ },
50674
+ {
50675
+ "model_a": "OpenJourney",
50676
+ "model_b": "PlayGround V2.5",
50677
+ "winner": "model_b",
50678
+ "judge": "arena_user_10.16.17.24",
50679
+ "anony": true,
50680
+ "tstamp": 1723510110.1062
50681
+ },
50682
+ {
50683
+ "model_a": "PixArtSigma",
50684
+ "model_b": "SDXL",
50685
+ "winner": "model_b",
50686
+ "judge": "arena_user_10.16.36.191",
50687
+ "anony": true,
50688
+ "tstamp": 1723510130.9627
50689
+ },
50690
+ {
50691
+ "model_a": "StableCascade",
50692
+ "model_b": "Kolors",
50693
+ "winner": "model_b",
50694
+ "judge": "arena_user_10.16.22.62",
50695
+ "anony": true,
50696
+ "tstamp": 1723510153.5137
50697
+ },
50698
+ {
50699
+ "model_a": "HunyuanDiT",
50700
+ "model_b": "FluxGuidance",
50701
+ "winner": "model_b",
50702
+ "judge": "arena_user_10.16.22.62",
50703
+ "anony": true,
50704
+ "tstamp": 1723510162.6681
50705
+ },
50706
+ {
50707
+ "model_a": "SDXLTurbo",
50708
+ "model_b": "SD3",
50709
+ "winner": "tie",
50710
+ "judge": "arena_user_10.16.17.24",
50711
+ "anony": true,
50712
+ "tstamp": 1723510177.3092
50713
+ },
50714
+ {
50715
+ "model_a": "OpenJourney",
50716
+ "model_b": "SDXLTurbo",
50717
+ "winner": "tie",
50718
+ "judge": "arena_user_10.16.17.24",
50719
+ "anony": true,
50720
+ "tstamp": 1723510190.7916
50721
+ },
50722
+ {
50723
+ "model_a": "PixArtAlpha",
50724
+ "model_b": "SD3",
50725
+ "winner": "tie (bothbad)",
50726
+ "judge": "arena_user_10.16.17.24",
50727
+ "anony": true,
50728
+ "tstamp": 1723510202.1981
50729
+ },
50730
+ {
50731
+ "model_a": "PlayGround V2.5",
50732
+ "model_b": "SDXL",
50733
+ "winner": "model_a",
50734
+ "judge": "arena_user_10.16.17.24",
50735
+ "anony": true,
50736
+ "tstamp": 1723510214.4232
50737
+ },
50738
+ {
50739
+ "model_a": "SDXL",
50740
+ "model_b": "SD3",
50741
+ "winner": "tie (bothbad)",
50742
+ "judge": "arena_user_10.16.45.228",
50743
+ "anony": true,
50744
+ "tstamp": 1723510222.8229
50745
+ },
50746
+ {
50747
+ "model_a": "PixArtAlpha",
50748
+ "model_b": "PlayGround V2.5",
50749
+ "winner": "model_b",
50750
+ "judge": "arena_user_10.16.36.191",
50751
+ "anony": true,
50752
+ "tstamp": 1723520652.9892
50753
+ },
50754
+ {
50755
+ "model_a": "HunyuanDiT",
50756
+ "model_b": "AuraFlow",
50757
+ "winner": "tie (bothbad)",
50758
+ "judge": "arena_user_10.16.12.147",
50759
+ "anony": true,
50760
+ "tstamp": 1723521784.4526
50761
+ },
50762
+ {
50763
+ "model_a": "PixArtSigma",
50764
+ "model_b": "PixArtAlpha",
50765
+ "winner": "tie",
50766
+ "judge": "arena_user_10.16.22.62",
50767
+ "anony": true,
50768
+ "tstamp": 1723521805.5654
50769
+ },
50770
+ {
50771
+ "model_a": "FluxTimestep",
50772
+ "model_b": "StableCascade",
50773
+ "winner": "model_a",
50774
+ "judge": "arena_user_10.16.12.147",
50775
+ "anony": true,
50776
+ "tstamp": 1723521815.6295
50777
+ },
50778
+ {
50779
+ "model_a": "SDXL",
50780
+ "model_b": "FluxGuidance",
50781
+ "winner": "model_b",
50782
+ "judge": "arena_user_10.16.36.191",
50783
+ "anony": true,
50784
+ "tstamp": 1723526528.1654
50785
+ },
50786
+ {
50787
+ "model_a": "AuraFlow",
50788
+ "model_b": "FluxGuidance",
50789
+ "winner": "model_b",
50790
+ "judge": "arena_user_10.16.45.228",
50791
+ "anony": true,
50792
+ "tstamp": 1723526540.4757
50793
+ },
50794
+ {
50795
+ "model_a": "PixArtAlpha",
50796
+ "model_b": "SDXLLightning",
50797
+ "winner": "tie (bothbad)",
50798
+ "judge": "arena_user_10.16.22.62",
50799
+ "anony": true,
50800
+ "tstamp": 1723526571.6821
50801
+ },
50802
+ {
50803
+ "model_a": "SDXLTurbo",
50804
+ "model_b": "HunyuanDiT",
50805
+ "winner": "model_a",
50806
+ "judge": "arena_user_10.16.17.24",
50807
+ "anony": true,
50808
+ "tstamp": 1723526595.2422
50809
+ },
50810
+ {
50811
+ "model_a": "HunyuanDiT",
50812
+ "model_b": "OpenJourney",
50813
+ "winner": "model_a",
50814
+ "judge": "arena_user_10.16.17.24",
50815
+ "anony": true,
50816
+ "tstamp": 1723526609.3918
50817
+ },
50818
+ {
50819
+ "model_a": "SDXLTurbo",
50820
+ "model_b": "SDXL",
50821
+ "winner": "model_a",
50822
+ "judge": "arena_user_10.16.45.228",
50823
+ "anony": true,
50824
+ "tstamp": 1723526669.1413
50825
+ },
50826
+ {
50827
+ "model_a": "Kolors",
50828
+ "model_b": "HunyuanDiT",
50829
+ "winner": "tie (bothbad)",
50830
+ "judge": "arena_user_10.16.22.62",
50831
+ "anony": true,
50832
+ "tstamp": 1723526680.4748
50833
+ },
50834
+ {
50835
+ "model_a": "OpenJourney",
50836
+ "model_b": "SD3",
50837
+ "winner": "model_a",
50838
+ "judge": "arena_user_10.16.22.62",
50839
+ "anony": true,
50840
+ "tstamp": 1723526700.7469
50841
+ },
50842
+ {
50843
+ "model_a": "PixArtSigma",
50844
+ "model_b": "SDXL",
50845
+ "winner": "tie",
50846
+ "judge": "arena_user_10.16.12.147",
50847
+ "anony": true,
50848
+ "tstamp": 1723526723.0377
50849
+ },
50850
+ {
50851
+ "model_a": "FluxTimestep",
50852
+ "model_b": "PlayGround V2.5",
50853
+ "winner": "model_a",
50854
+ "judge": "arena_user_10.16.17.24",
50855
+ "anony": true,
50856
+ "tstamp": 1723526731.8865
50857
+ },
50858
+ {
50859
+ "model_a": "Kolors",
50860
+ "model_b": "SDXLTurbo",
50861
+ "winner": "model_a",
50862
+ "judge": "arena_user_10.16.32.123",
50863
+ "anony": true,
50864
+ "tstamp": 1723531289.9185
50865
  }
50866
  ]
arena_elo/results/latest/elo_results_image_editing.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b54d460d93f22ee6e2519ccc82e4ebd64ec81987505760c428b593ff91a13368
3
- size 62455
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1da1e19486e987e18cf9bec79c36f1b71291a4f92490cf7d3af4edbc98628510
3
+ size 62482
arena_elo/results/latest/elo_results_t2i_generation.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ca369e35289b5734e13d1ea2cd01f55bdfb7c861578ee9c09fda83ba81654885
3
  size 73808
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:894b421ff17c034ec61f976ce4d3723d955afaacfb7e940eb7969a3cef2fe16f
3
  size 73808
arena_elo/results/latest/image_editing_leaderboard.csv CHANGED
@@ -2,7 +2,7 @@ key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,
2
  MagicBrush,MagicBrush,1112.4518849527376,1116.3228088792275,CC-BY-4.0,"The Ohio State University, University of Waterloo",https://osu-nlp-group.github.io/MagicBrush
3
  InfEdit,InfEdit,1077.2249767545911,1077.0861206067664,CC BY-NC-ND 4.0,"University of Michigan, University of California, Berkeley",https://huggingface.co/spaces/sled-umich/InfEdit
4
  CosXLEdit,CosXLEdit,1064.682441262532,1065.599445502775,cosxl-nc-community,Stability AI,https://huggingface.co/spaces/multimodalart/cosxl
5
- InstructPix2Pix,InstructPix2Pix,1035.4054226880567,1033.2086681336118,"Copyright 2023 Timothy Brooks, Aleksander Holynski, Alexei A. Efros","University of California, Berkeley",https://www.timothybrooks.com/instruct-pix2pix
6
  PNP,PNP,1001.4916130267786,1006.0747389504991,-,Weizmann Institute of Science,https://github.com/MichalGeyer/plug-and-play
7
  Prompt2prompt,Prompt2prompt,990.9755779591587,992.0796321838297,Apache-2.0,"Google, Tel Aviv University",https://prompt-to-prompt.github.io
8
  CycleDiffusion,CycleDiffusion,938.5637450408492,931.6722574678079,X11,Carnegie Mellon University,https://github.com/ChenWu98/cycle-diffusion
 
2
  MagicBrush,MagicBrush,1112.4518849527376,1116.3228088792275,CC-BY-4.0,"The Ohio State University, University of Waterloo",https://osu-nlp-group.github.io/MagicBrush
3
  InfEdit,InfEdit,1077.2249767545911,1077.0861206067664,CC BY-NC-ND 4.0,"University of Michigan, University of California, Berkeley",https://huggingface.co/spaces/sled-umich/InfEdit
4
  CosXLEdit,CosXLEdit,1064.682441262532,1065.599445502775,cosxl-nc-community,Stability AI,https://huggingface.co/spaces/multimodalart/cosxl
5
+ InstructPix2Pix,InstructPix2Pix,1035.4054226880567,1033.208668133612,"Copyright 2023 Timothy Brooks, Aleksander Holynski, Alexei A. Efros","University of California, Berkeley",https://www.timothybrooks.com/instruct-pix2pix
6
  PNP,PNP,1001.4916130267786,1006.0747389504991,-,Weizmann Institute of Science,https://github.com/MichalGeyer/plug-and-play
7
  Prompt2prompt,Prompt2prompt,990.9755779591587,992.0796321838297,Apache-2.0,"Google, Tel Aviv University",https://prompt-to-prompt.github.io
8
  CycleDiffusion,CycleDiffusion,938.5637450408492,931.6722574678079,X11,Carnegie Mellon University,https://github.com/ChenWu98/cycle-diffusion
arena_elo/results/latest/t2i_generation_leaderboard.csv CHANGED
@@ -1,14 +1,14 @@
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
- PlayGround V2.5,PlayGround V2.5,1149.4241788209033,1151.6962327432175,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
3
- PlayGround V2,PlayGround V2,1091.8871690584383,1091.070914111409,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
4
- HunyuanDiT,HunyuanDiT,1062.6797650755611,1047.7275198373045,tencent-hunyuan-community,Tencent,https://huggingface.co/Tencent-Hunyuan/HunyuanDiT
5
- StableCascade,StableCascade,1056.485271897239,1060.5033651115084,stable-cascade-nc-community (other),Stability AI,https://huggingface.co/stabilityai/stable-cascade
6
- SDXLLightning,SDXLLightning,1041.7335191346344,1046.8597076423962,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
7
- PixArtAlpha,PixArtAlpha,1040.1951767245846,1030.7898666622996,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
8
- PixArtSigma,PixArtSigma,1039.3457974285293,1039.6435421689853,openrail++,PixArt-alpha,https://fal.ai/models/fal-ai/pixart-sigma
9
- SD3,SD3,1023.1976950252729,1016.6535094249977,stabilityai-nc-research-community,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-3-medium
10
- SDXL,SDXL,986.4637648660859,986.9171901253504,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
11
- SDXLTurbo,SDXLTurbo,928.9989976656441,927.1259886217293,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
12
- LCM(v1.5/XL),LCM(v1.5/XL),924.5851787283315,918.6127375934319,openrail++,Latent Consistency,https://fal.ai/models/fal-ai/fast-lcm-diffusion/api
13
- OpenJourney,OpenJourney,846.7588501200388,841.6620180754599,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
14
- LCM,LCM,808.2446354547363,822.2832631079027,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
 
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ PlayGround V2.5,PlayGround V2.5,1150.7499504793323,1152.7978802461676,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
3
+ PlayGround V2,PlayGround V2,1092.3480876880844,1091.4337824871766,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
4
+ HunyuanDiT,HunyuanDiT,1060.6873964481285,1045.9410086686644,tencent-hunyuan-community,Tencent,https://huggingface.co/Tencent-Hunyuan/HunyuanDiT
5
+ StableCascade,StableCascade,1056.3562779615977,1060.3758908816894,stable-cascade-nc-community (other),Stability AI,https://huggingface.co/stabilityai/stable-cascade
6
+ SDXLLightning,SDXLLightning,1042.034415021577,1047.0881390453108,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
7
+ PixArtAlpha,PixArtAlpha,1040.36338481613,1030.9701625079067,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
8
+ PixArtSigma,PixArtSigma,1038.8231055672843,1039.053677673613,openrail++,PixArt-alpha,https://fal.ai/models/fal-ai/pixart-sigma
9
+ SD3,SD3,1020.87196084551,1014.8093007374721,stabilityai-nc-research-community,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-3-medium
10
+ SDXL,SDXL,986.6245892228262,987.0772066294832,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
11
+ SDXLTurbo,SDXLTurbo,930.0223715992644,927.9777399457049,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
12
+ LCM(v1.5/XL),LCM(v1.5/XL),924.9150421473538,918.899224709552,openrail++,Latent Consistency,https://fal.ai/models/fal-ai/fast-lcm-diffusion/api
13
+ OpenJourney,OpenJourney,847.4428420514181,842.2406737877131,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
14
+ LCM,LCM,808.7605761514947,822.71297437185,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7