Hugging Face's logo

Spaces:
TIGER-Lab
/
GenAI-Arena
Running on Zero

App Files Community
16
DongfuJiang commited on
Commit
f836811
•
1 Parent(s): 0f1b793

Auto Daily Leaderboard udpate Wed Sep 4 12:00:25 PM EDT 2024

Browse files
Files changed (12) hide show
  1. arena_elo/results/20240903/clean_battle_image_editing.json +0 -0
  2. arena_elo/results/20240903/elo_results_image_editing.pkl +3 -0
  3. arena_elo/results/20240903/image_editing_leaderboard.csv +10 -0
  4. arena_elo/results/20240904/clean_battle_t2i_generation.json +0 -0
  5. arena_elo/results/20240904/elo_results_t2i_generation.pkl +3 -0
  6. arena_elo/results/20240904/t2i_generation_leaderboard.csv +18 -0
  7. arena_elo/results/latest/clean_battle_image_editing.json +16 -0
  8. arena_elo/results/latest/clean_battle_t2i_generation.json +42 -0
  9. arena_elo/results/latest/elo_results_image_editing.pkl +1 -1
  10. arena_elo/results/latest/elo_results_t2i_generation.pkl +1 -1
  11. arena_elo/results/latest/image_editing_leaderboard.csv +9 -9
  12. arena_elo/results/latest/t2i_generation_leaderboard.csv +17 -17
arena_elo/results/20240903/clean_battle_image_editing.json ADDED
The diff for this file is too large to render. See raw diff
 
arena_elo/results/20240903/elo_results_image_editing.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b0a523a425f0d7e077d4b86af28e3fcdf1ee03b01b52a8eaa6d50a00a6c2937b
3
+ size 63251
arena_elo/results/20240903/image_editing_leaderboard.csv ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ MagicBrush,MagicBrush,1112.451629851484,1116.320673405148,CC-BY-4.0,"The Ohio State University, University of Waterloo",https://osu-nlp-group.github.io/MagicBrush/
3
+ InfEdit,InfEdit,1077.2196234272722,1077.0822371040688,CC BY-NC-ND 4.0,"University of Michigan, University of California, Berkeley",https://sled-group.github.io/InfEdit/
4
+ CosXLEdit,CosXLEdit,1064.6854336640097,1065.6016015010896,cosxl-nc-community,Stability AI,https://huggingface.co/stabilityai/cosxl
5
+ InstructPix2Pix,InstructPix2Pix,1035.2768636543208,1033.1103556659373,"Copyright 2023 Timothy Brooks, Aleksander Holynski, Alexei A. Efros","University of California, Berkeley",https://www.timothybrooks.com/instruct-pix2pix
6
+ PNP,PNP,1001.6190325480716,1006.1742699515779,-,Weizmann Institute of Science,https://github.com/MichalGeyer/plug-and-play
7
+ Prompt2prompt,Prompt2prompt,990.9748205235168,992.0791260748806,Apache-2.0,"Google, Tel Aviv University",https://prompt-to-prompt.github.io/
8
+ CycleDiffusion,CycleDiffusion,938.5611614312506,931.6700985543164,X11,Carnegie Mellon University,https://github.com/ChenWu98/cycle-diffusion?tab=readme-ov-file
9
+ SDEdit,SDEdit,925.0471397536328,923.4128508663366,MIT License,Stanford University,https://sde-image-editing.github.io
10
+ Pix2PixZero,Pix2PixZero,854.1642951464414,854.5487868766448,MIT License,"Carnegie Mellon University, Adobe Research",https://pix2pixzero.github.io/
arena_elo/results/20240904/clean_battle_t2i_generation.json ADDED
The diff for this file is too large to render. See raw diff
 
arena_elo/results/20240904/elo_results_t2i_generation.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6f5bb979f45eb0ae59fe017d94b2997e7e7dac94940b962d6f43804aa68af27a
3
+ size 88247
arena_elo/results/20240904/t2i_generation_leaderboard.csv ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ FLUX.1-dev,FLUX.1-dev,1127.056690690184,1144.384770362048,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
3
+ PlayGround V2.5,PlayGround V2.5,1126.8978948671543,1127.6789102317803,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
4
+ FLUX.1-schnell,FLUX.1-schnell,1081.5249007818854,1077.7136001599947,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
5
+ PlayGround V2,PlayGround V2,1073.392853666852,1071.3873434280104,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
6
+ Kolors,Kolors,1055.7855282409528,1054.038276611031,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
7
+ HunyuanDiT,HunyuanDiT,1041.087011579528,1029.0129534708606,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
8
+ StableCascade,StableCascade,1038.3717277228197,1040.7307129675319,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
9
+ SDXL-Lightning,SDXL-Lightning,1024.2067908775314,1027.5354208566764,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
10
+ PixArtAlpha,PixArtAlpha,1022.7221749204762,1012.1917184874329,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
11
+ PixArtSigma,PixArtSigma,1019.3343849062732,1018.3435242772997,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
12
+ AuraFlow,AuraFlow,997.0689464603923,993.1697601837125,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
13
+ SD3,SD3,989.0854840230352,984.7893129237831,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
14
+ SDXL,SDXL,965.0396841090552,964.7769840150405,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
+ SDXLTurbo,SDXLTurbo,914.0178629978767,910.4700578112197,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
+ LCM(v1.5/XL),LCM(v1.5/XL),905.8873556665003,898.2952376625747,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
+ OpenJourney,OpenJourney,828.3564614824708,822.2322254793573,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
+ LCM,LCM,790.1642470070125,803.1580945475691,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
arena_elo/results/latest/clean_battle_image_editing.json CHANGED
@@ -18712,5 +18712,21 @@
18712
  "judge": "arena_user_10.16.36.191",
18713
  "anony": true,
18714
  "tstamp": 1723521907.3049
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
18715
  }
18716
  ]
 
18712
  "judge": "arena_user_10.16.36.191",
18713
  "anony": true,
18714
  "tstamp": 1723521907.3049
18715
+ },
18716
+ {
18717
+ "model_a_conv_id": "a347b71ec4a34733b5db2bf6650a6a06",
18718
+ "model_b_conv_id": "5c4e39857ef74b2893784f3e27f964f9",
18719
+ "inputs": {
18720
+ "source_prompt": "A table with a jar of cookies, cake, and green apples on it.",
18721
+ "target_prompt": "A table with cake and green apples on it.",
18722
+ "instruct_prompt": "Get rid of the jar of cookies"
18723
+ },
18724
+ "model_a": "PNP",
18725
+ "model_b": "InstructPix2Pix",
18726
+ "vote_type": "bothbad_vote",
18727
+ "winner": "tie (bothbad)",
18728
+ "judge": "arena_user_10.16.34.60",
18729
+ "anony": true,
18730
+ "tstamp": 1725426997.1156
18731
  }
18732
  ]
arena_elo/results/latest/clean_battle_t2i_generation.json CHANGED
@@ -96020,5 +96020,47 @@
96020
  "judge": "arena_user_10.16.10.147",
96021
  "anony": true,
96022
  "tstamp": 1725110531.2065
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
96023
  }
96024
  ]
 
96020
  "judge": "arena_user_10.16.10.147",
96021
  "anony": true,
96022
  "tstamp": 1725110531.2065
96023
+ },
96024
+ {
96025
+ "model_a_conv_id": "3db0bbe07dcb4deba659e946ac1f665b",
96026
+ "model_b_conv_id": "627fda06df9549068536140a525c9c55",
96027
+ "inputs": {
96028
+ "prompt": "Buildings on fire, old film still"
96029
+ },
96030
+ "model_a": "AuraFlow",
96031
+ "model_b": "PlayGround V2.5",
96032
+ "vote_type": "rightvote",
96033
+ "winner": "model_b",
96034
+ "judge": "arena_user_10.16.34.60",
96035
+ "anony": true,
96036
+ "tstamp": 1725429384.2356
96037
+ },
96038
+ {
96039
+ "model_a_conv_id": "fc351e19923e4c578b5e674d5c3e3a59",
96040
+ "model_b_conv_id": "52b443426d804c818e6dd5b1c0ce1113",
96041
+ "inputs": {
96042
+ "prompt": "image of a white wooden sphere floating in water"
96043
+ },
96044
+ "model_a": "FLUX.1-schnell",
96045
+ "model_b": "StableCascade",
96046
+ "vote_type": "bothbad_vote",
96047
+ "winner": "tie (bothbad)",
96048
+ "judge": "arena_user_10.16.10.147",
96049
+ "anony": true,
96050
+ "tstamp": 1725442575.744
96051
+ },
96052
+ {
96053
+ "model_a_conv_id": "3fdc2bd45fc6487b974910a3b3468e71",
96054
+ "model_b_conv_id": "3215c5dcd1b9419080c123ddf9ab4972",
96055
+ "inputs": {
96056
+ "prompt": "A cat wearing a hat"
96057
+ },
96058
+ "model_a": "AuraFlow",
96059
+ "model_b": "PixArtAlpha",
96060
+ "vote_type": "tievote",
96061
+ "winner": "tie",
96062
+ "judge": "arena_user_10.16.10.147",
96063
+ "anony": true,
96064
+ "tstamp": 1725450194.9049
96065
  }
96066
  ]
arena_elo/results/latest/elo_results_image_editing.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fe056dd818906f7d714c47fdba95fdcd01db8b8aa8490cfa0399cf2baab086e0
3
  size 63251
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b0a523a425f0d7e077d4b86af28e3fcdf1ee03b01b52a8eaa6d50a00a6c2937b
3
  size 63251
arena_elo/results/latest/elo_results_t2i_generation.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cdc3bb70f2d8b6e0d58062d295a143a298de19f25c82a3de6677591613a0a0f9
3
  size 88247
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6f5bb979f45eb0ae59fe017d94b2997e7e7dac94940b962d6f43804aa68af27a
3
  size 88247
arena_elo/results/latest/image_editing_leaderboard.csv CHANGED
@@ -1,10 +1,10 @@
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
- MagicBrush,MagicBrush,1112.4518849527376,1116.3228088792275,CC-BY-4.0,"The Ohio State University, University of Waterloo",https://osu-nlp-group.github.io/MagicBrush/
3
- InfEdit,InfEdit,1077.2249767545911,1077.0861206067664,CC BY-NC-ND 4.0,"University of Michigan, University of California, Berkeley",https://sled-group.github.io/InfEdit/
4
- CosXLEdit,CosXLEdit,1064.682441262532,1065.599445502775,cosxl-nc-community,Stability AI,https://huggingface.co/stabilityai/cosxl
5
- InstructPix2Pix,InstructPix2Pix,1035.4054226880567,1033.2086681336118,"Copyright 2023 Timothy Brooks, Aleksander Holynski, Alexei A. Efros","University of California, Berkeley",https://www.timothybrooks.com/instruct-pix2pix
6
- PNP,PNP,1001.4916130267786,1006.0747389504991,-,Weizmann Institute of Science,https://github.com/MichalGeyer/plug-and-play
7
- Prompt2prompt,Prompt2prompt,990.9755779591587,992.0796321838297,Apache-2.0,"Google, Tel Aviv University",https://prompt-to-prompt.github.io/
8
- CycleDiffusion,CycleDiffusion,938.5637450408492,931.6722574678079,X11,Carnegie Mellon University,https://github.com/ChenWu98/cycle-diffusion?tab=readme-ov-file
9
- SDEdit,SDEdit,925.0466906054369,923.4126211812364,MIT License,Stanford University,https://sde-image-editing.github.io
10
- Pix2PixZero,Pix2PixZero,854.1576477098594,854.5437070942457,MIT License,"Carnegie Mellon University, Adobe Research",https://pix2pixzero.github.io/
 
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ MagicBrush,MagicBrush,1112.451629851484,1116.320673405148,CC-BY-4.0,"The Ohio State University, University of Waterloo",https://osu-nlp-group.github.io/MagicBrush/
3
+ InfEdit,InfEdit,1077.2196234272722,1077.0822371040688,CC BY-NC-ND 4.0,"University of Michigan, University of California, Berkeley",https://sled-group.github.io/InfEdit/
4
+ CosXLEdit,CosXLEdit,1064.6854336640097,1065.6016015010896,cosxl-nc-community,Stability AI,https://huggingface.co/stabilityai/cosxl
5
+ InstructPix2Pix,InstructPix2Pix,1035.2768636543208,1033.1103556659373,"Copyright 2023 Timothy Brooks, Aleksander Holynski, Alexei A. Efros","University of California, Berkeley",https://www.timothybrooks.com/instruct-pix2pix
6
+ PNP,PNP,1001.6190325480716,1006.1742699515779,-,Weizmann Institute of Science,https://github.com/MichalGeyer/plug-and-play
7
+ Prompt2prompt,Prompt2prompt,990.9748205235168,992.0791260748806,Apache-2.0,"Google, Tel Aviv University",https://prompt-to-prompt.github.io/
8
+ CycleDiffusion,CycleDiffusion,938.5611614312506,931.6700985543164,X11,Carnegie Mellon University,https://github.com/ChenWu98/cycle-diffusion?tab=readme-ov-file
9
+ SDEdit,SDEdit,925.0471397536328,923.4128508663366,MIT License,Stanford University,https://sde-image-editing.github.io
10
+ Pix2PixZero,Pix2PixZero,854.1642951464414,854.5487868766448,MIT License,"Carnegie Mellon University, Adobe Research",https://pix2pixzero.github.io/
arena_elo/results/latest/t2i_generation_leaderboard.csv CHANGED
@@ -1,18 +1,18 @@
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
- PlayGround V2.5,PlayGround V2.5,1126.4356402369692,1127.2280727778502,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
3
- FLUX.1-dev,FLUX.1-dev,1126.2889728629602,1144.5258173564819,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
4
- FLUX.1-schnell,FLUX.1-schnell,1082.315343452611,1078.1045614326772,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
5
- PlayGround V2,PlayGround V2,1073.065415257294,1071.158341308344,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
6
- Kolors,Kolors,1055.966372856129,1054.0552465921062,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
7
- HunyuanDiT,HunyuanDiT,1041.1512031294556,1028.8915216109826,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
8
- StableCascade,StableCascade,1038.1504518109414,1040.4937227177566,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
9
- SDXL-Lightning,SDXL-Lightning,1024.019916918541,1027.3246985843055,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
10
- PixArtAlpha,PixArtAlpha,1022.651416137263,1011.9969746596573,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
11
- PixArtSigma,PixArtSigma,1019.2217886230037,1018.1613737417579,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
12
- AuraFlow,AuraFlow,999.3019843928246,995.4412513381933,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
13
- SD3,SD3,988.9076762817376,984.6841501247743,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
14
- SDXL,SDXL,964.7772008332179,964.5698415953276,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
- SDXLTurbo,SDXLTurbo,913.8451806991811,910.261383758,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
- LCM(v1.5/XL),LCM(v1.5/XL),905.6733341829878,898.0738137449478,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
- OpenJourney,OpenJourney,828.1762137420162,822.0289068622536,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
- LCM,LCM,790.0518885828609,802.9475233351188,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
 
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ FLUX.1-dev,FLUX.1-dev,1127.056690690184,1144.384770362048,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
3
+ PlayGround V2.5,PlayGround V2.5,1126.8978948671543,1127.6789102317803,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
4
+ FLUX.1-schnell,FLUX.1-schnell,1081.5249007818854,1077.7136001599947,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
5
+ PlayGround V2,PlayGround V2,1073.392853666852,1071.3873434280104,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
6
+ Kolors,Kolors,1055.7855282409528,1054.038276611031,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
7
+ HunyuanDiT,HunyuanDiT,1041.087011579528,1029.0129534708606,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
8
+ StableCascade,StableCascade,1038.3717277228197,1040.7307129675319,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
9
+ SDXL-Lightning,SDXL-Lightning,1024.2067908775314,1027.5354208566764,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
10
+ PixArtAlpha,PixArtAlpha,1022.7221749204762,1012.1917184874329,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
11
+ PixArtSigma,PixArtSigma,1019.3343849062732,1018.3435242772997,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
12
+ AuraFlow,AuraFlow,997.0689464603923,993.1697601837125,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
13
+ SD3,SD3,989.0854840230352,984.7893129237831,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
14
+ SDXL,SDXL,965.0396841090552,964.7769840150405,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
+ SDXLTurbo,SDXLTurbo,914.0178629978767,910.4700578112197,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
+ LCM(v1.5/XL),LCM(v1.5/XL),905.8873556665003,898.2952376625747,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
+ OpenJourney,OpenJourney,828.3564614824708,822.2322254793573,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
+ LCM,LCM,790.1642470070125,803.1580945475691,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7