Spaces:
Running
on
Zero
Running
on
Zero
DongfuJiang
commited on
Commit
•
0334436
1
Parent(s):
9c6f6e0
Auto Daily Leaderboard udpate Thu Aug 8 12:00:24 PM EDT 2024
Browse files- arena_elo/results/20240808/clean_battle_t2i_generation.json +0 -0
- arena_elo/results/20240808/clean_battle_video_generation.json +0 -0
- arena_elo/results/20240808/elo_results_t2i_generation.pkl +3 -0
- arena_elo/results/20240808/elo_results_video_generation.pkl +3 -0
- arena_elo/results/20240808/t2i_generation_leaderboard.csv +18 -0
- arena_elo/results/20240808/video_generation_leaderboard.csv +9 -0
- arena_elo/results/latest/clean_battle_t2i_generation.json +136 -0
- arena_elo/results/latest/clean_battle_video_generation.json +168 -0
- arena_elo/results/latest/elo_results_t2i_generation.pkl +2 -2
- arena_elo/results/latest/elo_results_video_generation.pkl +1 -1
- arena_elo/results/latest/t2i_generation_leaderboard.csv +17 -13
- arena_elo/results/latest/video_generation_leaderboard.csv +8 -8
arena_elo/results/20240808/clean_battle_t2i_generation.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|
arena_elo/results/20240808/clean_battle_video_generation.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|
arena_elo/results/20240808/elo_results_t2i_generation.pkl
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:6a0bc5842a13e68e43e47f8713a71a952307787344205b60f952aefc58f7b7dc
|
3 |
+
size 85772
|
arena_elo/results/20240808/elo_results_video_generation.pkl
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d98fbb5aeb3fe840503cda7c42ef15340fed25eb4e65bb04e2985850fb6cf5ba
|
3 |
+
size 59905
|
arena_elo/results/20240808/t2i_generation_leaderboard.csv
ADDED
@@ -0,0 +1,18 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
+
FluxTimestep,FluxTimestep,1214.8405410597163,1268.8081253338864,N/A,N/A,N/A
|
3 |
+
FluxGuidance,FluxGuidance,1171.9302438783548,1280.7274155318826,N/A,N/A,N/A
|
4 |
+
PlayGround V2.5,PlayGround V2.5,1139.5104041681875,1093.8755129403712,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
|
5 |
+
PlayGround V2,PlayGround V2,1080.267768035212,1031.711789812054,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
|
6 |
+
HunyuanDiT,HunyuanDiT,1057.3948978511037,993.5300592549087,tencent-hunyuan-community,Tencent,https://huggingface.co/Tencent-Hunyuan/HunyuanDiT
|
7 |
+
StableCascade,StableCascade,1043.5554301408906,1000.1825546307998,stable-cascade-nc-community (other),Stability AI,https://huggingface.co/stabilityai/stable-cascade
|
8 |
+
AuraFlow,AuraFlow,1043.0774152314,905.4155674173782,N/A,N/A,N/A
|
9 |
+
SDXLLightning,SDXLLightning,1030.176037263112,987.7949247755674,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
|
10 |
+
PixArtAlpha,PixArtAlpha,1028.2881123547797,971.2154365327415,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
|
11 |
+
PixArtSigma,PixArtSigma,1026.6892332008106,979.1841654725179,openrail++,PixArt-alpha,https://fal.ai/models/fal-ai/pixart-sigma
|
12 |
+
SD3,SD3,1011.7515067036493,956.7215604444668,stabilityai-nc-research-community,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-3-medium
|
13 |
+
SDXL,SDXL,974.0626501167529,926.9049335091465,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
|
14 |
+
SDXLTurbo,SDXLTurbo,917.1250431688785,867.9511006927216,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
|
15 |
+
LCM(v1.5/XL),LCM(v1.5/XL),912.4100279149377,859.7939054983376,openrail++,Latent Consistency,https://fal.ai/models/fal-ai/fast-lcm-diffusion/api
|
16 |
+
OpenJourney,OpenJourney,835.7176337894391,782.8288973266096,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
|
17 |
+
LCM,LCM,796.5741829165427,762.9098656374077,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
|
18 |
+
Kolors,Kolors,716.6288722062632,792.3328249865597,N/A,N/A,N/A
|
arena_elo/results/20240808/video_generation_leaderboard.csv
ADDED
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
+
StableVideoDiffusion,StableVideoDiffusion,1122.5421604812714,1125.3759897751343,stable-video-diffusion-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
|
3 |
+
T2VTurbo,T2VTurbo,1107.5392325426644,1105.6533826949078,cc-by-nc-4.0,"University of California, Santa Barbara",https://huggingface.co/jiachenli-ucsb/T2V-Turbo-VC2
|
4 |
+
VideoCrafter2,VideoCrafter2,1073.6162738533299,1073.9455187261779,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
|
5 |
+
AnimateDiff,AnimateDiff,1070.4414319031353,1068.8927922630937,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
|
6 |
+
LaVie,LaVie,993.6187329366976,992.6992059767628,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
|
7 |
+
OpenSora,OpenSora,912.7003595870469,912.4654178293881,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
8 |
+
ModelScope,ModelScope,865.3308025978378,866.5856670330255,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
|
9 |
+
AnimateDiffTurbo,AnimateDiffTurbo,854.2110060980162,854.3820257015113,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
|
arena_elo/results/latest/clean_battle_t2i_generation.json
CHANGED
@@ -49846,5 +49846,141 @@
|
|
49846 |
"judge": "arena_user_10.16.43.250",
|
49847 |
"anony": true,
|
49848 |
"tstamp": 1723054634.5468
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
49849 |
}
|
49850 |
]
|
|
|
49846 |
"judge": "arena_user_10.16.43.250",
|
49847 |
"anony": true,
|
49848 |
"tstamp": 1723054634.5468
|
49849 |
+
},
|
49850 |
+
{
|
49851 |
+
"model_a": "FluxGuidance",
|
49852 |
+
"model_b": "FluxTimestep",
|
49853 |
+
"winner": "model_b",
|
49854 |
+
"judge": "arena_user_10.16.12.147",
|
49855 |
+
"anony": true,
|
49856 |
+
"tstamp": 1723060554.0993
|
49857 |
+
},
|
49858 |
+
{
|
49859 |
+
"model_a": "StableCascade",
|
49860 |
+
"model_b": "SDXLLightning",
|
49861 |
+
"winner": "model_b",
|
49862 |
+
"judge": "arena_user_10.16.12.147",
|
49863 |
+
"anony": true,
|
49864 |
+
"tstamp": 1723060717.4346
|
49865 |
+
},
|
49866 |
+
{
|
49867 |
+
"model_a": "AuraFlow",
|
49868 |
+
"model_b": "OpenJourney",
|
49869 |
+
"winner": "tie (bothbad)",
|
49870 |
+
"judge": "arena_user_10.16.12.147",
|
49871 |
+
"anony": true,
|
49872 |
+
"tstamp": 1723061132.7536
|
49873 |
+
},
|
49874 |
+
{
|
49875 |
+
"model_a": "SDXLTurbo",
|
49876 |
+
"model_b": "StableCascade",
|
49877 |
+
"winner": "model_b",
|
49878 |
+
"judge": "arena_user_10.16.43.145",
|
49879 |
+
"anony": true,
|
49880 |
+
"tstamp": 1723063074.7642
|
49881 |
+
},
|
49882 |
+
{
|
49883 |
+
"model_a": "FluxTimestep",
|
49884 |
+
"model_b": "FluxGuidance",
|
49885 |
+
"winner": "model_b",
|
49886 |
+
"judge": "arena_user_10.16.14.231",
|
49887 |
+
"anony": true,
|
49888 |
+
"tstamp": 1723065466.5186
|
49889 |
+
},
|
49890 |
+
{
|
49891 |
+
"model_a": "OpenJourney",
|
49892 |
+
"model_b": "PlayGround V2.5",
|
49893 |
+
"winner": "model_b",
|
49894 |
+
"judge": "arena_user_10.16.43.145",
|
49895 |
+
"anony": true,
|
49896 |
+
"tstamp": 1723065687.0972
|
49897 |
+
},
|
49898 |
+
{
|
49899 |
+
"model_a": "AuraFlow",
|
49900 |
+
"model_b": "FluxGuidance",
|
49901 |
+
"winner": "model_b",
|
49902 |
+
"judge": "arena_user_10.16.31.28",
|
49903 |
+
"anony": false,
|
49904 |
+
"tstamp": 1723067240.2924
|
49905 |
+
},
|
49906 |
+
{
|
49907 |
+
"model_a": "FluxTimestep",
|
49908 |
+
"model_b": "SDXLLightning",
|
49909 |
+
"winner": "model_a",
|
49910 |
+
"judge": "arena_user_10.16.43.145",
|
49911 |
+
"anony": true,
|
49912 |
+
"tstamp": 1723078081.7925
|
49913 |
+
},
|
49914 |
+
{
|
49915 |
+
"model_a": "StableCascade",
|
49916 |
+
"model_b": "PixArtAlpha",
|
49917 |
+
"winner": "model_a",
|
49918 |
+
"judge": "arena_user_10.16.31.28",
|
49919 |
+
"anony": true,
|
49920 |
+
"tstamp": 1723078808.7741
|
49921 |
+
},
|
49922 |
+
{
|
49923 |
+
"model_a": "FluxTimestep",
|
49924 |
+
"model_b": "FluxGuidance",
|
49925 |
+
"winner": "tie (bothbad)",
|
49926 |
+
"judge": "arena_user_10.16.31.28",
|
49927 |
+
"anony": false,
|
49928 |
+
"tstamp": 1723080943.3647
|
49929 |
+
},
|
49930 |
+
{
|
49931 |
+
"model_a": "FluxTimestep",
|
49932 |
+
"model_b": "FluxGuidance",
|
49933 |
+
"winner": "tie (bothbad)",
|
49934 |
+
"judge": "arena_user_10.16.12.147",
|
49935 |
+
"anony": false,
|
49936 |
+
"tstamp": 1723080993.6338
|
49937 |
+
},
|
49938 |
+
{
|
49939 |
+
"model_a": "SDXL",
|
49940 |
+
"model_b": "Kolors",
|
49941 |
+
"winner": "tie (bothbad)",
|
49942 |
+
"judge": "arena_user_10.16.14.231",
|
49943 |
+
"anony": false,
|
49944 |
+
"tstamp": 1723081072.3311
|
49945 |
+
},
|
49946 |
+
{
|
49947 |
+
"model_a": "PixArtAlpha",
|
49948 |
+
"model_b": "StableCascade",
|
49949 |
+
"winner": "tie (bothbad)",
|
49950 |
+
"judge": "arena_user_10.16.43.145",
|
49951 |
+
"anony": true,
|
49952 |
+
"tstamp": 1723083880.361
|
49953 |
+
},
|
49954 |
+
{
|
49955 |
+
"model_a": "OpenJourney",
|
49956 |
+
"model_b": "StableCascade",
|
49957 |
+
"winner": "tie (bothbad)",
|
49958 |
+
"judge": "arena_user_10.16.12.147",
|
49959 |
+
"anony": true,
|
49960 |
+
"tstamp": 1723087396.3849
|
49961 |
+
},
|
49962 |
+
{
|
49963 |
+
"model_a": "SD3",
|
49964 |
+
"model_b": "PlayGround V2.5",
|
49965 |
+
"winner": "model_b",
|
49966 |
+
"judge": "arena_user_10.16.43.145",
|
49967 |
+
"anony": true,
|
49968 |
+
"tstamp": 1723105557.4317
|
49969 |
+
},
|
49970 |
+
{
|
49971 |
+
"model_a": "AuraFlow",
|
49972 |
+
"model_b": "OpenJourney",
|
49973 |
+
"winner": "model_a",
|
49974 |
+
"judge": "arena_user_10.16.43.250",
|
49975 |
+
"anony": true,
|
49976 |
+
"tstamp": 1723111987.6246
|
49977 |
+
},
|
49978 |
+
{
|
49979 |
+
"model_a": "HunyuanDiT",
|
49980 |
+
"model_b": "Kolors",
|
49981 |
+
"winner": "model_a",
|
49982 |
+
"judge": "arena_user_10.16.43.250",
|
49983 |
+
"anony": true,
|
49984 |
+
"tstamp": 1723115582.8888
|
49985 |
}
|
49986 |
]
|
arena_elo/results/latest/clean_battle_video_generation.json
CHANGED
@@ -13670,5 +13670,173 @@
|
|
13670 |
"judge": "arena_user_10.16.14.231",
|
13671 |
"anony": true,
|
13672 |
"tstamp": 1723055095.7108
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
13673 |
}
|
13674 |
]
|
|
|
13670 |
"judge": "arena_user_10.16.14.231",
|
13671 |
"anony": true,
|
13672 |
"tstamp": 1723055095.7108
|
13673 |
+
},
|
13674 |
+
{
|
13675 |
+
"model_a": "VideoCrafter2",
|
13676 |
+
"model_b": "OpenSora",
|
13677 |
+
"winner": "model_a",
|
13678 |
+
"judge": "arena_user_10.16.14.231",
|
13679 |
+
"anony": true,
|
13680 |
+
"tstamp": 1723105593.6628
|
13681 |
+
},
|
13682 |
+
{
|
13683 |
+
"model_a": "StableVideoDiffusion",
|
13684 |
+
"model_b": "AnimateDiffTurbo",
|
13685 |
+
"winner": "model_a",
|
13686 |
+
"judge": "arena_user_10.16.43.145",
|
13687 |
+
"anony": true,
|
13688 |
+
"tstamp": 1723105608.5526
|
13689 |
+
},
|
13690 |
+
{
|
13691 |
+
"model_a": "StableVideoDiffusion",
|
13692 |
+
"model_b": "ModelScope",
|
13693 |
+
"winner": "model_a",
|
13694 |
+
"judge": "arena_user_10.16.43.145",
|
13695 |
+
"anony": true,
|
13696 |
+
"tstamp": 1723105622.0646
|
13697 |
+
},
|
13698 |
+
{
|
13699 |
+
"model_a": "LaVie",
|
13700 |
+
"model_b": "OpenSora",
|
13701 |
+
"winner": "tie (bothbad)",
|
13702 |
+
"judge": "arena_user_10.16.43.250",
|
13703 |
+
"anony": true,
|
13704 |
+
"tstamp": 1723105638.7252
|
13705 |
+
},
|
13706 |
+
{
|
13707 |
+
"model_a": "VideoCrafter2",
|
13708 |
+
"model_b": "T2VTurbo",
|
13709 |
+
"winner": "model_b",
|
13710 |
+
"judge": "arena_user_10.16.43.250",
|
13711 |
+
"anony": true,
|
13712 |
+
"tstamp": 1723105654.0341
|
13713 |
+
},
|
13714 |
+
{
|
13715 |
+
"model_a": "OpenSora",
|
13716 |
+
"model_b": "AnimateDiff",
|
13717 |
+
"winner": "tie (bothbad)",
|
13718 |
+
"judge": "arena_user_10.16.43.145",
|
13719 |
+
"anony": true,
|
13720 |
+
"tstamp": 1723105692.3889
|
13721 |
+
},
|
13722 |
+
{
|
13723 |
+
"model_a": "VideoCrafter2",
|
13724 |
+
"model_b": "StableVideoDiffusion",
|
13725 |
+
"winner": "model_b",
|
13726 |
+
"judge": "arena_user_10.16.14.231",
|
13727 |
+
"anony": true,
|
13728 |
+
"tstamp": 1723105709.4927
|
13729 |
+
},
|
13730 |
+
{
|
13731 |
+
"model_a": "StableVideoDiffusion",
|
13732 |
+
"model_b": "LaVie",
|
13733 |
+
"winner": "model_b",
|
13734 |
+
"judge": "arena_user_10.16.12.147",
|
13735 |
+
"anony": true,
|
13736 |
+
"tstamp": 1723105725.4326
|
13737 |
+
},
|
13738 |
+
{
|
13739 |
+
"model_a": "LaVie",
|
13740 |
+
"model_b": "StableVideoDiffusion",
|
13741 |
+
"winner": "tie (bothbad)",
|
13742 |
+
"judge": "arena_user_10.16.12.147",
|
13743 |
+
"anony": true,
|
13744 |
+
"tstamp": 1723105745.4172
|
13745 |
+
},
|
13746 |
+
{
|
13747 |
+
"model_a": "VideoCrafter2",
|
13748 |
+
"model_b": "LaVie",
|
13749 |
+
"winner": "tie (bothbad)",
|
13750 |
+
"judge": "arena_user_10.16.43.250",
|
13751 |
+
"anony": true,
|
13752 |
+
"tstamp": 1723105765.8105
|
13753 |
+
},
|
13754 |
+
{
|
13755 |
+
"model_a": "OpenSora",
|
13756 |
+
"model_b": "ModelScope",
|
13757 |
+
"winner": "tie (bothbad)",
|
13758 |
+
"judge": "arena_user_10.16.43.250",
|
13759 |
+
"anony": true,
|
13760 |
+
"tstamp": 1723105773.9308
|
13761 |
+
},
|
13762 |
+
{
|
13763 |
+
"model_a": "LaVie",
|
13764 |
+
"model_b": "AnimateDiff",
|
13765 |
+
"winner": "model_b",
|
13766 |
+
"judge": "arena_user_10.16.14.231",
|
13767 |
+
"anony": true,
|
13768 |
+
"tstamp": 1723105789.1982
|
13769 |
+
},
|
13770 |
+
{
|
13771 |
+
"model_a": "AnimateDiffTurbo",
|
13772 |
+
"model_b": "OpenSora",
|
13773 |
+
"winner": "model_a",
|
13774 |
+
"judge": "arena_user_10.16.43.250",
|
13775 |
+
"anony": true,
|
13776 |
+
"tstamp": 1723105801.2517
|
13777 |
+
},
|
13778 |
+
{
|
13779 |
+
"model_a": "LaVie",
|
13780 |
+
"model_b": "AnimateDiff",
|
13781 |
+
"winner": "model_a",
|
13782 |
+
"judge": "arena_user_10.16.43.250",
|
13783 |
+
"anony": true,
|
13784 |
+
"tstamp": 1723105817.5575
|
13785 |
+
},
|
13786 |
+
{
|
13787 |
+
"model_a": "T2VTurbo",
|
13788 |
+
"model_b": "StableVideoDiffusion",
|
13789 |
+
"winner": "model_b",
|
13790 |
+
"judge": "arena_user_10.16.14.231",
|
13791 |
+
"anony": true,
|
13792 |
+
"tstamp": 1723105834.2554
|
13793 |
+
},
|
13794 |
+
{
|
13795 |
+
"model_a": "StableVideoDiffusion",
|
13796 |
+
"model_b": "OpenSora",
|
13797 |
+
"winner": "model_a",
|
13798 |
+
"judge": "arena_user_10.16.14.231",
|
13799 |
+
"anony": true,
|
13800 |
+
"tstamp": 1723105842.3919
|
13801 |
+
},
|
13802 |
+
{
|
13803 |
+
"model_a": "AnimateDiff",
|
13804 |
+
"model_b": "AnimateDiffTurbo",
|
13805 |
+
"winner": "model_a",
|
13806 |
+
"judge": "arena_user_10.16.14.231",
|
13807 |
+
"anony": true,
|
13808 |
+
"tstamp": 1723105854.6487
|
13809 |
+
},
|
13810 |
+
{
|
13811 |
+
"model_a": "AnimateDiffTurbo",
|
13812 |
+
"model_b": "AnimateDiff",
|
13813 |
+
"winner": "model_a",
|
13814 |
+
"judge": "arena_user_10.16.43.145",
|
13815 |
+
"anony": true,
|
13816 |
+
"tstamp": 1723105869.2839
|
13817 |
+
},
|
13818 |
+
{
|
13819 |
+
"model_a": "AnimateDiffTurbo",
|
13820 |
+
"model_b": "ModelScope",
|
13821 |
+
"winner": "model_a",
|
13822 |
+
"judge": "arena_user_10.16.12.147",
|
13823 |
+
"anony": true,
|
13824 |
+
"tstamp": 1723105878.339
|
13825 |
+
},
|
13826 |
+
{
|
13827 |
+
"model_a": "VideoCrafter2",
|
13828 |
+
"model_b": "ModelScope",
|
13829 |
+
"winner": "model_a",
|
13830 |
+
"judge": "arena_user_10.16.43.250",
|
13831 |
+
"anony": true,
|
13832 |
+
"tstamp": 1723105887.5779
|
13833 |
+
},
|
13834 |
+
{
|
13835 |
+
"model_a": "T2VTurbo",
|
13836 |
+
"model_b": "StableVideoDiffusion",
|
13837 |
+
"winner": "model_a",
|
13838 |
+
"judge": "arena_user_10.16.14.231",
|
13839 |
+
"anony": true,
|
13840 |
+
"tstamp": 1723105897.8683
|
13841 |
}
|
13842 |
]
|
arena_elo/results/latest/elo_results_t2i_generation.pkl
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:6a0bc5842a13e68e43e47f8713a71a952307787344205b60f952aefc58f7b7dc
|
3 |
+
size 85772
|
arena_elo/results/latest/elo_results_video_generation.pkl
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 59905
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d98fbb5aeb3fe840503cda7c42ef15340fed25eb4e65bb04e2985850fb6cf5ba
|
3 |
size 59905
|
arena_elo/results/latest/t2i_generation_leaderboard.csv
CHANGED
@@ -1,14 +1,18 @@
|
|
1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
-
|
3 |
-
|
4 |
-
|
5 |
-
|
6 |
-
|
7 |
-
|
8 |
-
|
9 |
-
|
10 |
-
|
11 |
-
|
12 |
-
|
13 |
-
|
14 |
-
|
|
|
|
|
|
|
|
|
|
1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
+
FluxTimestep,FluxTimestep,1214.8405410597163,1268.8081253338864,N/A,N/A,N/A
|
3 |
+
FluxGuidance,FluxGuidance,1171.9302438783548,1280.7274155318826,N/A,N/A,N/A
|
4 |
+
PlayGround V2.5,PlayGround V2.5,1139.5104041681875,1093.8755129403712,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
|
5 |
+
PlayGround V2,PlayGround V2,1080.267768035212,1031.711789812054,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
|
6 |
+
HunyuanDiT,HunyuanDiT,1057.3948978511037,993.5300592549087,tencent-hunyuan-community,Tencent,https://huggingface.co/Tencent-Hunyuan/HunyuanDiT
|
7 |
+
StableCascade,StableCascade,1043.5554301408906,1000.1825546307998,stable-cascade-nc-community (other),Stability AI,https://huggingface.co/stabilityai/stable-cascade
|
8 |
+
AuraFlow,AuraFlow,1043.0774152314,905.4155674173782,N/A,N/A,N/A
|
9 |
+
SDXLLightning,SDXLLightning,1030.176037263112,987.7949247755674,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
|
10 |
+
PixArtAlpha,PixArtAlpha,1028.2881123547797,971.2154365327415,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
|
11 |
+
PixArtSigma,PixArtSigma,1026.6892332008106,979.1841654725179,openrail++,PixArt-alpha,https://fal.ai/models/fal-ai/pixart-sigma
|
12 |
+
SD3,SD3,1011.7515067036493,956.7215604444668,stabilityai-nc-research-community,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-3-medium
|
13 |
+
SDXL,SDXL,974.0626501167529,926.9049335091465,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
|
14 |
+
SDXLTurbo,SDXLTurbo,917.1250431688785,867.9511006927216,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
|
15 |
+
LCM(v1.5/XL),LCM(v1.5/XL),912.4100279149377,859.7939054983376,openrail++,Latent Consistency,https://fal.ai/models/fal-ai/fast-lcm-diffusion/api
|
16 |
+
OpenJourney,OpenJourney,835.7176337894391,782.8288973266096,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
|
17 |
+
LCM,LCM,796.5741829165427,762.9098656374077,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
|
18 |
+
Kolors,Kolors,716.6288722062632,792.3328249865597,N/A,N/A,N/A
|
arena_elo/results/latest/video_generation_leaderboard.csv
CHANGED
@@ -1,9 +1,9 @@
|
|
1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
-
StableVideoDiffusion,StableVideoDiffusion,1122.
|
3 |
-
T2VTurbo,T2VTurbo,
|
4 |
-
VideoCrafter2,VideoCrafter2,
|
5 |
-
AnimateDiff,AnimateDiff,
|
6 |
-
LaVie,LaVie,
|
7 |
-
OpenSora,OpenSora,
|
8 |
-
ModelScope,ModelScope,
|
9 |
-
AnimateDiffTurbo,AnimateDiffTurbo,
|
|
|
1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
+
StableVideoDiffusion,StableVideoDiffusion,1122.5421604812714,1125.3759897751343,stable-video-diffusion-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
|
3 |
+
T2VTurbo,T2VTurbo,1107.5392325426644,1105.6533826949078,cc-by-nc-4.0,"University of California, Santa Barbara",https://huggingface.co/jiachenli-ucsb/T2V-Turbo-VC2
|
4 |
+
VideoCrafter2,VideoCrafter2,1073.6162738533299,1073.9455187261779,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
|
5 |
+
AnimateDiff,AnimateDiff,1070.4414319031353,1068.8927922630937,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
|
6 |
+
LaVie,LaVie,993.6187329366976,992.6992059767628,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
|
7 |
+
OpenSora,OpenSora,912.7003595870469,912.4654178293881,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
8 |
+
ModelScope,ModelScope,865.3308025978378,866.5856670330255,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
|
9 |
+
AnimateDiffTurbo,AnimateDiffTurbo,854.2110060980162,854.3820257015113,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
|