Model Comparison Leaderboard
Category
Bytedance
Seedream 5.0 Pro
OpenAI
GPT Image 2
Bytedance
Seedream 4.0
Bytedance
Seedream 4.5
Google
Imagen 4.0 Ultra
Ideogram
Ideogram 3.0 (Quality)
Google
Imagen 3.0
Reve
Reve 2.1
Ideogram
Ideogram 4.0 (Quality)
Google
Nano Banana 2
Black Forest Labs
Flux 1.1 Pro Ultra
Recraft
Recraft V3
Google
Nano Banana 2 Lite
Alibaba
Z-Image Turbo
OpenAI
GPT Image 1.5
Google
Nano Banana (2.5 Flash)
Google
Nano Banana Pro
XAI
Grok Imagine
OpenAI
DALL-E 3
Black Forest Labs
FLUX.2 Max
Ideogram
Ideogram V2
XAI
Grok Imagine (Quality)
OpenAI
ChatGPT 4o
Midjourney
Midjourney V6.1
Recraft
Recraft V4.1
Black Forest Labs
Flux 2 Pro
Minimax
MiniMax Image-01
Midjourney
Midjourney v7
Black Forest Labs
FLUX.1 Kontext Max
Bytedance
Seedream 3.0
Reve
Reve Image (Halfmoon)
Krea
Krea 2 Large
XAI
Grok 2 Image
Technical Quality
(100 examples)
1 Avg: 8.77 / 10
Refusals: 13
2 Avg: 8.64 / 10
Refusals: 12
3 Avg: 8.62 / 10
Avg: 8.60 / 10
Avg: 8.54 / 10
Avg: 8.51 / 10
Avg: 8.48 / 10
Refusals: 3
Avg: 8.47 / 10
Avg: 8.41 / 10
Avg: 8.40 / 10
Avg: 8.36 / 10
Refusals: 1
Avg: 8.36 / 10
Avg: 8.35 / 10
Refusals: 1
Avg: 8.34 / 10
Avg: 8.26 / 10
Refusals: 11
Avg: 8.18 / 10
Avg: 8.05 / 10
Avg: 8.04 / 10
Avg: 8.01 / 10
Avg: 8.00 / 10
Refusals: 10
Avg: 7.93 / 10
Avg: 7.87 / 10
Refusals: 2
Avg: 7.81 / 10
Refusals: 11
Avg: 7.80 / 10
Refusals: 2
Avg: 7.67 / 10
Avg: 7.66 / 10
Refusals: 1
Avg: 7.53 / 10
Avg: 7.47 / 10
Refusals: 2
Avg: 7.37 / 10
Refusals: 6
Avg: 7.36 / 10
Avg: 7.34 / 10
Avg: 6.86 / 10
Avg: 6.75 / 10
Refusals: 1
(10 examples)
Avg Score: 8.00
Avg Score: 8.00
2 9.00 / 10
Refusals: 3
3 8.86 / 10
Refusals: 3
1 9.10 / 10
2 9.00 / 10
8.70 / 10
8.50 / 10
8.30 / 10
8.60 / 10
7.90 / 10
8.30 / 10
8.10 / 10
7.50 / 10
8.67 / 10
Refusals: 1
8.60 / 10
8.25 / 10
Refusals: 2
8.10 / 10
7.80 / 10
8.60 / 10
8.60 / 10
8.00 / 10
Refusals: 3
7.40 / 10
7.67 / 10
Refusals: 1
7.50 / 10
Refusals: 2
8.00 / 10
7.50 / 10
7.60 / 10
8.00 / 10
6.80 / 10
7.50 / 10
7.60 / 10
7.40 / 10
6.50 / 10
6.60 / 10
(10 examples)
Avg Score: 8.02
Avg Score: 8.02
1 9.00 / 10
Refusals: 1
3 8.80 / 10
1 9.00 / 10
2 8.90 / 10
3 8.80 / 10
8.50 / 10
8.50 / 10
8.50 / 10
8.60 / 10
8.40 / 10
8.40 / 10
8.50 / 10
8.10 / 10
8.40 / 10
8.40 / 10
7.90 / 10
8.00 / 10
7.60 / 10
8.10 / 10
7.90 / 10
8.20 / 10
7.90 / 10
7.86 / 10
Refusals: 3
7.70 / 10
7.50 / 10
7.70 / 10
7.60 / 10
7.10 / 10
6.90 / 10
7.10 / 10
7.50 / 10
7.00 / 10
6.50 / 10
(10 examples)
Avg Score: 7.89
Avg Score: 7.89
1 8.89 / 10
Refusals: 1
3 8.40 / 10
8.30 / 10
3 8.40 / 10
3 8.40 / 10
8.30 / 10
8.25 / 10
Refusals: 2
2 8.70 / 10
2 8.70 / 10
7.90 / 10
8.00 / 10
Refusals: 1
7.90 / 10
8.30 / 10
8.30 / 10
8.22 / 10
Refusals: 1
8.20 / 10
7.90 / 10
7.40 / 10
7.90 / 10
8.10 / 10
8.10 / 10
7.60 / 10
7.00 / 10
Refusals: 1
8.00 / 10
7.90 / 10
7.33 / 10
Refusals: 1
7.50 / 10
7.10 / 10
7.78 / 10
Refusals: 1
7.20 / 10
7.50 / 10
6.60 / 10
6.22 / 10
Refusals: 1
(10 examples)
Avg Score: 7.91
Avg Score: 7.91
1 9.00 / 10
Refusals: 3
1 9.00 / 10
Refusals: 9
8.20 / 10
8.20 / 10
8.40 / 10
8.00 / 10
2 8.70 / 10
8.50 / 10
3 8.60 / 10
7.90 / 10
8.00 / 10
8.10 / 10
8.20 / 10
8.30 / 10
8.00 / 10
Refusals: 7
8.30 / 10
7.90 / 10
8.30 / 10
8.00 / 10
8.00 / 10
Refusals: 5
6.20 / 10
8.00 / 10
7.57 / 10
Refusals: 3
7.75 / 10
Refusals: 2
7.40 / 10
7.80 / 10
7.70 / 10
7.75 / 10
Refusals: 2
7.38 / 10
Refusals: 2
8.30 / 10
7.60 / 10
6.50 / 10
6.70 / 10
(10 examples)
Avg Score: 7.98
Avg Score: 7.98
8.20 / 10
8.40 / 10
3 9.00 / 10
8.80 / 10
1 9.20 / 10
3 9.00 / 10
8.80 / 10
7.20 / 10
7.70 / 10
8.70 / 10
8.40 / 10
2 9.10 / 10
8.50 / 10
8.30 / 10
7.40 / 10
8.10 / 10
7.80 / 10
8.10 / 10
8.60 / 10
7.80 / 10
8.10 / 10
8.20 / 10
8.40 / 10
8.10 / 10
7.50 / 10
7.40 / 10
6.90 / 10
7.20 / 10
7.20 / 10
6.80 / 10
7.50 / 10
6.40 / 10
6.40 / 10
(10 examples)
Avg Score: 8.05
Avg Score: 8.05
8.40 / 10
3 8.50 / 10
8.30 / 10
8.10 / 10
8.00 / 10
1 8.60 / 10
8.30 / 10
8.40 / 10
1 8.60 / 10
3 8.50 / 10
1 8.60 / 10
8.20 / 10
8.30 / 10
8.10 / 10
2 8.56 / 10
Refusals: 1
8.40 / 10
3 8.50 / 10
8.30 / 10
7.30 / 10
8.20 / 10
8.30 / 10
7.60 / 10
7.60 / 10
7.40 / 10
8.30 / 10
8.00 / 10
7.60 / 10
8.30 / 10
7.60 / 10
7.30 / 10
7.50 / 10
7.20 / 10
6.90 / 10
(10 examples)
Avg Score: 8.30
Avg Score: 8.30
2 9.00 / 10
8.70 / 10
8.50 / 10
3 8.80 / 10
3 8.80 / 10
8.60 / 10
2 9.00 / 10
Refusals: 1
3 8.80 / 10
8.70 / 10
8.60 / 10
8.50 / 10
1 9.20 / 10
8.40 / 10
8.70 / 10
8.70 / 10
8.40 / 10
8.20 / 10
8.10 / 10
7.60 / 10
8.10 / 10
8.70 / 10
8.20 / 10
8.44 / 10
Refusals: 1
8.20 / 10
7.70 / 10
7.80 / 10
7.60 / 10
8.10 / 10
7.80 / 10
7.80 / 10
7.30 / 10
7.30 / 10
7.80 / 10
(10 examples)
Avg Score: 8.02
Avg Score: 8.02
1 8.88 / 10
Refusals: 2
2 8.80 / 10
3 8.70 / 10
3 8.70 / 10
8.00 / 10
8.50 / 10
8.10 / 10
8.50 / 10
7.90 / 10
8.50 / 10
3 8.70 / 10
8.30 / 10
8.50 / 10
7.80 / 10
8.50 / 10
8.30 / 10
8.10 / 10
8.00 / 10
3 8.70 / 10
8.10 / 10
7.70 / 10
7.60 / 10
7.60 / 10
8.00 / 10
7.80 / 10
7.80 / 10
7.80 / 10
7.70 / 10
7.20 / 10
7.60 / 10
7.00 / 10
6.60 / 10
6.70 / 10
(10 examples)
Avg Score: 8.13
Avg Score: 8.13
3 8.89 / 10
Refusals: 1
2 8.90 / 10
8.60 / 10
2 8.90 / 10
1 9.00 / 10
8.70 / 10
8.50 / 10
8.80 / 10
8.70 / 10
8.70 / 10
8.70 / 10
8.70 / 10
8.30 / 10
8.80 / 10
8.20 / 10
8.60 / 10
8.10 / 10
8.10 / 10
7.60 / 10
7.90 / 10
8.80 / 10
7.90 / 10
8.20 / 10
7.50 / 10
7.50 / 10
7.90 / 10
7.50 / 10
7.10 / 10
6.80 / 10
6.80 / 10
7.30 / 10
7.50 / 10
6.80 / 10
(10 examples)
Avg Score: 7.89
Avg Score: 7.89
2 8.62 / 10
Refusals: 2
8.40 / 10
3 8.50 / 10
8.20 / 10
8.10 / 10
8.40 / 10
8.40 / 10
1 8.70 / 10
1 8.70 / 10
3 8.50 / 10
8.20 / 10
8.10 / 10
8.30 / 10
8.10 / 10
8.20 / 10
7.50 / 10
8.20 / 10
7.90 / 10
7.70 / 10
7.88 / 10
Refusals: 2
7.80 / 10
8.00 / 10
Refusals: 1
7.78 / 10
Refusals: 1
7.30 / 10
7.60 / 10
7.20 / 10
7.10 / 10
7.60 / 10
7.71 / 10
Refusals: 3
7.10 / 10
6.80 / 10
7.00 / 10
6.80 / 10