Model Comparison Leaderboard
Category
Bytedance
Seedream 5.0 Pro
Google
Nano Banana 2
OpenAI
GPT Image 2
Google
Nano Banana 2 Lite
Reve
Reve 2.1
OpenAI
GPT Image 1.5
Google
Nano Banana (2.5 Flash)
Google
Nano Banana Pro
OpenAI
DALL-E 3
Bytedance
Seedream 4.0
Ideogram
Ideogram 4.0 (Quality)
XAI
Grok Imagine (Quality)
Bytedance
Seedream 4.5
Google
Imagen 4.0 Ultra
Google
Imagen 3.0
Ideogram
Ideogram 3.0 (Quality)
XAI
Grok Imagine
Black Forest Labs
FLUX.2 Max
Midjourney
Midjourney v7
Recraft
Recraft V3
Black Forest Labs
Flux 1.1 Pro Ultra
Midjourney
Midjourney V6.1
Alibaba
Z-Image Turbo
Black Forest Labs
Flux 2 Pro
OpenAI
ChatGPT 4o
Recraft
Recraft V4.1
Ideogram
Ideogram V2
Minimax
MiniMax Image-01
Black Forest Labs
FLUX.1 Kontext Max
Reve
Reve Image (Halfmoon)
Bytedance
Seedream 3.0
XAI
Grok 2 Image
Krea
Krea 2 Large
Detail Execution
(100 examples)
1 Avg: 8.80 / 10
Refusals: 13
2 Avg: 8.65 / 10
3 Avg: 8.60 / 10
Refusals: 12
Avg: 8.58 / 10
Refusals: 1
Avg: 8.55 / 10
Avg: 8.45 / 10
Refusals: 11
Avg: 8.33 / 10
Avg: 8.30 / 10
Avg: 8.29 / 10
Avg: 8.21 / 10
Avg: 8.20 / 10
Avg: 8.13 / 10
Refusals: 2
Avg: 8.10 / 10
Avg: 8.10 / 10
Avg: 8.00 / 10
Refusals: 3
Avg: 7.95 / 10
Avg: 7.88 / 10
Avg: 7.88 / 10
Refusals: 10
Avg: 7.81 / 10
Refusals: 2
Avg: 7.78 / 10
Avg: 7.70 / 10
Refusals: 1
Avg: 7.62 / 10
Refusals: 2
Avg: 7.62 / 10
Avg: 7.59 / 10
Refusals: 1
Avg: 7.53 / 10
Refusals: 11
Avg: 7.50 / 10
Avg: 7.43 / 10
Avg: 7.34 / 10
Avg: 7.23 / 10
Refusals: 6
Avg: 7.16 / 10
Avg: 7.03 / 10
Avg: 6.35 / 10
Refusals: 1
Avg: 6.22 / 10
(10 examples)
Avg Score: 7.92
Avg Score: 7.92
1 9.29 / 10
Refusals: 3
8.90 / 10
3 9.00 / 10
Refusals: 3
2 9.11 / 10
Refusals: 1
8.90 / 10
8.38 / 10
Refusals: 2
8.50 / 10
8.50 / 10
8.90 / 10
8.20 / 10
7.90 / 10
8.11 / 10
Refusals: 1
8.60 / 10
8.40 / 10
7.70 / 10
7.70 / 10
8.80 / 10
8.00 / 10
Refusals: 3
7.80 / 10
7.10 / 10
7.40 / 10
8.30 / 10
7.50 / 10
7.60 / 10
6.88 / 10
Refusals: 2
7.10 / 10
6.90 / 10
7.90 / 10
7.90 / 10
7.00 / 10
7.40 / 10
6.70 / 10
5.70 / 10
(10 examples)
Avg Score: 8.06
Avg Score: 8.06
1 9.11 / 10
Refusals: 1
2 8.90 / 10
8.70 / 10
8.50 / 10
3 8.80 / 10
2 8.90 / 10
8.40 / 10
8.30 / 10
8.50 / 10
2 8.90 / 10
8.40 / 10
8.30 / 10
8.50 / 10
3 8.80 / 10
8.40 / 10
8.10 / 10
7.40 / 10
8.00 / 10
7.70 / 10
8.20 / 10
8.30 / 10
7.70 / 10
7.90 / 10
7.70 / 10
7.71 / 10
Refusals: 3
7.60 / 10
8.30 / 10
7.60 / 10
7.30 / 10
7.60 / 10
7.00 / 10
5.90 / 10
6.50 / 10
(10 examples)
Avg Score: 7.87
Avg Score: 7.87
1 9.00 / 10
Refusals: 1
8.50 / 10
8.70 / 10
8.40 / 10
2 8.80 / 10
3 8.78 / 10
Refusals: 1
8.40 / 10
8.00 / 10
8.40 / 10
8.00 / 10
8.70 / 10
8.00 / 10
7.60 / 10
7.80 / 10
7.88 / 10
Refusals: 2
7.90 / 10
7.80 / 10
8.20 / 10
7.80 / 10
6.80 / 10
7.89 / 10
Refusals: 1
7.90 / 10
7.80 / 10
7.78 / 10
Refusals: 1
7.33 / 10
Refusals: 1
7.80 / 10
7.60 / 10
7.10 / 10
7.67 / 10
Refusals: 1
7.80 / 10
7.10 / 10
5.89 / 10
Refusals: 1
6.40 / 10
(10 examples)
Avg Score: 7.97
Avg Score: 7.97
1 9.29 / 10
Refusals: 3
8.60 / 10
2 9.00 / 10
Refusals: 9
2 9.00 / 10
3 8.90 / 10
2 9.00 / 10
Refusals: 7
3 8.90 / 10
8.40 / 10
8.30 / 10
8.10 / 10
8.50 / 10
3 8.90 / 10
7.90 / 10
8.10 / 10
8.40 / 10
7.40 / 10
8.50 / 10
8.60 / 10
Refusals: 5
8.25 / 10
Refusals: 2
7.40 / 10
7.00 / 10
8.00 / 10
Refusals: 2
7.80 / 10
8.20 / 10
7.57 / 10
Refusals: 3
7.90 / 10
5.90 / 10
7.60 / 10
7.88 / 10
Refusals: 2
7.70 / 10
8.10 / 10
6.30 / 10
5.90 / 10
(10 examples)
Avg Score: 7.51
Avg Score: 7.51
3 8.50 / 10
1 8.70 / 10
8.20 / 10
8.30 / 10
7.00 / 10
7.40 / 10
7.70 / 10
7.50 / 10
8.30 / 10
8.30 / 10
6.90 / 10
8.00 / 10
8.20 / 10
1 8.70 / 10
8.00 / 10
2 8.60 / 10
7.70 / 10
7.50 / 10
7.40 / 10
8.40 / 10
7.50 / 10
7.10 / 10
7.50 / 10
6.90 / 10
7.50 / 10
6.10 / 10
7.40 / 10
6.80 / 10
6.90 / 10
6.70 / 10
6.30 / 10
6.30 / 10
5.50 / 10
(10 examples)
Avg Score: 7.66
Avg Score: 7.66
8.10 / 10
3 8.40 / 10
8.30 / 10
2 8.50 / 10
8.20 / 10
8.22 / 10
Refusals: 1
8.30 / 10
1 8.90 / 10
7.60 / 10
7.80 / 10
2 8.50 / 10
7.60 / 10
7.40 / 10
7.10 / 10
8.00 / 10
7.90 / 10
7.80 / 10
7.70 / 10
8.10 / 10
7.50 / 10
7.70 / 10
6.70 / 10
7.10 / 10
7.60 / 10
7.30 / 10
8.20 / 10
7.40 / 10
7.80 / 10
6.90 / 10
7.20 / 10
6.40 / 10
6.40 / 10
6.20 / 10
(10 examples)
Avg Score: 8.16
Avg Score: 8.16
1 9.00 / 10
2 8.80 / 10
8.50 / 10
8.70 / 10
8.70 / 10
2 8.80 / 10
8.40 / 10
8.40 / 10
8.30 / 10
7.90 / 10
8.60 / 10
8.40 / 10
8.60 / 10
7.90 / 10
3 8.78 / 10
Refusals: 1
8.20 / 10
7.70 / 10
8.00 / 10
8.40 / 10
1 9.00 / 10
7.90 / 10
8.20 / 10
7.80 / 10
7.40 / 10
8.67 / 10
Refusals: 1
8.10 / 10
8.30 / 10
7.50 / 10
7.40 / 10
7.20 / 10
7.30 / 10
7.50 / 10
7.10 / 10
(10 examples)
Avg Score: 7.93
Avg Score: 7.93
2 9.00 / 10
Refusals: 2
8.60 / 10
3 8.90 / 10
8.60 / 10
3 8.90 / 10
8.80 / 10
8.70 / 10
8.40 / 10
1 9.10 / 10
8.40 / 10
7.60 / 10
7.80 / 10
8.40 / 10
7.60 / 10
7.60 / 10
7.90 / 10
7.90 / 10
8.00 / 10
8.40 / 10
7.80 / 10
8.00 / 10
8.10 / 10
7.50 / 10
8.00 / 10
7.50 / 10
8.00 / 10
7.20 / 10
7.50 / 10
6.90 / 10
6.90 / 10
7.60 / 10
6.40 / 10
6.00 / 10
(10 examples)
Avg Score: 7.74
Avg Score: 7.74
2 8.78 / 10
Refusals: 1
3 8.70 / 10
1 8.80 / 10
8.50 / 10
8.60 / 10
8.00 / 10
8.30 / 10
8.20 / 10
7.80 / 10
8.50 / 10
8.30 / 10
7.90 / 10
8.30 / 10
1 8.80 / 10
7.90 / 10
8.20 / 10
7.70 / 10
7.40 / 10
6.60 / 10
8.40 / 10
7.90 / 10
7.20 / 10
7.80 / 10
7.60 / 10
7.10 / 10
6.90 / 10
8.20 / 10
6.90 / 10
6.30 / 10
6.90 / 10
6.30 / 10
6.00 / 10
6.60 / 10
(10 examples)
Avg Score: 7.60
Avg Score: 7.60
8.25 / 10
Refusals: 2
3 8.40 / 10
3 8.40 / 10
8.20 / 10
1 8.70 / 10
2 8.60 / 10
7.70 / 10
3 8.40 / 10
7.70 / 10
8.00 / 10
2 8.60 / 10
8.33 / 10
Refusals: 1
7.50 / 10
7.80 / 10
7.40 / 10
7.60 / 10
7.50 / 10
7.75 / 10
Refusals: 2
7.70 / 10
7.20 / 10
7.40 / 10
7.10 / 10
7.50 / 10
7.10 / 10
7.78 / 10
Refusals: 1
7.30 / 10
7.10 / 10
6.70 / 10
7.43 / 10
Refusals: 3
6.60 / 10
6.80 / 10
6.10 / 10
6.30 / 10