Model Comparison Leaderboard
Category
OpenAI
GPT Image 2
OpenAI
GPT Image 1.5
XAI
Grok Imagine
OpenAI
DALL-E 3
Google
Nano Banana 2
Black Forest Labs
Flux 2 Pro
Bytedance
Seedream 4.0
Google
Imagen 4.0 Ultra
Bytedance
Seedream 4.5
Google
Imagen 3.0
Ideogram
Ideogram 3.0 (Quality)
Google
Nano Banana (2.5 Flash)
OpenAI
ChatGPT 4o
Black Forest Labs
FLUX.1 Kontext Max
Bytedance
Seedream 3.0
Recraft
Recraft V3
Minimax
MiniMax Image-01
Black Forest Labs
Flux 1.1 Pro Ultra
Alibaba
Z-Image Turbo
Midjourney
Midjourney v7
Midjourney
Midjourney V6.1
Google
Nano Banana Pro
Ideogram
Ideogram V2
Reve
Reve Image (Halfmoon)
XAI
Grok 2 Image
Detail Execution
(100 examples)
Avg: 8.55 / 10
Refusals: 12
Avg: 8.33 / 10
Refusals: 11
Avg: 8.32 / 10
Avg: 8.29 / 10
Avg: 8.25 / 10
Avg: 8.24 / 10
Refusals: 1
Avg: 8.20 / 10
Avg: 8.11 / 10
Avg: 8.10 / 10
Avg: 8.00 / 10
Refusals: 3
Avg: 7.96 / 10
Avg: 7.95 / 10
Avg: 7.92 / 10
Refusals: 11
Avg: 7.89 / 10
Refusals: 6
Avg: 7.85 / 10
Avg: 7.78 / 10
Avg: 7.71 / 10
Avg: 7.70 / 10
Refusals: 1
Avg: 7.62 / 10
Avg: 7.61 / 10
Refusals: 2
Avg: 7.56 / 10
Refusals: 2
Avg: 7.51 / 10
Avg: 7.43 / 10
Avg: 6.55 / 10
Avg: 5.44 / 10
Refusals: 1
(10 examples)
Avg Score: 7.90
Avg Score: 7.90
9.00 / 10
Refusals: 3
8.25 / 10
Refusals: 2
8.50 / 10
8.90 / 10
8.50 / 10
8.40 / 10
8.20 / 10
8.40 / 10
8.60 / 10
7.70 / 10
7.70 / 10
8.50 / 10
7.50 / 10
Refusals: 2
8.20 / 10
8.00 / 10
7.10 / 10
8.40 / 10
7.40 / 10
7.50 / 10
7.80 / 10
8.20 / 10
7.50 / 10
6.90 / 10
7.20 / 10
5.50 / 10
(10 examples)
Avg Score: 8.19
Avg Score: 8.19
8.90 / 10
8.90 / 10
8.70 / 10
8.50 / 10
8.70 / 10
9.10 / 10
8.90 / 10
8.80 / 10
8.50 / 10
8.40 / 10
8.10 / 10
7.90 / 10
8.57 / 10
Refusals: 3
8.40 / 10
8.80 / 10
8.20 / 10
8.70 / 10
8.30 / 10
7.90 / 10
7.70 / 10
7.70 / 10
7.60 / 10
8.30 / 10
6.30 / 10
5.10 / 10
(10 examples)
Avg Score: 7.68
Avg Score: 7.68
8.80 / 10
8.56 / 10
Refusals: 1
8.50 / 10
8.40 / 10
8.10 / 10
7.89 / 10
Refusals: 1
7.90 / 10
7.80 / 10
7.60 / 10
7.88 / 10
Refusals: 2
7.90 / 10
8.10 / 10
7.56 / 10
Refusals: 1
7.56 / 10
Refusals: 1
7.40 / 10
6.80 / 10
7.20 / 10
7.89 / 10
Refusals: 1
7.80 / 10
7.40 / 10
7.90 / 10
7.50 / 10
7.60 / 10
7.00 / 10
4.78 / 10
Refusals: 1
(10 examples)
Avg Score: 7.89
Avg Score: 7.89
9.00 / 10
Refusals: 9
9.33 / 10
Refusals: 7
8.40 / 10
8.30 / 10
8.60 / 10
8.30 / 10
8.10 / 10
8.10 / 10
7.90 / 10
8.40 / 10
7.50 / 10
8.90 / 10
7.86 / 10
Refusals: 3
8.25 / 10
Refusals: 2
8.10 / 10
7.40 / 10
7.70 / 10
7.00 / 10
7.80 / 10
8.88 / 10
Refusals: 2
7.38 / 10
Refusals: 2
8.20 / 10
5.90 / 10
7.30 / 10
6.90 / 10
(10 examples)
Avg Score: 7.74
Avg Score: 7.74
8.30 / 10
7.30 / 10
8.40 / 10
8.30 / 10
8.10 / 10
8.40 / 10
8.30 / 10
8.70 / 10
8.20 / 10
8.00 / 10
8.60 / 10
7.30 / 10
8.40 / 10
8.10 / 10
7.80 / 10
8.40 / 10
7.80 / 10
7.50 / 10
7.50 / 10
7.00 / 10
7.10 / 10
7.10 / 10
7.40 / 10
6.30 / 10
5.30 / 10
(10 examples)
Avg Score: 7.42
Avg Score: 7.42
8.30 / 10
8.33 / 10
Refusals: 1
8.00 / 10
7.60 / 10
7.60 / 10
7.80 / 10
7.80 / 10
7.00 / 10
7.40 / 10
8.00 / 10
7.90 / 10
7.30 / 10
7.20 / 10
7.20 / 10
7.60 / 10
7.50 / 10
6.50 / 10
7.70 / 10
7.10 / 10
7.80 / 10
6.70 / 10
7.70 / 10
7.40 / 10
7.00 / 10
5.10 / 10
(10 examples)
Avg Score: 7.99
Avg Score: 7.99
8.30 / 10
8.60 / 10
7.90 / 10
8.30 / 10
8.10 / 10
7.90 / 10
7.90 / 10
8.10 / 10
8.60 / 10
8.78 / 10
Refusals: 1
8.20 / 10
8.10 / 10
8.56 / 10
Refusals: 1
7.90 / 10
7.50 / 10
9.00 / 10
7.90 / 10
7.90 / 10
7.80 / 10
8.10 / 10
8.20 / 10
7.20 / 10
8.30 / 10
6.50 / 10
6.20 / 10
(10 examples)
Avg Score: 7.81
Avg Score: 7.81
9.10 / 10
8.50 / 10
8.20 / 10
9.10 / 10
8.20 / 10
8.30 / 10
8.40 / 10
7.60 / 10
8.40 / 10
7.60 / 10
7.90 / 10
8.00 / 10
7.90 / 10
7.70 / 10
8.30 / 10
7.80 / 10
7.50 / 10
8.00 / 10
7.50 / 10
7.80 / 10
8.10 / 10
7.40 / 10
7.20 / 10
5.80 / 10
5.00 / 10
(10 examples)
Avg Score: 7.86
Avg Score: 7.86
8.40 / 10
7.80 / 10
8.70 / 10
7.80 / 10
8.40 / 10
8.50 / 10
8.50 / 10
8.80 / 10
8.30 / 10
7.90 / 10
8.20 / 10
7.80 / 10
8.00 / 10
7.70 / 10
7.90 / 10
8.40 / 10
8.10 / 10
7.90 / 10
7.80 / 10
6.40 / 10
7.20 / 10
7.50 / 10
8.20 / 10
6.70 / 10
5.50 / 10
(10 examples)
Avg Score: 7.41
Avg Score: 7.41
7.90 / 10
8.40 / 10
7.90 / 10
7.70 / 10
8.20 / 10
7.80 / 10
8.00 / 10
7.80 / 10
7.50 / 10
7.40 / 10
7.60 / 10
7.60 / 10
7.78 / 10
Refusals: 1
8.00 / 10
Refusals: 3
7.10 / 10
7.20 / 10
7.30 / 10
7.40 / 10
7.50 / 10
7.50 / 10
7.10 / 10
7.40 / 10
7.10 / 10
5.40 / 10
5.00 / 10