Model Comparison Leaderboard
Category
OpenAI
GPT Image 2
OpenAI
GPT Image 1.5
Google
Nano Banana (2.5 Flash)
Google
Nano Banana 2
XAI
Grok Imagine
Bytedance
Seedream 4.0
Google
Imagen 4.0 Ultra
Ideogram
Ideogram 3.0 (Quality)
OpenAI
ChatGPT 4o
Google
Nano Banana Pro
Bytedance
Seedream 4.5
Black Forest Labs
FLUX.1 Kontext Max
Google
Imagen 3.0
Black Forest Labs
Flux 2 Pro
Bytedance
Seedream 3.0
OpenAI
DALL-E 3
Alibaba
Z-Image Turbo
Minimax
MiniMax Image-01
Recraft
Recraft V3
Midjourney
Midjourney V6.1
Ideogram
Ideogram V2
Black Forest Labs
Flux 1.1 Pro Ultra
Midjourney
Midjourney v7
Reve
Reve Image (Halfmoon)
XAI
Grok 2 Image
Overall Score
(100 examples)
Avg: 8.51 / 10
Refusals: 12
Avg: 8.19 / 10
Refusals: 11
Avg: 7.86 / 10
Avg: 7.84 / 10
Avg: 7.80 / 10
Avg: 7.66 / 10
Avg: 7.66 / 10
Avg: 7.65 / 10
Avg: 7.62 / 10
Refusals: 11
Avg: 7.61 / 10
Avg: 7.58 / 10
Avg: 7.53 / 10
Refusals: 6
Avg: 7.41 / 10
Refusals: 3
Avg: 7.40 / 10
Refusals: 1
Avg: 7.36 / 10
Avg: 7.14 / 10
Avg: 7.03 / 10
Avg: 7.01 / 10
Avg: 6.99 / 10
Avg: 6.81 / 10
Refusals: 2
Avg: 6.79 / 10
Avg: 6.74 / 10
Refusals: 1
Avg: 6.41 / 10
Refusals: 2
Avg: 6.40 / 10
Avg: 5.31 / 10
Refusals: 1
(10 examples)
Avg Score: 7.63
Avg Score: 7.63
8.86 / 10
Refusals: 3
8.38 / 10
Refusals: 2
8.30 / 10
8.40 / 10
7.80 / 10
7.80 / 10
8.50 / 10
8.20 / 10
7.75 / 10
Refusals: 2
7.60 / 10
8.70 / 10
7.90 / 10
7.30 / 10
7.30 / 10
8.30 / 10
8.10 / 10
7.60 / 10
7.90 / 10
6.80 / 10
7.40 / 10
7.00 / 10
6.60 / 10
6.80 / 10
6.90 / 10
5.20 / 10
(10 examples)
Avg Score: 7.90
Avg Score: 7.90
8.60 / 10
8.60 / 10
7.80 / 10
8.30 / 10
8.80 / 10
8.80 / 10
8.50 / 10
8.30 / 10
8.57 / 10
Refusals: 3
7.60 / 10
8.50 / 10
7.90 / 10
7.80 / 10
8.20 / 10
8.70 / 10
7.80 / 10
7.20 / 10
8.40 / 10
8.30 / 10
7.50 / 10
8.00 / 10
7.40 / 10
6.70 / 10
6.30 / 10
5.10 / 10
(10 examples)
Avg Score: 6.89
Avg Score: 6.89
8.70 / 10
8.33 / 10
Refusals: 1
7.90 / 10
7.30 / 10
7.30 / 10
6.80 / 10
6.30 / 10
7.10 / 10
6.22 / 10
Refusals: 1
7.70 / 10
6.70 / 10
6.78 / 10
Refusals: 1
6.75 / 10
Refusals: 2
6.00 / 10
Refusals: 1
7.20 / 10
7.40 / 10
6.80 / 10
6.50 / 10
5.90 / 10
6.90 / 10
6.90 / 10
6.22 / 10
Refusals: 1
6.00 / 10
6.80 / 10
5.44 / 10
Refusals: 1
(10 examples)
Avg Score: 7.20
Avg Score: 7.20
9.00 / 10
Refusals: 9
9.00 / 10
Refusals: 7
8.90 / 10
8.10 / 10
8.10 / 10
7.80 / 10
7.90 / 10
7.30 / 10
8.14 / 10
Refusals: 3
8.80 / 10
7.30 / 10
8.12 / 10
Refusals: 2
7.70 / 10
8.10 / 10
8.00 / 10
5.80 / 10
7.40 / 10
6.60 / 10
6.10 / 10
7.00 / 10
Refusals: 2
5.30 / 10
6.00 / 10
6.25 / 10
Refusals: 2
5.90 / 10
4.60 / 10
(10 examples)
Avg Score: 7.71
Avg Score: 7.71
8.80 / 10
7.20 / 10
7.70 / 10
8.20 / 10
9.10 / 10
8.60 / 10
8.80 / 10
8.30 / 10
9.10 / 10
7.10 / 10
8.40 / 10
8.20 / 10
7.10 / 10
8.90 / 10
6.60 / 10
7.60 / 10
7.80 / 10
7.30 / 10
8.30 / 10
5.70 / 10
7.30 / 10
7.50 / 10
6.40 / 10
7.00 / 10
5.70 / 10
(10 examples)
Avg Score: 6.92
Avg Score: 6.92
8.30 / 10
8.11 / 10
Refusals: 1
7.40 / 10
7.40 / 10
7.50 / 10
7.30 / 10
6.40 / 10
7.00 / 10
6.20 / 10
7.50 / 10
6.00 / 10
7.20 / 10
8.10 / 10
6.50 / 10
7.60 / 10
5.90 / 10
6.90 / 10
6.40 / 10
6.60 / 10
6.10 / 10
6.50 / 10
7.10 / 10
7.10 / 10
6.90 / 10
5.20 / 10
(10 examples)
Avg Score: 7.39
Avg Score: 7.39
8.30 / 10
8.70 / 10
8.00 / 10
7.50 / 10
6.60 / 10
7.20 / 10
7.60 / 10
7.70 / 10
8.22 / 10
Refusals: 1
7.50 / 10
7.70 / 10
7.20 / 10
8.56 / 10
Refusals: 1
6.90 / 10
6.50 / 10
7.20 / 10
6.80 / 10
7.00 / 10
8.30 / 10
7.60 / 10
7.20 / 10
6.90 / 10
7.40 / 10
6.10 / 10
6.30 / 10
(10 examples)
Avg Score: 7.29
Avg Score: 7.29
8.70 / 10
8.40 / 10
7.90 / 10
7.60 / 10
7.70 / 10
7.70 / 10
7.50 / 10
7.60 / 10
7.40 / 10
7.10 / 10
8.10 / 10
7.50 / 10
7.40 / 10
7.70 / 10
8.30 / 10
8.30 / 10
6.30 / 10
6.80 / 10
6.00 / 10
7.20 / 10
6.80 / 10
6.80 / 10
6.50 / 10
5.80 / 10
5.10 / 10
(10 examples)
Avg Score: 7.73
Avg Score: 7.73
8.70 / 10
7.80 / 10
7.90 / 10
8.30 / 10
8.50 / 10
8.40 / 10
8.80 / 10
8.10 / 10
8.60 / 10
7.80 / 10
8.40 / 10
7.70 / 10
7.70 / 10
8.20 / 10
7.30 / 10
7.00 / 10
7.70 / 10
7.80 / 10
8.00 / 10
6.80 / 10
7.80 / 10
7.80 / 10
5.40 / 10
7.00 / 10
5.80 / 10
(10 examples)
Avg Score: 6.13
Avg Score: 6.13
7.70 / 10
8.00 / 10
6.80 / 10
7.30 / 10
6.60 / 10
6.20 / 10
6.30 / 10
6.90 / 10
6.22 / 10
Refusals: 1
7.40 / 10
6.00 / 10
6.57 / 10
Refusals: 3
5.70 / 10
6.10 / 10
5.10 / 10
6.30 / 10
5.80 / 10
5.40 / 10
5.60 / 10
5.90 / 10
5.10 / 10
5.00 / 10
5.50 / 10
5.30 / 10
4.70 / 10