Model Comparison Leaderboard
Category
OpenAI
GPT Image 2
Ideogram
Ideogram 4.0 (Quality)
Google
Nano Banana 2
Google
Nano Banana 2 Lite
Bytedance
Seedream 5.0 Pro
Reve
Reve 2.1
Bytedance
Seedream 4.0
OpenAI
GPT Image 1.5
Google
Nano Banana Pro
Ideogram
Ideogram 3.0 (Quality)
Alibaba
Z-Image Turbo
Google
Imagen 3.0
Bytedance
Seedream 4.5
Google
Imagen 4.0 Ultra
Google
Nano Banana (2.5 Flash)
Recraft
Recraft V3
XAI
Grok Imagine (Quality)
Black Forest Labs
FLUX.2 Max
OpenAI
ChatGPT 4o
XAI
Grok Imagine
Black Forest Labs
Flux 1.1 Pro Ultra
Recraft
Recraft V4.1
Midjourney
Midjourney V6.1
Ideogram
Ideogram V2
Black Forest Labs
Flux 2 Pro
Bytedance
Seedream 3.0
OpenAI
DALL-E 3
Minimax
MiniMax Image-01
Black Forest Labs
FLUX.1 Kontext Max
Reve
Reve Image (Halfmoon)
Midjourney
Midjourney v7
Krea
Krea 2 Large
XAI
Grok 2 Image
Realism & Coherence
(100 examples)
1 Avg: 8.19 / 10
Refusals: 12
2 Avg: 8.03 / 10
3 Avg: 8.00 / 10
Avg: 7.98 / 10
Refusals: 1
Avg: 7.98 / 10
Refusals: 13
Avg: 7.91 / 10
Avg: 7.79 / 10
Avg: 7.79 / 10
Refusals: 11
Avg: 7.73 / 10
Avg: 7.71 / 10
Avg: 7.69 / 10
Avg: 7.68 / 10
Refusals: 3
Avg: 7.68 / 10
Avg: 7.61 / 10
Avg: 7.58 / 10
Avg: 7.50 / 10
Avg: 7.44 / 10
Refusals: 2
Avg: 7.29 / 10
Refusals: 10
Avg: 7.28 / 10
Refusals: 11
Avg: 7.26 / 10
Avg: 7.17 / 10
Refusals: 1
Avg: 7.10 / 10
Avg: 7.06 / 10
Refusals: 2
Avg: 7.01 / 10
Avg: 6.91 / 10
Refusals: 1
Avg: 6.90 / 10
Avg: 6.87 / 10
Avg: 6.82 / 10
Avg: 6.74 / 10
Refusals: 6
Avg: 6.69 / 10
Avg: 6.55 / 10
Refusals: 2
Avg: 6.43 / 10
Avg: 6.36 / 10
Refusals: 1
(10 examples)
Avg Score: 7.43
Avg Score: 7.43
1 8.71 / 10
Refusals: 3
7.80 / 10
7.90 / 10
8.00 / 10
Refusals: 1
2 8.43 / 10
Refusals: 3
7.80 / 10
7.60 / 10
8.12 / 10
Refusals: 2
7.50 / 10
8.00 / 10
8.10 / 10
7.30 / 10
3 8.30 / 10
8.00 / 10
7.90 / 10
6.50 / 10
7.56 / 10
Refusals: 1
7.86 / 10
Refusals: 3
7.50 / 10
Refusals: 2
7.90 / 10
6.50 / 10
6.90 / 10
7.30 / 10
6.90 / 10
6.90 / 10
7.30 / 10
7.70 / 10
7.50 / 10
6.80 / 10
6.80 / 10
6.30 / 10
6.60 / 10
6.00 / 10
(10 examples)
Avg Score: 7.52
Avg Score: 7.52
3 8.30 / 10
1 8.50 / 10
8.10 / 10
7.70 / 10
8.22 / 10
Refusals: 1
8.20 / 10
3 8.30 / 10
7.90 / 10
7.60 / 10
8.00 / 10
2 8.40 / 10
7.80 / 10
3 8.30 / 10
1 8.50 / 10
7.60 / 10
7.90 / 10
7.60 / 10
7.40 / 10
7.29 / 10
Refusals: 3
7.00 / 10
7.50 / 10
6.60 / 10
7.20 / 10
8.00 / 10
7.00 / 10
6.70 / 10
7.40 / 10
6.60 / 10
6.50 / 10
7.00 / 10
5.90 / 10
6.70 / 10
6.30 / 10
(10 examples)
Avg Score: 6.91
Avg Score: 6.91
7.90 / 10
7.80 / 10
7.30 / 10
3 8.00 / 10
1 8.11 / 10
Refusals: 1
2 8.10 / 10
6.80 / 10
7.56 / 10
Refusals: 1
7.40 / 10
6.90 / 10
7.30 / 10
7.00 / 10
Refusals: 2
6.70 / 10
6.00 / 10
7.40 / 10
6.00 / 10
6.60 / 10
6.70 / 10
6.22 / 10
Refusals: 1
6.20 / 10
6.89 / 10
Refusals: 1
7.10 / 10
6.70 / 10
7.10 / 10
6.33 / 10
Refusals: 1
6.80 / 10
6.50 / 10
6.80 / 10
7.11 / 10
Refusals: 1
6.60 / 10
6.20 / 10
6.00 / 10
6.00 / 10
Refusals: 1
(10 examples)
Avg Score: 7.31
Avg Score: 7.31
2 8.00 / 10
Refusals: 9
1 8.20 / 10
7.60 / 10
2 8.00 / 10
7.86 / 10
Refusals: 3
7.80 / 10
3 7.90 / 10
7.33 / 10
Refusals: 7
7.60 / 10
7.50 / 10
7.60 / 10
2 8.00 / 10
7.40 / 10
2 8.00 / 10
2 8.00 / 10
7.40 / 10
7.60 / 10
7.40 / 10
Refusals: 5
7.14 / 10
Refusals: 3
7.30 / 10
7.10 / 10
6.70 / 10
7.62 / 10
Refusals: 2
5.70 / 10
7.30 / 10
3 7.90 / 10
6.40 / 10
6.80 / 10
6.88 / 10
Refusals: 2
6.80 / 10
6.75 / 10
Refusals: 2
5.90 / 10
6.30 / 10
(10 examples)
Avg Score: 7.91
Avg Score: 7.91
8.50 / 10
7.80 / 10
8.80 / 10
8.50 / 10
8.00 / 10
7.30 / 10
2 9.10 / 10
7.70 / 10
8.20 / 10
8.80 / 10
8.50 / 10
7.90 / 10
8.80 / 10
1 9.20 / 10
8.10 / 10
3 9.00 / 10
8.10 / 10
7.80 / 10
8.30 / 10
8.30 / 10
8.10 / 10
7.30 / 10
7.20 / 10
7.90 / 10
7.40 / 10
7.10 / 10
8.10 / 10
7.00 / 10
7.10 / 10
7.50 / 10
6.50 / 10
6.60 / 10
6.50 / 10
(10 examples)
Avg Score: 7.10
Avg Score: 7.10
7.80 / 10
8.10 / 10
8.00 / 10
7.80 / 10
6.90 / 10
7.40 / 10
7.50 / 10
3 8.11 / 10
Refusals: 1
1 8.30 / 10
7.00 / 10
7.10 / 10
2 8.20 / 10
6.70 / 10
6.80 / 10
7.60 / 10
6.80 / 10
7.70 / 10
7.10 / 10
6.30 / 10
7.10 / 10
7.30 / 10
2 8.20 / 10
6.20 / 10
6.80 / 10
6.70 / 10
7.10 / 10
5.50 / 10
6.20 / 10
6.50 / 10
6.30 / 10
7.20 / 10
6.00 / 10
6.00 / 10
(10 examples)
Avg Score: 7.45
Avg Score: 7.45
8.20 / 10
3 8.40 / 10
1 8.70 / 10
8.30 / 10
8.20 / 10
8.30 / 10
7.20 / 10
7.90 / 10
7.80 / 10
7.70 / 10
7.60 / 10
2 8.56 / 10
Refusals: 1
7.80 / 10
7.10 / 10
7.30 / 10
1 8.70 / 10
7.60 / 10
6.70 / 10
8.11 / 10
Refusals: 1
7.00 / 10
6.70 / 10
7.20 / 10
7.60 / 10
7.50 / 10
6.20 / 10
6.30 / 10
6.10 / 10
6.70 / 10
6.30 / 10
6.50 / 10
7.40 / 10
6.60 / 10
7.80 / 10
(10 examples)
Avg Score: 7.20
Avg Score: 7.20
1 8.30 / 10
7.20 / 10
7.50 / 10
7.70 / 10
2 8.25 / 10
Refusals: 2
3 7.90 / 10
7.70 / 10
3 7.90 / 10
7.10 / 10
7.70 / 10
7.00 / 10
7.20 / 10
3 7.90 / 10
6.90 / 10
7.50 / 10
7.40 / 10
6.60 / 10
7.40 / 10
6.90 / 10
7.30 / 10
7.30 / 10
6.80 / 10
7.20 / 10
6.70 / 10
7.20 / 10
7.00 / 10
7.80 / 10
7.20 / 10
6.70 / 10
6.20 / 10
6.70 / 10
5.80 / 10
6.00 / 10
(10 examples)
Avg Score: 7.71
Avg Score: 7.71
3 8.30 / 10
2 8.50 / 10
8.10 / 10
7.90 / 10
8.22 / 10
Refusals: 1
2 8.50 / 10
1 8.60 / 10
7.40 / 10
7.90 / 10
8.10 / 10
8.10 / 10
8.10 / 10
2 8.50 / 10
1 8.60 / 10
8.00 / 10
3 8.30 / 10
7.70 / 10
7.50 / 10
7.70 / 10
7.30 / 10
8.10 / 10
7.30 / 10
7.40 / 10
7.90 / 10
7.60 / 10
6.90 / 10
6.70 / 10
7.30 / 10
6.70 / 10
6.90 / 10
6.30 / 10
7.60 / 10
6.50 / 10
(10 examples)
Avg Score: 6.95
Avg Score: 6.95
2 7.90 / 10
1 8.00 / 10
1 8.00 / 10
2 7.90 / 10
7.75 / 10
Refusals: 2
3 7.80 / 10
7.20 / 10
7.70 / 10
2 7.90 / 10
7.40 / 10
7.20 / 10
6.70 / 10
6.40 / 10
7.00 / 10
6.40 / 10
7.00 / 10
7.33 / 10
Refusals: 1
7.25 / 10
Refusals: 2
7.33 / 10
Refusals: 1
7.20 / 10
6.20 / 10
6.90 / 10
6.30 / 10
5.60 / 10
6.40 / 10
5.90 / 10
6.50 / 10
6.10 / 10
7.00 / 10
Refusals: 3
6.30 / 10
6.30 / 10
6.50 / 10
6.20 / 10