Model Comparison Leaderboard
Category
OpenAI
GPT Image 2
Google
Imagen 4.0 Ultra
OpenAI
GPT Image 1.5
Google
Nano Banana 2 Lite
Google
Nano Banana 2
XAI
Grok Imagine (Quality)
Google
Nano Banana Pro
Bytedance
Seedream 4.0
Bytedance
Seedream 4.5
Black Forest Labs
FLUX.2 Max
Google
Nano Banana (2.5 Flash)
Google
Imagen 3.0
Ideogram
Ideogram 3.0 (Quality)
Reve
Reve 2.1
Bytedance
Seedream 5.0 Pro
Ideogram
Ideogram 4.0 (Quality)
XAI
Grok Imagine
OpenAI
ChatGPT 4o
Ideogram
Ideogram V2
Black Forest Labs
Flux 2 Pro
Recraft
Recraft V4.1
Alibaba
Z-Image Turbo
Black Forest Labs
Flux 1.1 Pro Ultra
Black Forest Labs
FLUX.1 Kontext Max
Recraft
Recraft V3
Bytedance
Seedream 3.0
Reve
Reve Image (Halfmoon)
OpenAI
DALL-E 3
Minimax
MiniMax Image-01
Krea
Krea 2 Large
Midjourney
Midjourney V6.1
Midjourney
Midjourney v7
XAI
Grok 2 Image
Prompt Adherence
(100 examples)
1 Avg: 9.24 / 10
Refusals: 12
2 Avg: 9.21 / 10
3 Avg: 9.08 / 10
Refusals: 11
Avg: 8.93 / 10
Refusals: 1
Avg: 8.91 / 10
Avg: 8.86 / 10
Refusals: 2
Avg: 8.84 / 10
Avg: 8.82 / 10
Avg: 8.73 / 10
Avg: 8.71 / 10
Refusals: 10
Avg: 8.70 / 10
Avg: 8.54 / 10
Refusals: 3
Avg: 8.52 / 10
Avg: 8.52 / 10
Avg: 8.52 / 10
Refusals: 13
Avg: 8.30 / 10
Avg: 8.29 / 10
Avg: 8.24 / 10
Refusals: 11
Avg: 8.11 / 10
Avg: 8.08 / 10
Refusals: 1
Avg: 8.05 / 10
Avg: 7.95 / 10
Avg: 7.84 / 10
Refusals: 1
Avg: 7.69 / 10
Refusals: 6
Avg: 7.68 / 10
Avg: 7.63 / 10
Avg: 7.52 / 10
Avg: 7.37 / 10
Avg: 7.26 / 10
Avg: 7.09 / 10
Avg: 6.96 / 10
Refusals: 2
Avg: 6.39 / 10
Refusals: 2
Avg: 6.30 / 10
Refusals: 1
(10 examples)
Avg Score: 8.64
Avg Score: 8.64
3 9.57 / 10
Refusals: 3
1 9.90 / 10
9.38 / 10
Refusals: 2
2 9.67 / 10
Refusals: 1
9.40 / 10
9.00 / 10
Refusals: 1
9.20 / 10
8.80 / 10
9.10 / 10
9.29 / 10
Refusals: 3
9.50 / 10
9.20 / 10
9.30 / 10
8.50 / 10
9.00 / 10
Refusals: 3
9.10 / 10
8.80 / 10
8.38 / 10
Refusals: 2
8.90 / 10
8.20 / 10
8.30 / 10
8.40 / 10
8.60 / 10
7.90 / 10
8.40 / 10
8.80 / 10
7.20 / 10
8.30 / 10
7.70 / 10
7.50 / 10
7.80 / 10
7.90 / 10
7.10 / 10
(10 examples)
Avg Score: 8.28
Avg Score: 8.28
3 9.40 / 10
2 9.60 / 10
9.00 / 10
8.90 / 10
9.30 / 10
8.70 / 10
8.50 / 10
1 9.70 / 10
9.10 / 10
8.70 / 10
8.50 / 10
9.20 / 10
9.10 / 10
8.90 / 10
9.22 / 10
Refusals: 1
8.30 / 10
7.70 / 10
7.71 / 10
Refusals: 3
8.90 / 10
8.20 / 10
7.30 / 10
7.60 / 10
8.70 / 10
7.40 / 10
8.80 / 10
7.40 / 10
7.70 / 10
8.00 / 10
7.60 / 10
6.50 / 10
7.70 / 10
6.50 / 10
5.40 / 10
(10 examples)
Avg Score: 9.03
Avg Score: 9.03
3 9.80 / 10
1 9.90 / 10
2 9.89 / 10
Refusals: 1
9.60 / 10
1 9.90 / 10
1 9.90 / 10
9.50 / 10
9.60 / 10
9.60 / 10
9.40 / 10
9.40 / 10
9.38 / 10
Refusals: 2
8.70 / 10
3 9.80 / 10
9.78 / 10
Refusals: 1
8.90 / 10
9.60 / 10
9.11 / 10
Refusals: 1
9.20 / 10
8.78 / 10
Refusals: 1
9.00 / 10
9.00 / 10
8.56 / 10
Refusals: 1
8.89 / 10
Refusals: 1
8.10 / 10
8.60 / 10
8.50 / 10
8.40 / 10
8.50 / 10
8.20 / 10
8.00 / 10
7.20 / 10
7.44 / 10
Refusals: 1
(10 examples)
Avg Score: 7.52
Avg Score: 7.52
1 10.00 / 10
Refusals: 9
8.40 / 10
2 9.67 / 10
Refusals: 7
3 9.60 / 10
8.80 / 10
8.90 / 10
9.00 / 10
7.90 / 10
7.80 / 10
8.80 / 10
Refusals: 5
8.90 / 10
8.10 / 10
7.20 / 10
8.50 / 10
8.43 / 10
Refusals: 3
8.60 / 10
7.50 / 10
8.43 / 10
Refusals: 3
6.00 / 10
8.50 / 10
7.10 / 10
7.50 / 10
5.80 / 10
7.62 / 10
Refusals: 2
6.00 / 10
7.90 / 10
6.70 / 10
5.20 / 10
7.10 / 10
5.70 / 10
6.50 / 10
Refusals: 2
5.62 / 10
Refusals: 2
4.80 / 10
(10 examples)
Avg Score: 7.92
Avg Score: 7.92
8.80 / 10
1 9.60 / 10
7.80 / 10
8.20 / 10
8.90 / 10
8.60 / 10
8.60 / 10
3 9.10 / 10
2 9.20 / 10
8.40 / 10
8.70 / 10
7.40 / 10
8.80 / 10
7.40 / 10
6.70 / 10
8.20 / 10
8.80 / 10
8.70 / 10
8.30 / 10
8.00 / 10
7.90 / 10
8.40 / 10
8.00 / 10
7.50 / 10
8.70 / 10
6.50 / 10
8.10 / 10
7.50 / 10
6.60 / 10
6.60 / 10
5.30 / 10
5.90 / 10
6.20 / 10
(10 examples)
Avg Score: 8.02
Avg Score: 8.02
8.50 / 10
2 9.10 / 10
8.67 / 10
Refusals: 1
8.00 / 10
8.20 / 10
8.90 / 10
8.60 / 10
8.20 / 10
7.90 / 10
8.80 / 10
8.20 / 10
3 9.00 / 10
1 9.30 / 10
8.00 / 10
7.10 / 10
7.90 / 10
7.90 / 10
7.60 / 10
8.30 / 10
7.70 / 10
2 9.10 / 10
2 9.10 / 10
8.70 / 10
7.60 / 10
8.30 / 10
7.90 / 10
7.60 / 10
6.10 / 10
7.00 / 10
7.60 / 10
6.10 / 10
7.30 / 10
6.60 / 10
(10 examples)
Avg Score: 8.94
Avg Score: 8.94
9.70 / 10
9.60 / 10
3 9.80 / 10
9.20 / 10
8.90 / 10
9.30 / 10
9.10 / 10
1 9.90 / 10
9.50 / 10
9.20 / 10
9.40 / 10
2 9.89 / 10
Refusals: 1
9.00 / 10
8.40 / 10
9.40 / 10
8.30 / 10
9.00 / 10
9.11 / 10
Refusals: 1
9.10 / 10
9.30 / 10
9.20 / 10
8.70 / 10
9.00 / 10
8.30 / 10
9.30 / 10
8.30 / 10
7.90 / 10
8.60 / 10
8.00 / 10
8.50 / 10
8.40 / 10
8.00 / 10
7.80 / 10
(10 examples)
Avg Score: 7.76
Avg Score: 7.76
2 9.10 / 10
8.90 / 10
2 9.10 / 10
3 9.00 / 10
8.40 / 10
8.10 / 10
8.10 / 10
8.20 / 10
8.50 / 10
8.00 / 10
8.40 / 10
8.60 / 10
7.90 / 10
8.90 / 10
1 9.12 / 10
Refusals: 2
7.60 / 10
8.00 / 10
7.70 / 10
7.70 / 10
7.60 / 10
8.00 / 10
6.20 / 10
6.80 / 10
7.30 / 10
5.30 / 10
8.10 / 10
6.90 / 10
8.50 / 10
6.70 / 10
6.30 / 10
7.20 / 10
6.20 / 10
6.00 / 10
(10 examples)
Avg Score: 8.60
Avg Score: 8.60
2 9.70 / 10
1 10.00 / 10
9.10 / 10
9.40 / 10
9.20 / 10
9.20 / 10
9.10 / 10
3 9.60 / 10
3 9.60 / 10
9.10 / 10
9.50 / 10
8.50 / 10
9.20 / 10
9.30 / 10
9.33 / 10
Refusals: 1
8.60 / 10
8.70 / 10
8.30 / 10
9.40 / 10
8.90 / 10
8.00 / 10
8.30 / 10
9.00 / 10
7.80 / 10
8.50 / 10
7.40 / 10
8.60 / 10
7.30 / 10
8.10 / 10
8.20 / 10
7.20 / 10
5.00 / 10
6.90 / 10
(10 examples)
Avg Score: 6.60
Avg Score: 6.60
3 8.60 / 10
7.10 / 10
1 8.90 / 10
7.80 / 10
8.10 / 10
7.89 / 10
Refusals: 1
2 8.70 / 10
7.20 / 10
7.00 / 10
7.38 / 10
Refusals: 2
6.50 / 10
6.40 / 10
6.70 / 10
7.50 / 10
7.38 / 10
Refusals: 2
7.50 / 10
6.90 / 10
7.33 / 10
Refusals: 1
5.30 / 10
5.70 / 10
6.60 / 10
6.30 / 10
5.30 / 10
6.29 / 10
Refusals: 3
5.40 / 10
5.40 / 10
6.00 / 10
5.80 / 10
5.30 / 10
5.80 / 10
5.30 / 10
4.10 / 10
4.90 / 10