Model Comparison Leaderboard
Category
XAI
Grok Imagine
Black Forest Labs
Flux 2 Pro
OpenAI
GPT Image 2
Bytedance
Seedream 4.0
Bytedance
Seedream 4.5
Google
Imagen 4.0 Ultra
Ideogram
Ideogram 3.0 (Quality)
Google
Imagen 3.0
OpenAI
ChatGPT 4o
Black Forest Labs
Flux 1.1 Pro Ultra
Recraft
Recraft V3
Bytedance
Seedream 3.0
Alibaba
Z-Image Turbo
OpenAI
GPT Image 1.5
Black Forest Labs
FLUX.1 Kontext Max
Google
Nano Banana 2
Minimax
MiniMax Image-01
Google
Nano Banana (2.5 Flash)
OpenAI
DALL-E 3
Ideogram
Ideogram V2
Midjourney
Midjourney V6.1
Midjourney
Midjourney v7
Google
Nano Banana Pro
Reve
Reve Image (Halfmoon)
XAI
Grok 2 Image
Technical Quality
(100 examples)
Avg: 8.78 / 10
Avg: 8.70 / 10
Refusals: 1
Avg: 8.65 / 10
Refusals: 12
Avg: 8.62 / 10
Avg: 8.60 / 10
Avg: 8.56 / 10
Avg: 8.54 / 10
Avg: 8.48 / 10
Refusals: 3
Avg: 8.42 / 10
Refusals: 11
Avg: 8.36 / 10
Refusals: 1
Avg: 8.36 / 10
Avg: 8.35 / 10
Avg: 8.34 / 10
Avg: 8.33 / 10
Refusals: 11
Avg: 8.32 / 10
Refusals: 6
Avg: 8.30 / 10
Avg: 8.30 / 10
Avg: 8.06 / 10
Avg: 8.01 / 10
Avg: 7.93 / 10
Avg: 7.84 / 10
Refusals: 2
Avg: 7.62 / 10
Refusals: 2
Avg: 7.57 / 10
Avg: 7.29 / 10
Avg: 6.32 / 10
Refusals: 1
(10 examples)
Avg Score: 8.25
Avg Score: 8.25
9.10 / 10
8.70 / 10
8.86 / 10
Refusals: 3
9.10 / 10
9.00 / 10
8.70 / 10
8.50 / 10
8.30 / 10
8.00 / 10
Refusals: 2
8.10 / 10
7.50 / 10
8.30 / 10
8.60 / 10
8.50 / 10
Refusals: 2
8.50 / 10
8.40 / 10
8.80 / 10
8.30 / 10
8.60 / 10
7.40 / 10
8.20 / 10
7.50 / 10
7.30 / 10
7.90 / 10
6.30 / 10
(10 examples)
Avg Score: 8.32
Avg Score: 8.32
9.00 / 10
9.10 / 10
8.70 / 10
9.00 / 10
8.90 / 10
8.80 / 10
8.50 / 10
8.50 / 10
8.86 / 10
Refusals: 3
8.40 / 10
8.50 / 10
8.90 / 10
8.40 / 10
8.50 / 10
8.40 / 10
8.60 / 10
8.80 / 10
8.10 / 10
8.10 / 10
8.20 / 10
7.70 / 10
7.50 / 10
7.60 / 10
6.90 / 10
6.10 / 10
(10 examples)
Avg Score: 7.96
Avg Score: 7.96
8.90 / 10
8.22 / 10
Refusals: 1
8.60 / 10
8.30 / 10
8.40 / 10
8.40 / 10
8.30 / 10
8.25 / 10
Refusals: 2
8.11 / 10
Refusals: 1
8.00 / 10
Refusals: 1
7.90 / 10
8.00 / 10
8.30 / 10
8.11 / 10
Refusals: 1
8.00 / 10
Refusals: 1
7.90 / 10
8.00 / 10
7.80 / 10
7.90 / 10
8.10 / 10
8.00 / 10
6.90 / 10
7.50 / 10
7.40 / 10
5.67 / 10
Refusals: 1
(10 examples)
Avg Score: 8.19
Avg Score: 8.19
8.60 / 10
8.70 / 10
9.00 / 10
Refusals: 9
8.20 / 10
8.20 / 10
8.40 / 10
8.20 / 10
8.70 / 10
8.00 / 10
Refusals: 3
8.00 / 10
8.10 / 10
8.40 / 10
8.30 / 10
9.00 / 10
Refusals: 7
8.12 / 10
Refusals: 2
8.50 / 10
8.30 / 10
8.60 / 10
8.00 / 10
6.20 / 10
8.00 / 10
Refusals: 2
8.50 / 10
Refusals: 2
8.40 / 10
7.80 / 10
7.70 / 10
(10 examples)
Avg Score: 8.36
Avg Score: 8.36
9.10 / 10
9.20 / 10
8.90 / 10
9.00 / 10
8.80 / 10
9.20 / 10
9.00 / 10
8.80 / 10
9.00 / 10
8.40 / 10
9.10 / 10
8.30 / 10
8.30 / 10
7.50 / 10
8.60 / 10
8.70 / 10
8.20 / 10
7.80 / 10
8.60 / 10
8.10 / 10
8.10 / 10
7.30 / 10
7.30 / 10
7.60 / 10
6.10 / 10
(10 examples)
Avg Score: 8.04
Avg Score: 8.04
8.70 / 10
8.40 / 10
8.50 / 10
8.30 / 10
8.10 / 10
8.10 / 10
8.60 / 10
8.30 / 10
7.90 / 10
8.60 / 10
8.20 / 10
8.50 / 10
8.10 / 10
8.67 / 10
Refusals: 1
8.20 / 10
7.80 / 10
7.80 / 10
7.70 / 10
7.30 / 10
8.30 / 10
7.40 / 10
8.10 / 10
7.60 / 10
7.90 / 10
6.00 / 10
(10 examples)
Avg Score: 8.40
Avg Score: 8.40
8.60 / 10
8.90 / 10
8.50 / 10
8.50 / 10
8.80 / 10
8.90 / 10
8.70 / 10
9.00 / 10
Refusals: 1
9.11 / 10
Refusals: 1
8.50 / 10
9.20 / 10
8.50 / 10
8.70 / 10
8.70 / 10
8.60 / 10
8.10 / 10
8.30 / 10
8.50 / 10
7.60 / 10
8.70 / 10
8.20 / 10
7.90 / 10
7.60 / 10
7.10 / 10
6.80 / 10
(10 examples)
Avg Score: 8.11
Avg Score: 8.11
8.50 / 10
8.60 / 10
8.70 / 10
8.70 / 10
8.70 / 10
8.00 / 10
8.50 / 10
8.10 / 10
8.20 / 10
8.70 / 10
8.30 / 10
8.60 / 10
7.80 / 10
8.40 / 10
8.40 / 10
8.20 / 10
8.10 / 10
8.20 / 10
8.70 / 10
7.70 / 10
8.00 / 10
7.80 / 10
7.30 / 10
6.60 / 10
5.90 / 10
(10 examples)
Avg Score: 8.30
Avg Score: 8.30
9.10 / 10
8.70 / 10
8.70 / 10
8.60 / 10
8.90 / 10
9.00 / 10
8.70 / 10
8.50 / 10
8.80 / 10
8.70 / 10
8.70 / 10
8.20 / 10
8.80 / 10
8.20 / 10
8.10 / 10
8.70 / 10
8.60 / 10
8.10 / 10
7.60 / 10
8.80 / 10
7.50 / 10
7.00 / 10
7.70 / 10
7.30 / 10
6.50 / 10
(10 examples)
Avg Score: 7.90
Avg Score: 7.90
8.20 / 10
8.40 / 10
8.40 / 10
8.50 / 10
8.20 / 10
8.10 / 10
8.40 / 10
8.40 / 10
8.11 / 10
Refusals: 1
8.20 / 10
8.10 / 10
7.80 / 10
8.10 / 10
8.20 / 10
8.14 / 10
Refusals: 3
8.10 / 10
8.10 / 10
7.50 / 10
7.70 / 10
7.80 / 10
7.30 / 10
7.90 / 10
7.40 / 10
6.40 / 10
6.10 / 10