Model Comparison Leaderboard
Category
Google
Imagen 4.0 Ultra
OpenAI
GPT Image 2
OpenAI
ChatGPT 4o
XAI
Grok Imagine
Black Forest Labs
Flux 2 Pro
OpenAI
GPT Image 1.5
Bytedance
Seedream 4.0
Black Forest Labs
FLUX.1 Kontext Max
Bytedance
Seedream 4.5
Ideogram
Ideogram 3.0 (Quality)
Google
Imagen 3.0
Google
Nano Banana (2.5 Flash)
Google
Nano Banana 2
Bytedance
Seedream 3.0
Google
Nano Banana Pro
Ideogram
Ideogram V2
Alibaba
Z-Image Turbo
Minimax
MiniMax Image-01
Black Forest Labs
Flux 1.1 Pro Ultra
Recraft
Recraft V3
OpenAI
DALL-E 3
Reve
Reve Image (Halfmoon)
Midjourney
Midjourney V6.1
Midjourney
Midjourney v7
XAI
Grok 2 Image
Prompt Adherence
(100 examples)
Avg: 9.25 / 10
Avg: 9.08 / 10
Refusals: 12
Avg: 9.06 / 10
Refusals: 11
Avg: 9.05 / 10
Avg: 8.93 / 10
Refusals: 1
Avg: 8.88 / 10
Refusals: 11
Avg: 8.83 / 10
Avg: 8.79 / 10
Refusals: 6
Avg: 8.73 / 10
Avg: 8.59 / 10
Avg: 8.54 / 10
Refusals: 3
Avg: 8.51 / 10
Avg: 8.48 / 10
Avg: 8.44 / 10
Avg: 8.33 / 10
Avg: 8.11 / 10
Avg: 7.95 / 10
Avg: 7.88 / 10
Avg: 7.84 / 10
Refusals: 1
Avg: 7.68 / 10
Avg: 7.37 / 10
Avg: 7.11 / 10
Avg: 7.00 / 10
Refusals: 2
Avg: 6.48 / 10
Refusals: 2
Avg: 5.74 / 10
Refusals: 1
(10 examples)
Avg Score: 8.67
Avg Score: 8.67
9.90 / 10
9.43 / 10
Refusals: 3
9.62 / 10
Refusals: 2
8.50 / 10
8.90 / 10
9.38 / 10
Refusals: 2
8.80 / 10
9.10 / 10
9.10 / 10
9.30 / 10
9.20 / 10
9.10 / 10
9.20 / 10
9.50 / 10
8.70 / 10
8.90 / 10
8.40 / 10
8.30 / 10
8.60 / 10
8.40 / 10
8.30 / 10
7.40 / 10
7.70 / 10
7.70 / 10
5.90 / 10
(10 examples)
Avg Score: 8.62
Avg Score: 8.62
9.60 / 10
9.10 / 10
9.29 / 10
Refusals: 3
9.70 / 10
9.90 / 10
9.00 / 10
9.70 / 10
9.30 / 10
9.10 / 10
9.10 / 10
9.20 / 10
8.30 / 10
8.90 / 10
9.60 / 10
7.90 / 10
8.90 / 10
7.60 / 10
9.70 / 10
8.70 / 10
8.80 / 10
8.00 / 10
6.80 / 10
7.70 / 10
6.50 / 10
5.20 / 10
(10 examples)
Avg Score: 8.88
Avg Score: 8.88
9.90 / 10
9.50 / 10
9.44 / 10
Refusals: 1
9.70 / 10
9.44 / 10
Refusals: 1
9.67 / 10
Refusals: 1
9.70 / 10
9.44 / 10
Refusals: 1
9.60 / 10
9.20 / 10
9.38 / 10
Refusals: 2
9.20 / 10
9.10 / 10
9.20 / 10
9.10 / 10
9.20 / 10
9.00 / 10
8.40 / 10
8.56 / 10
Refusals: 1
8.10 / 10
8.40 / 10
7.60 / 10
8.00 / 10
6.50 / 10
6.67 / 10
Refusals: 1
(10 examples)
Avg Score: 7.30
Avg Score: 7.30
8.40 / 10
9.00 / 10
Refusals: 9
8.43 / 10
Refusals: 3
8.50 / 10
8.60 / 10
9.33 / 10
Refusals: 7
7.90 / 10
8.38 / 10
Refusals: 2
7.80 / 10
7.30 / 10
8.10 / 10
8.80 / 10
8.50 / 10
8.00 / 10
9.00 / 10
6.00 / 10
7.50 / 10
6.10 / 10
5.80 / 10
6.00 / 10
5.20 / 10
5.80 / 10
7.12 / 10
Refusals: 2
6.12 / 10
Refusals: 2
4.10 / 10
(10 examples)
Avg Score: 8.22
Avg Score: 8.22
9.60 / 10
9.30 / 10
9.70 / 10
9.80 / 10
9.40 / 10
7.70 / 10
9.10 / 10
9.00 / 10
9.20 / 10
8.80 / 10
7.40 / 10
8.50 / 10
8.40 / 10
7.20 / 10
7.70 / 10
8.30 / 10
8.40 / 10
7.30 / 10
8.00 / 10
8.70 / 10
7.50 / 10
8.10 / 10
5.30 / 10
6.60 / 10
6.40 / 10
(10 examples)
Avg Score: 8.23
Avg Score: 8.23
9.30 / 10
8.70 / 10
9.00 / 10
9.50 / 10
8.80 / 10
8.44 / 10
Refusals: 1
8.20 / 10
8.80 / 10
7.90 / 10
9.30 / 10
9.00 / 10
8.00 / 10
8.00 / 10
9.00 / 10
8.00 / 10
8.30 / 10
9.10 / 10
8.80 / 10
8.70 / 10
8.30 / 10
6.10 / 10
7.80 / 10
6.10 / 10
6.90 / 10
5.70 / 10
(10 examples)
Avg Score: 8.98
Avg Score: 8.98
9.80 / 10
9.00 / 10
9.44 / 10
Refusals: 1
9.40 / 10
9.90 / 10
9.60 / 10
9.90 / 10
9.80 / 10
9.50 / 10
9.10 / 10
9.89 / 10
Refusals: 1
9.30 / 10
8.00 / 10
9.10 / 10
8.40 / 10
9.10 / 10
8.70 / 10
9.20 / 10
9.00 / 10
9.30 / 10
8.60 / 10
7.50 / 10
8.40 / 10
7.90 / 10
6.90 / 10
(10 examples)
Avg Score: 7.71
Avg Score: 7.71
8.90 / 10
9.30 / 10
8.50 / 10
8.60 / 10
8.30 / 10
9.00 / 10
8.20 / 10
7.50 / 10
8.50 / 10
7.90 / 10
8.60 / 10
8.20 / 10
8.30 / 10
8.70 / 10
7.80 / 10
7.70 / 10
6.20 / 10
7.10 / 10
6.80 / 10
5.30 / 10
8.50 / 10
6.30 / 10
7.20 / 10
6.20 / 10
5.20 / 10
(10 examples)
Avg Score: 8.64
Avg Score: 8.64
10.00 / 10
9.30 / 10
9.40 / 10
9.70 / 10
9.20 / 10
8.60 / 10
9.60 / 10
9.30 / 10
9.60 / 10
9.20 / 10
8.50 / 10
8.90 / 10
9.00 / 10
8.60 / 10
8.70 / 10
9.40 / 10
8.30 / 10
8.90 / 10
9.00 / 10
8.50 / 10
7.30 / 10
8.00 / 10
7.20 / 10
5.30 / 10
6.40 / 10
(10 examples)
Avg Score: 6.44
Avg Score: 6.44
7.10 / 10
8.20 / 10
7.67 / 10
Refusals: 1
7.10 / 10
6.90 / 10
8.50 / 10
7.20 / 10
6.57 / 10
Refusals: 3
7.00 / 10
6.70 / 10
6.40 / 10
6.80 / 10
7.40 / 10
5.50 / 10
8.00 / 10
5.30 / 10
6.30 / 10
5.00 / 10
5.30 / 10
5.40 / 10
5.80 / 10
5.80 / 10
5.30 / 10
5.00 / 10
5.00 / 10