ImageBench

vs

192 evaluations across 6 categories

Benchmark V1 verdicts are produced by VLM judges and can contain mistakes. Treat PASS/FAIL labels as machine-assisted assessments, and inspect the images yourself. Learn more about the methodology.

Generation Details

Source-backed model context, size, cost, and request settings for this ImageBench V1 run.

xai/grok-imagine-2

API

Grok Imagine Image 2.0 is xAI's text-to-image model (released Aug 2026), emphasizing photorealism, natural lighting, physics, and textures. Served via xAI's first-party API (OpenAI-images-compatible). The first xAI model on this board.

Maker
xAI
Family
Grok Imagine 2.0
Model Size
not disclosed
unknown
Cost
$0.04 / image
high
Run Target
xai/grok-imagine-image-2.0
Effective Request
aspect_ratio: 1:1 · resolution: 1k

openai/gpt-image-2.5-flare

API

GPT Image 2.5 Flare is one of two API variants OpenAI released alongside ChatGPT Images 2.5 (September 2026), positioned as OpenAI's fastest model for high-quality, everyday image generation.

Maker
OpenAI
Family
GPT Image
Model Size
not disclosed
unknown
Cost
token-based
high
Run Target
openai/gpt-image-2.5-flare
Effective Request
model: gpt-image-2.5-flare · size: 1024x1024 · quality: auto
73.6vs81.5
Overall
76%vs87%
Capability
71.6vs76.5
Est. Preference
69.0svs13.2s
Avg Latency
Text Rendering100%100%Spatial Reasoning90%95%Human realism38%55%Truthfulness56%85%Professional Studio100%100%Graphical design88%100%Preference72%77%Latency0%24%

All 192 generations

Text Rendering100%vs100%

xai/grok-imagine-2.0openai/gpt-image-2.5-flare

Typography Style100%vs100%

Writing accuracy100%vs100%

Spatial Reasoning89%vs95%

xai/grok-imagine-2.0openai/gpt-image-2.5-flare

Attributes Binding100%vs100%

Compositionality100%vs100%

Counting100%vs100%

Negation100%vs100%

Relative Position75%vs100%

Scale & Proportions67%vs67%

Human realism38%vs55%

xai/grok-imagine-2.0openai/gpt-image-2.5-flare

Faces & Expressions83%vs92%

Full Body8%vs8%

Hands17%vs67%

Multi-Subject50%vs50%

Truthfulness56%vs85%

xai/grok-imagine-2.0openai/gpt-image-2.5-flare

Photorealism100%vs100%

Physics & Reflections42%vs75%

World Knowledge58%vs92%

Professional Studio100%vs100%

xai/grok-imagine-2.0openai/gpt-image-2.5-flare

Camera & Lighting100%vs100%

Color Precision100%vs100%

Photorealism100%vs100%

Graphical design88%vs100%

xai/grok-imagine-2.0openai/gpt-image-2.5-flare

Data Visualisation67%vs100%

Layout & Design100%vs100%

Style Diversity83%vs100%

Grok Imagine 2.0 vs GPT Image 2.5 Flare: frequently asked questions