ImageBench

vs

192 evaluations across 6 categories

Benchmark V1 verdicts are produced by VLM judges and can contain mistakes. Treat PASS/FAIL labels as machine-assisted assessments, and inspect the images yourself. Learn more about the methodology.

Generation Details

Source-backed model context, size, cost, and request settings for this ImageBench V1 run.

xai/grok-imagine-2

API

Grok Imagine Image 2.0 is xAI's text-to-image model (released Aug 2026), emphasizing photorealism, natural lighting, physics, and textures. Served via xAI's first-party API (OpenAI-images-compatible). The first xAI model on this board.

Maker
xAI
Family
Grok Imagine 2.0
Model Size
not disclosed
unknown
Cost
$0.04 / image
high
Run Target
xai/grok-imagine-image-2.0
Effective Request
aspect_ratio: 1:1 · resolution: 1k

openai/gpt-image-2.5-sunburst

API

GPT Image 2.5 Sunburst is one of two API variants OpenAI released alongside ChatGPT Images 2.5 (September 2026), built for workflows where editing precision matters most.

Maker
OpenAI
Family
GPT Image
Model Size
not disclosed
unknown
Cost
token-based
high
Run Target
openai/gpt-image-2.5-sunburst
Effective Request
model: gpt-image-2.5-sunburst · size: 1024x1024 · quality: auto
73.6vs82.1
Overall
76%vs88%
Capability
71.6vs76.2
Est. Preference
69.0svs16.9s
Avg Latency
Text Rendering100%100%Spatial Reasoning90%98%Human realism38%67%Truthfulness56%78%Professional Studio100%96%Graphical design88%96%Preference72%76%Latency0%17%

All 192 generations

Text Rendering100%vs100%

xai/grok-imagine-2.0openai/gpt-image-2.5-sunburst

Typography Style100%vs100%

Writing accuracy100%vs100%

Spatial Reasoning89%vs98%

xai/grok-imagine-2.0openai/gpt-image-2.5-sunburst

Attributes Binding100%vs100%

Compositionality100%vs100%

Counting100%vs100%

Negation100%vs100%

Relative Position75%vs100%

Scale & Proportions67%vs89%

Human realism38%vs70%

xai/grok-imagine-2.0openai/gpt-image-2.5-sunburst

Faces & Expressions83%vs100%

Full Body8%vs36%

Hands17%vs67%

Multi-Subject50%vs83%

Truthfulness56%vs78%

xai/grok-imagine-2.0openai/gpt-image-2.5-sunburst

Photorealism100%vs67%

Physics & Reflections42%vs75%

World Knowledge58%vs83%

Professional Studio100%vs96%

xai/grok-imagine-2.0openai/gpt-image-2.5-sunburst

Camera & Lighting100%vs100%

Color Precision100%vs100%

Photorealism100%vs67%

Graphical design88%vs96%

xai/grok-imagine-2.0openai/gpt-image-2.5-sunburst

Data Visualisation67%vs100%

Layout & Design100%vs89%

Style Diversity83%vs100%

Grok Imagine 2.0 vs GPT Image 2.5 Sunburst: frequently asked questions