ImageBench

vs

192 evaluations across 6 categories

Benchmark V1 verdicts are produced by VLM judges and can contain mistakes. Treat PASS/FAIL labels as machine-assisted assessments, and inspect the images yourself. Learn more about the methodology.

Generation Details

Source-backed model context, size, cost, and request settings for this ImageBench V1 run.

openai/gpt-image-2

API

GPT Image 2 is OpenAI's current image generation and editing model for fast, high-quality image creation, with flexible image sizes and high-fidelity image inputs through the OpenAI Images API.

Maker
OpenAI
Family
GPT Image
Model Size
not disclosed
unknown
Cost
token-based
high
Run Target
openai/gpt-image-2
Effective Request
model: gpt-image-2 · size: 1024x1024 · quality: auto

xai/grok-imagine-2

API

Grok Imagine Image 2.0 is xAI's text-to-image model (released Aug 2026), emphasizing photorealism, natural lighting, physics, and textures. Served via xAI's first-party API (OpenAI-images-compatible). The first xAI model on this board.

Maker
xAI
Family
Grok Imagine 2.0
Model Size
not disclosed
unknown
Cost
$0.04 / image
high
Run Target
xai/grok-imagine-image-2.0
Effective Request
aspect_ratio: 1:1 · resolution: 1k
80.0vs73.6
Overall
87%vs76%
Capability
73.0vs71.6
Est. Preference
45.3svs69.0s
Avg Latency
Text Rendering100%100%Spatial Reasoning91%90%Human realism69%38%Truthfulness74%56%Professional Studio100%100%Graphical design100%88%Preference73%72%Latency0%0%

All 192 generations

Text Rendering100%vs100%

openai/gpt-image-2xai/grok-imagine-2.0

Typography Style100%vs100%

Writing accuracy100%vs100%

Spatial Reasoning91%vs89%

openai/gpt-image-2xai/grok-imagine-2.0

Attributes Binding100%vs100%

Compositionality100%vs100%

Counting89%vs100%

Negation100%vs100%

Relative Position83%vs75%

Scale & Proportions78%vs67%

Human realism69%vs38%

openai/gpt-image-2xai/grok-imagine-2.0

Faces & Expressions92%vs83%

Full Body17%vs8%

Hands83%vs17%

Multi-Subject100%vs50%

Truthfulness74%vs56%

openai/gpt-image-2xai/grok-imagine-2.0

Photorealism100%vs100%

Physics & Reflections58%vs42%

World Knowledge83%vs58%

Professional Studio100%vs100%

openai/gpt-image-2xai/grok-imagine-2.0

Camera & Lighting100%vs100%

Color Precision100%vs100%

Photorealism100%vs100%

Graphical design100%vs88%

openai/gpt-image-2xai/grok-imagine-2.0

Layout & Design100%vs100%

Data Visualisation100%vs67%

Style Diversity100%vs83%