ImageBench

ImageBench V1 —

192 evaluations across 6 categories

Benchmark V1 verdicts are produced by VLM judges and can contain mistakes. Treat PASS/FAIL labels as machine-assisted assessments, and inspect the images yourself. Learn more about the methodology.

Generation Details

Source-backed model context, size, cost, and request settings for this ImageBench V1 run.

openai/gpt-image-2

API

GPT Image 2 is OpenAI's current image generation and editing model for fast, high-quality image creation, with flexible image sizes and high-fidelity image inputs through the OpenAI Images API.

Maker
OpenAI
Family
GPT Image
Model Size
not disclosed
unknown
Cost
token-based
high
Run Target
openai/gpt-image-2
Effective Request
model: gpt-image-2 · size: 1024x1024 · quality: auto
Sources
GPT Image 2 model docsOpenAI image generation guideOpenAI API pricing
78.5
Overall
84%
Capability
73.0
Est. Preference
161
Pass
31
Fail
45.3s
Avg Latency
12.5s
Min Latency
159.3s
Max Latency
Text Rendering100%Spatial Reasoning91%Human realism55%Truthfulness74%Professional Studio100%Graphical design100%Preference73%Latency0%

All 192 generations

Text Rendering100%

Typography Style100%

Writing accuracy100%

Spatial Reasoning91%

Attributes Binding100%

Compositionality100%

Counting89%

Negation100%

Relative Position83%

Scale & Proportions78%

Human realism55%

Faces & Expressions92%

Full Body17%

Hands33%

Multi-Subject100%

Truthfulness74%

Photorealism100%

Physics & Reflections58%

World Knowledge83%

Professional Studio100%

Camera & Lighting100%

Color Precision100%

Photorealism100%

Graphical design100%

Layout & Design100%

Data Visualisation100%

Style Diversity100%