ImageBench

vs

192 evaluations across 6 categories

Benchmark V1 verdicts are produced by VLM judges and can contain mistakes. Treat PASS/FAIL labels as machine-assisted assessments, and inspect the images yourself. Learn more about the methodology.

Generation Details

Source-backed model context, size, cost, and request settings for this ImageBench V1 run.

openai/gpt-image-2

API

GPT Image 2 is OpenAI's current image generation and editing model for fast, high-quality image creation, with flexible image sizes and high-fidelity image inputs through the OpenAI Images API.

Maker
OpenAI
Family
GPT Image
Model Size
not disclosed
unknown
Cost
token-based
high
Run Target
openai/gpt-image-2
Effective Request
model: gpt-image-2 · size: 1024x1024 · quality: auto

fal/microsoft/mai-image-2.5

API

MAI-Image-2.5 is Microsoft AI’s flagship photorealistic text-to-image and editing model, built for high-quality generation and controllable, identity-preserving edits at production scale. Strong at readable embedded text, composition, and studio/product visuals; ships a faster MAI-Image-2.5-Flash variant. Places top-3 on Arena.ai T2I. Note: a strict content filter refuses some benign prompts (e.g. involving children).

Maker
Microsoft
Family
MAI-Image
Model Size
not disclosed
unknown
Cost
~$0.05 / image
medium
Run Target
fal/microsoft/mai-image-2.5
Effective Request
aspect_ratio: 1:1 · num_images: 1 · output_format: png
78.5vs65.7
Overall
84%vs65%
Capability
73.0vs66.8
Est. Preference
45.3svs25.4s
Avg Latency
Text Rendering100%80%Spatial Reasoning91%77%Human realism55%33%Truthfulness74%44%Professional Studio100%85%Graphical design100%79%Preference73%67%Latency0%5%

All 192 generations

Text Rendering100%vs86%

openai/gpt-image-2fal/microsoft/mai-image-2.5

Typography Style100%vs100%

Writing accuracy100%vs82%

Spatial Reasoning91%vs79%

openai/gpt-image-2fal/microsoft/mai-image-2.5

Attributes Binding100%vs89%

Compositionality100%vs89%

Counting89%vs56%

Negation100%vs78%

Relative Position83%vs83%

Scale & Proportions78%vs75%

Human realism55%vs35%

openai/gpt-image-2fal/microsoft/mai-image-2.5

Faces & Expressions92%vs91%

Full Body17%vs0%

Hands33%vs0%

Multi-Subject100%vs67%

Truthfulness74%vs44%

openai/gpt-image-2fal/microsoft/mai-image-2.5

Photorealism100%vs67%

Physics & Reflections58%vs42%

World Knowledge83%vs42%

Professional Studio100%vs85%

openai/gpt-image-2fal/microsoft/mai-image-2.5

Camera & Lighting100%vs75%

Color Precision100%vs92%

Photorealism100%vs100%

Graphical design100%vs83%

openai/gpt-image-2fal/microsoft/mai-image-2.5

Layout & Design100%vs89%

Data Visualisation100%vs33%

Style Diversity100%vs91%