ImageBench

ImageBench V1 —

192 evaluations across 6 categories

Benchmark V1 verdicts are produced by VLM judges and can contain mistakes. Treat PASS/FAIL labels as machine-assisted assessments, and inspect the images yourself. Learn more about the methodology.

Generation Details

Source-backed model context, size, cost, and request settings for this ImageBench V1 run.

fal/microsoft/mai-image-2.5

API

MAI-Image-2.5 is Microsoft AI’s flagship photorealistic text-to-image and editing model, built for high-quality generation and controllable, identity-preserving edits at production scale. Strong at readable embedded text, composition, and studio/product visuals; ships a faster MAI-Image-2.5-Flash variant. Places top-3 on Arena.ai T2I. Note: a strict content filter refuses some benign prompts (e.g. involving children).

Maker
Microsoft
Family
MAI-Image
Model Size
not disclosed
unknown
Cost
~$0.05 / image
medium
Run Target
fal/microsoft/mai-image-2.5
Effective Request
aspect_ratio: 1:1 · num_images: 1 · output_format: png
65.7
Overall
65%
Capability
66.8
Est. Preference
124
Pass
68
Fail
25.4s
Avg Latency
19.0s
Min Latency
51.0s
Max Latency
Text Rendering80%Spatial Reasoning77%Human realism33%Truthfulness44%Professional Studio85%Graphical design79%Preference67%Latency5%

All 192 generations

Text Rendering80%

Typography Style100%

Writing accuracy75%

Spatial Reasoning77%

Attributes Binding89%

Compositionality89%

Counting56%

Negation78%

Relative Position83%

Scale & Proportions67%

Human realism33%

Faces & Expressions83%

Full Body0%

Hands0%

Multi-Subject67%

Truthfulness44%

Photorealism67%

Physics & Reflections42%

World Knowledge42%

Professional Studio85%

Camera & Lighting75%

Color Precision92%

Photorealism100%

Graphical design79%

Data Visualisation33%

Layout & Design89%

Style Diversity83%