ImageBench

vs

192 evaluations across 6 categories

Benchmark V1 verdicts are produced by VLM judges and can contain mistakes. Treat PASS/FAIL labels as machine-assisted assessments, and inspect the images yourself. Learn more about the methodology.

Generation Details

Source-backed model context, size, cost, and request settings for this ImageBench V1 run.

bfl/flux-2-pro

API

FLUX.2 Pro is a hosted Black Forest Labs FLUX.2 model for premium image generation workloads, using the same FLUX.2 family emphasis on prompt following, image quality, and production-oriented generation.

Maker
Black Forest Labs
Family
FLUX.2
Model Size
not disclosed
unknown
Cost
from $0.03 / image
high
Run Target
bfl/flux-2-pro
Effective Request
aspect_ratio: 1:1

fal/microsoft/mai-image-2.5

API

MAI-Image-2.5 is Microsoft AI’s flagship photorealistic text-to-image and editing model, built for high-quality generation and controllable, identity-preserving edits at production scale. Strong at readable embedded text, composition, and studio/product visuals; ships a faster MAI-Image-2.5-Flash variant. Places top-3 on Arena.ai T2I. Note: a strict content filter refuses some benign prompts (e.g. involving children).

Maker
Microsoft
Family
MAI-Image
Model Size
not disclosed
unknown
Cost
~$0.05 / image
medium
Run Target
fal/microsoft/mai-image-2.5
Effective Request
aspect_ratio: 1:1 · num_images: 1 · output_format: png
60.1vs65.7
Overall
63%vs65%
Capability
57.3vs66.8
Est. Preference
11.8svs25.4s
Avg Latency
Text Rendering80%80%Spatial Reasoning75%77%Human realism31%33%Truthfulness44%44%Professional Studio85%85%Graphical design75%79%Preference57%67%Latency27%5%

All 192 generations

Text Rendering80%vs86%

bfl/flux-2-profal/microsoft/mai-image-2.5

Typography Style100%vs100%

Writing accuracy75%vs82%

Spatial Reasoning75%vs79%

bfl/flux-2-profal/microsoft/mai-image-2.5

Attributes Binding78%vs89%

Compositionality89%vs89%

Counting56%vs56%

Negation89%vs78%

Relative Position67%vs83%

Scale & Proportions78%vs75%

Human realism31%vs35%

bfl/flux-2-profal/microsoft/mai-image-2.5

Faces & Expressions67%vs91%

Full Body25%vs0%

Hands8%vs0%

Multi-Subject17%vs67%

Truthfulness44%vs44%

bfl/flux-2-profal/microsoft/mai-image-2.5

Photorealism33%vs67%

Physics & Reflections50%vs42%

World Knowledge42%vs42%

Professional Studio85%vs85%

bfl/flux-2-profal/microsoft/mai-image-2.5

Camera & Lighting83%vs75%

Color Precision92%vs92%

Photorealism67%vs100%

Graphical design75%vs83%

bfl/flux-2-profal/microsoft/mai-image-2.5

Data Visualisation0%vs33%

Layout & Design78%vs89%

Style Diversity92%vs91%