ImageBench

vs

192 evaluations across 6 categories

Benchmark V1 verdicts are produced by VLM judges and can contain mistakes. Treat PASS/FAIL labels as machine-assisted assessments, and inspect the images yourself. Learn more about the methodology.

Generation Details

Source-backed model context, size, cost, and request settings for this ImageBench V1 run.

local/mage-flow-turbo

Local

Mage-Flow-Turbo is Microsoft Research Asia’s 4B MIT-licensed native-resolution text-to-image model — a 4-step distilled rectified-flow DiT paired with the lightweight high-fidelity Mage-VAE and a Qwen3-VL text encoder. It generates any aspect ratio from 512 to 2048 px and claims a GenEval lead over FLUX.2 while matching much larger models at a fraction of the size.

Maker
Microsoft
Family
Mage-Flow
Model Size
4B
high
Cost
local run; no API price
not_applicable
Run Target
gx10/mage-flow-turbo
Effective Request
response_format: b64_json · size: 1024x1024 · num_inference_steps: 4 · guidance_scale: 1 · seed: 7
51.8vs49.9
Overall
51%vs54%
Capability
53.2vs45.6
Est. Preference
3.8svs4.6s
Avg Latency
Text Rendering40%67%Spatial Reasoning54%49%Human realism43%52%Truthfulness26%37%Professional Studio89%85%Graphical design46%46%Preference53%46%Latency61%55%

All 192 generations

Text Rendering40%vs67%

bfl/flux-2-klein-4blocal/mage-flow-turbo

Typography Style100%vs67%

Writing accuracy25%vs67%

Spatial Reasoning54%vs49%

bfl/flux-2-klein-4blocal/mage-flow-turbo

Attributes Binding67%vs56%

Compositionality67%vs67%

Counting33%vs22%

Negation56%vs33%

Relative Position50%vs67%

Scale & Proportions56%vs44%

Human realism43%vs52%

bfl/flux-2-klein-4blocal/mage-flow-turbo

Faces & Expressions50%vs67%

Full Body8%vs17%

Hands67%vs83%

Multi-Subject50%vs33%

Truthfulness26%vs37%

bfl/flux-2-klein-4blocal/mage-flow-turbo

Photorealism0%vs33%

Physics & Reflections42%vs58%

World Knowledge17%vs17%

Professional Studio89%vs85%

bfl/flux-2-klein-4blocal/mage-flow-turbo

Camera & Lighting83%vs83%

Color Precision100%vs92%

Photorealism67%vs67%

Graphical design46%vs46%

bfl/flux-2-klein-4blocal/mage-flow-turbo

Data Visualisation0%vs0%

Layout & Design11%vs11%

Style Diversity83%vs83%