ImageBench

vs

192 evaluations across 6 categories

Benchmark V1 verdicts are produced by VLM judges and can contain mistakes. Treat PASS/FAIL labels as machine-assisted assessments, and inspect the images yourself. Learn more about the methodology.

Generation Details

Source-backed model context, size, cost, and request settings for this ImageBench V1 run.

bfl/flux-2-max

API

FLUX.2 Max is Black Forest Labs' higher-capacity FLUX.2 tier, described as a top-end generation model with support for stronger visual output and, when prompted, grounding search for current visual context.

Maker
Black Forest Labs
Family
FLUX.2
Model Size
not disclosed
unknown
Cost
from $0.07 / image
high
Run Target
bfl/flux-2-max
Effective Request
aspect_ratio: 1:1
Sources
Black Forest Labs FLUX.2 overviewBFL FLUX.2 pricingBlack Forest Labs pricing

fal/bytedance/seedream-v5-pro

API

Seedream 5.0 Pro is ByteDance Seed's flagship Seedream 5.0 text-to-image model, generating high-resolution images with strong prompt adherence; served here through fal.

Maker
ByteDance Seed
Family
Seedream 5.0
Model Size
not disclosed
unknown
Cost
from $0.0675 / image
medium
Run Target
fal/bytedance/seedream/v5/pro/text-to-image
Effective Request
seed: 7
Sources
Seedream 5.0 Pro on fal
59.6vs65.4
Overall
63%vs70%
Capability
56.6vs60.9
Est. Preference
26.7svs147.4s
Avg Latency
Text Rendering93%93%Spatial Reasoning75%81%Human realism24%36%Truthfulness41%56%Professional Studio89%93%Graphical design75%83%Preference57%61%Latency3%0%

All 192 generations

Text Rendering93%vs100%

bfl/flux-2-maxfal/bytedance/seedream-v5-pro

Typography Style100%vs100%

Writing accuracy92%vs100%

Spatial Reasoning75%vs81%

bfl/flux-2-maxfal/bytedance/seedream-v5-pro

Attributes Binding89%vs89%

Compositionality89%vs89%

Counting44%vs78%

Negation89%vs100%

Relative Position83%vs67%

Scale & Proportions56%vs67%

Human realism24%vs36%

bfl/flux-2-maxfal/bytedance/seedream-v5-pro

Faces & Expressions83%vs75%

Full Body0%vs17%

Hands0%vs8%

Multi-Subject0%vs50%

Truthfulness41%vs56%

bfl/flux-2-maxfal/bytedance/seedream-v5-pro

Photorealism0%vs67%

Physics & Reflections50%vs58%

World Knowledge42%vs50%

Professional Studio89%vs93%

bfl/flux-2-maxfal/bytedance/seedream-v5-pro

Camera & Lighting92%vs83%

Color Precision83%vs100%

Photorealism100%vs100%

Graphical design75%vs83%

bfl/flux-2-maxfal/bytedance/seedream-v5-pro

Data Visualisation0%vs67%

Layout & Design78%vs89%

Style Diversity92%vs83%