ImageBench

vs

192 evaluations across 6 categories

Benchmark V1 verdicts are produced by VLM judges and can contain mistakes. Treat PASS/FAIL labels as machine-assisted assessments, and inspect the images yourself. Learn more about the methodology.

Generation Details

Source-backed model context, size, cost, and request settings for this ImageBench V1 run.

bfl/flux-2-pro

API

FLUX.2 Pro is a hosted Black Forest Labs FLUX.2 model for premium image generation workloads, using the same FLUX.2 family emphasis on prompt following, image quality, and production-oriented generation.

Maker
Black Forest Labs
Family
FLUX.2
Model Size
not disclosed
unknown
Cost
from $0.03 / image
high
Run Target
bfl/flux-2-pro
Effective Request
aspect_ratio: 1:1
Sources
Black Forest Labs FLUX.2 overviewBFL FLUX.2 pricingBlack Forest Labs pricing

fal/bytedance/seedream-v5-pro

API

Seedream 5.0 Pro is ByteDance Seed's flagship Seedream 5.0 text-to-image model, generating high-resolution images with strong prompt adherence; served here through fal.

Maker
ByteDance Seed
Family
Seedream 5.0
Model Size
not disclosed
unknown
Cost
from $0.0675 / image
medium
Run Target
fal/bytedance/seedream/v5/pro/text-to-image
Effective Request
seed: 7
Sources
Seedream 5.0 Pro on fal
60.1vs65.4
Overall
63%vs70%
Capability
57.3vs60.9
Est. Preference
11.8svs147.4s
Avg Latency
Text Rendering80%93%Spatial Reasoning75%81%Human realism31%36%Truthfulness44%56%Professional Studio85%93%Graphical design75%83%Preference57%61%Latency27%0%

All 192 generations

Text Rendering80%vs100%

bfl/flux-2-profal/bytedance/seedream-v5-pro

Typography Style100%vs100%

Writing accuracy75%vs100%

Spatial Reasoning75%vs81%

bfl/flux-2-profal/bytedance/seedream-v5-pro

Attributes Binding78%vs89%

Compositionality89%vs89%

Counting56%vs78%

Negation89%vs100%

Relative Position67%vs67%

Scale & Proportions78%vs67%

Human realism31%vs36%

bfl/flux-2-profal/bytedance/seedream-v5-pro

Faces & Expressions67%vs75%

Full Body25%vs17%

Hands8%vs8%

Multi-Subject17%vs50%

Truthfulness44%vs56%

bfl/flux-2-profal/bytedance/seedream-v5-pro

Photorealism33%vs67%

Physics & Reflections50%vs58%

World Knowledge42%vs50%

Professional Studio85%vs93%

bfl/flux-2-profal/bytedance/seedream-v5-pro

Camera & Lighting83%vs83%

Color Precision92%vs100%

Photorealism67%vs100%

Graphical design75%vs83%

bfl/flux-2-profal/bytedance/seedream-v5-pro

Data Visualisation0%vs67%

Layout & Design78%vs89%

Style Diversity92%vs83%