ImageBench

vs

192 evaluations across 6 categories

Benchmark V1 verdicts are produced by VLM judges and can contain mistakes. Treat PASS/FAIL labels as machine-assisted assessments, and inspect the images yourself. Learn more about the methodology.

Generation Details

Source-backed model context, size, cost, and request settings for this ImageBench V1 run.

bfl/flux-2-pro

API

FLUX.2 Pro is a hosted Black Forest Labs FLUX.2 model for premium image generation workloads, using the same FLUX.2 family emphasis on prompt following, image quality, and production-oriented generation.

Maker
Black Forest Labs
Family
FLUX.2
Model Size
not disclosed
unknown
Cost
from $0.03 / image
high
Run Target
bfl/flux-2-pro
Effective Request
aspect_ratio: 1:1

fal/bytedance/seedream-v4

API

Seedream 4.0 is ByteDance Seed's unified image creation model for text-to-image and editing, aimed at multimodal generation, reference consistency, knowledge-based prompts, and high-resolution output.

Maker
ByteDance Seed
Family
Seedream
Model Size
not disclosed
unknown
Cost
$0.03 / image
high
Run Target
fal/fal-ai/bytedance/seedream/v4/text-to-image
Effective Request
image_size: square_hd · num_images: 1 · seed: 7
60.1vs59.4
Overall
63%vs63%
Capability
57.3vs56.2
Est. Preference
11.8svs14.1s
Avg Latency
Text Rendering80%87%Spatial Reasoning75%75%Human realism31%33%Truthfulness44%41%Professional Studio85%74%Graphical design75%79%Preference57%56%Latency27%22%

All 192 generations

Text Rendering80%vs87%

bfl/flux-2-profal/bytedance/seedream-v4

Typography Style100%vs100%

Writing accuracy75%vs83%

Spatial Reasoning75%vs75%

bfl/flux-2-profal/bytedance/seedream-v4

Attributes Binding78%vs100%

Compositionality89%vs89%

Counting56%vs56%

Negation89%vs56%

Relative Position67%vs83%

Scale & Proportions78%vs67%

Human realism31%vs33%

bfl/flux-2-profal/bytedance/seedream-v4

Faces & Expressions67%vs83%

Full Body25%vs8%

Hands8%vs0%

Multi-Subject17%vs50%

Truthfulness44%vs41%

bfl/flux-2-profal/bytedance/seedream-v4

Photorealism33%vs67%

Physics & Reflections50%vs42%

World Knowledge42%vs33%

Professional Studio85%vs74%

bfl/flux-2-profal/bytedance/seedream-v4

Camera & Lighting83%vs83%

Color Precision92%vs75%

Photorealism67%vs33%

Graphical design75%vs79%

bfl/flux-2-profal/bytedance/seedream-v4

Data Visualisation0%vs33%

Layout & Design78%vs78%

Style Diversity92%vs92%