ImageBench

ImageBench V1 —

192 evaluations across 6 categories

Benchmark V1 verdicts are produced by VLM judges and can contain mistakes. Treat PASS/FAIL labels as machine-assisted assessments, and inspect the images yourself. Learn more about the methodology.

Generation Details

Source-backed model context, size, cost, and request settings for this ImageBench V1 run.

replicate/google/imagen-4-fast

API

Imagen 4 Fast is the speed- and cost-optimized tier of Google DeepMind's Imagen 4 family, tuned for low-latency, high-volume generation. It trades some fidelity for faster turnaround while retaining Imagen 4's prompt adherence and improved text rendering.

Maker
Google DeepMind
Family
Imagen 4
Model Size
not disclosed
unknown
Cost
$0.02 / image
high
Run Target
replicate/google/imagen-4-fast
Effective Request
aspect_ratio: 1:1 · seed: 7
53.0
Overall
52%
Capability
54.5
Est. Preference
99
Pass
93
Fail
5.8s
Avg Latency
3.0s
Min Latency
12.0s
Max Latency
Text Rendering47%Spatial Reasoning54%Human realism45%Truthfulness30%Professional Studio85%Graphical design46%Preference55%Latency48%

All 192 generations

Text Rendering47%

Typography Style67%

Writing accuracy42%

Spatial Reasoning54%

Attributes Binding67%

Compositionality67%

Counting22%

Negation67%

Relative Position58%

Scale & Proportions44%

Human realism45%

Faces & Expressions67%

Full Body8%

Hands58%

Multi-Subject50%

Truthfulness30%

Photorealism33%

Physics & Reflections33%

World Knowledge25%

Professional Studio85%

Camera & Lighting83%

Color Precision92%

Photorealism67%

Graphical design46%

Data Visualisation0%

Layout & Design22%

Style Diversity75%