ImageBench

ImageBench V1 —

192 evaluations across 6 categories

Benchmark V1 verdicts are produced by VLM judges and can contain mistakes. Treat PASS/FAIL labels as machine-assisted assessments, and inspect the images yourself. Learn more about the methodology.

Generation Details

Source-backed model context, size, cost, and request settings for this ImageBench V1 run.

fal/ideogram/v4

API

Ideogram 4.0 is Ideogram's open-weight design model, focused on dependable typography, stronger prompt alignment, structured layout control, color-palette control, and native 2K image output.

Maker
Ideogram
Family
Ideogram 4.0
Model Size
9.3B
high
Cost
$0.015 / MP at BALANCED on fal
high
Run Target
fal/ideogram/v4
Effective Request
image_size: square_hd · rendering_speed: BALANCED · expand_prompt: true · num_images: 1
Sources
Ideogram 4.0 technical detailsIdeogram 4.0 model pageIdeogram 4 fp8 model cardIdeogram V4 on fal
46.1
Overall
58%
Capability
34.0
Est. Preference
112
Pass
80
Fail
16.6s
Avg Latency
6.4s
Min Latency
53.0s
Max Latency
Text Rendering93%Spatial Reasoning68%Human realism21%Truthfulness30%Professional Studio93%Graphical design71%Preference34%Latency17%

All 192 generations

Text Rendering93%

Typography Style100%

Writing accuracy92%

Spatial Reasoning68%

Attributes Binding78%

Compositionality89%

Counting44%

Negation56%

Relative Position67%

Scale & Proportions78%

Human realism21%

Faces & Expressions67%

Full Body0%

Hands0%

Multi-Subject17%

Truthfulness30%

Photorealism0%

Physics & Reflections42%

World Knowledge25%

Professional Studio93%

Camera & Lighting83%

Color Precision100%

Photorealism100%

Graphical design71%

Data Visualisation33%

Layout & Design67%

Style Diversity83%