ImageBench

ImageBench V1 —

192 evaluations across 6 categories

Benchmark V1 verdicts are produced by VLM judges and can contain mistakes. Treat PASS/FAIL labels as machine-assisted assessments, and inspect the images yourself. Learn more about the methodology.

Generation Details

Source-backed model context, size, cost, and request settings for this ImageBench V1 run.

fal/ideogram/v3

API

Ideogram 3.0 is Ideogram's design-oriented image model for photorealistic images, brand graphics, style control, and especially legible text inside generated compositions.

Maker
Ideogram
Family
Ideogram 3.0
Model Size
not disclosed
unknown
Cost
$0.06 / image at BALANCED
high
Run Target
fal/fal-ai/ideogram/v3
Effective Request
image_size: square_hd · rendering_speed: BALANCED · expand_prompt: true · num_images: 1
48.5
Overall
44%
Capability
53.3
Est. Preference
84
Pass
108
Fail
12.9s
Avg Latency
11.2s
Min Latency
15.4s
Max Latency
Text Rendering67%Spatial Reasoning53%Human realism24%Truthfulness26%Professional Studio52%Graphical design54%Preference53%Latency25%

All 192 generations

Text Rendering67%

Typography Style67%

Writing accuracy67%

Spatial Reasoning53%

Attributes Binding67%

Compositionality78%

Counting44%

Negation56%

Relative Position42%

Scale & Proportions33%

Human realism24%

Faces & Expressions75%

Full Body0%

Hands0%

Multi-Subject17%

Truthfulness26%

Photorealism0%

Physics & Reflections33%

World Knowledge25%

Professional Studio52%

Camera & Lighting58%

Color Precision42%

Photorealism67%

Graphical design54%

Data Visualisation33%

Layout & Design33%

Style Diversity75%