ImageBench V1 —

192 evaluations across 6 categories

Benchmark V1 verdicts are produced by VLM judges and can contain mistakes. Treat PASS/FAIL labels as machine-assisted assessments, and inspect the images yourself. Learn more about the methodology.

Generation Details

Source-backed model context, size, cost, and request settings for this ImageBench V1 run.

fal/hidream-o1-image-dev-8b

API

HiDream O1 Image Dev is the distilled 8B sibling of HiDream O1 Image, running CFG-free at 28 steps for faster generation, open-sourced under the MIT licence in May 2026.

Maker: HiDream.ai
Family: HiDream O1
Model Size: 8B
high
Cost: $0.0052 / image at 1024x1024
high
Run Target: fal/fal-ai/hidream-o1-image/dev
Effective Request: image_size: [object Object] · num_inference_steps: 28 · guidance_scale: 0 · enable_safety_checker: false · output_format: png
Sources: HiDream O1 Image Dev (8B, distilled) on Hugging Face HiDream O1 Image Dev (8B, distilled) on fal HiDream-O1-Image paper (Pixel-level Unified Transformer)

50.0

Overall

46%

Capability

53.6

Est. Preference

89

Pass

103

Fail

13.0s

Avg Latency

4.3s

Min Latency

35.8s

Max Latency

All 192 generations

Text Rendering67%

Typography Style100%

Writing accuracy58%

Spatial Reasoning56%

Attributes Binding89%

Compositionality67%

Counting22%

Negation33%

Relative Position75%

Scale & Proportions44%

Human realism38%

Faces & Expressions33%

Full Body8%

Hands83%

Multi-Subject17%

Truthfulness19%

Photorealism0%

Physics & Reflections33%

World Knowledge8%

Professional Studio59%

Camera & Lighting67%

Color Precision67%

Photorealism0%

Graphical design42%

Data Visualisation0%

Layout & Design44%

Style Diversity50%