ImageBench

ImageBench V1 —

192 evaluations across 6 categories

Benchmark V1 verdicts are produced by VLM judges and can contain mistakes. Treat PASS/FAIL labels as machine-assisted assessments, and inspect the images yourself. Learn more about the methodology.

Generation Details

Source-backed model context, size, cost, and request settings for this ImageBench V1 run.

local/iris-3b-turbo

Local

Iris-3B by Sperid Labs is a 3B-parameter Apache-2.0 diffusion transformer that generates directly in pixel space: no VAE and no latent, with 16x16 RGB patches, 2D RoPE and a frozen Qwen3-VL-4B text encoder read at eleven layers. Trained progressively up to about one megapixel. This entry is the distilled turbo checkpoint: 4 fixed sigmas with guidance baked into the weights.

Maker
Sperid Labs
Family
Iris-3B
Model Size
3B
high
Cost
local run; no API price
not_applicable
Run Target
gx10/iris-3b-turbo
Effective Request
response_format: b64_json · size: 1024x1024 · seed: 7
51.6
Overall
47%
Capability
55.9
Est. Preference
91
Pass
101
Fail
4.2s
Avg Latency
4.0s
Min Latency
4.3s
Max Latency
Text Rendering53%Spatial Reasoning47%Human realism33%Truthfulness26%Professional Studio78%Graphical design58%Preference56%Latency58%

All 192 generations

Text Rendering53%

Typography Style100%

Writing accuracy42%

Spatial Reasoning47%

Attributes Binding56%

Compositionality67%

Counting33%

Negation22%

Relative Position58%

Scale & Proportions44%

Human realism33%

Faces & Expressions50%

Full Body0%

Hands58%

Multi-Subject17%

Truthfulness26%

Photorealism0%

Physics & Reflections42%

World Knowledge17%

Professional Studio78%

Camera & Lighting92%

Color Precision83%

Photorealism0%

Graphical design58%

Data Visualisation0%

Layout & Design33%

Style Diversity92%