ImageBench

ImageBench V1 —

192 evaluations across 6 categories

Benchmark V1 verdicts are produced by VLM judges and can contain mistakes. Treat PASS/FAIL labels as machine-assisted assessments, and inspect the images yourself. Learn more about the methodology.

Generation Details

Source-backed model context, size, cost, and request settings for this ImageBench V1 run.

local/flux-3-klein-nvfp4

Local

FLUX 3 Image Klein is Black Forest Labs' 5.6B open-weights image model (released 2026-10-15) covering text-to-image, editing with up to ten reference images and bounding-box layout control in one model, with a Qwen3-VL-4B-Instruct text encoder and output up to 4K. This entry runs the distilled flow-map checkpoint (16 steps, no CFG; the checkpoint behind the BFL API) in NVFP4 precision. Released under the FLUX Kommunity License (non-commercial, with a commercial-output exception for small companies).

Maker
Black Forest Labs
Family
FLUX 3
Model Size
5.6B
high
Cost
local run; no API price
not_applicable
Run Target
gx10/flux3-klein-nvfp4
Effective Request
response_format: b64_json · size: 1024x1024 · seed: 7 · num_inference_steps: 16 · guidance: none (distilled flow map; CFG is rejected)
60.3
Overall
65%
Capability
56.0
Est. Preference
124
Pass
68
Fail
13.7s
Avg Latency
13.5s
Min Latency
14.7s
Max Latency
Text Rendering80%Spatial Reasoning63%Human realism55%Truthfulness44%Professional Studio100%Graphical design58%Preference56%Latency23%

All 192 generations

Text Rendering80%

Typography Style100%

Writing accuracy75%

Spatial Reasoning63%

Attributes Binding89%

Compositionality78%

Counting44%

Negation56%

Relative Position58%

Scale & Proportions56%

Human realism55%

Faces & Expressions67%

Full Body17%

Hands92%

Multi-Subject33%

Truthfulness44%

Photorealism67%

Physics & Reflections58%

World Knowledge25%

Professional Studio100%

Camera & Lighting100%

Color Precision100%

Photorealism100%

Graphical design58%

Data Visualisation0%

Layout & Design44%

Style Diversity83%