ImageBench

ImageBench V1 —

192 evaluations across 6 categories

Benchmark V1 verdicts are produced by VLM judges and can contain mistakes. Treat PASS/FAIL labels as machine-assisted assessments, and inspect the images yourself. Learn more about the methodology.

Generation Details

Source-backed model context, size, cost, and request settings for this ImageBench V1 run.

local/moss-image-sft

Local

MOSS-Image-SFT is the OpenMOSS Team's Apache-2.0 instruction-tuned 1024 px text-to-image model, with a Qwen3.5-9B text encoder and the FLUX.2 small-decoder VAE. It is the sibling of MOSS-Image-Base and the checkpoint Kromoss is a drop-in replacement for.

Maker
OpenMOSS Team
Family
MOSS-Image
Model Size
5B
medium
Cost
local run; no API price
not_applicable
Run Target
gx10/moss-image-sft
Effective Request
response_format: b64_json · size: 1024x1024 · num_inference_steps: 50 · guidance_scale: 3 · seed: 7
61.9
Overall
66%
Capability
57.7
Est. Preference
127
Pass
65
Fail
157.8s
Avg Latency
156.6s
Min Latency
159.1s
Max Latency
Text Rendering87%Spatial Reasoning61%Human realism55%Truthfulness44%Professional Studio89%Graphical design83%Preference58%Latency0%

All 192 generations

Text Rendering87%

Typography Style100%

Writing accuracy83%

Spatial Reasoning61%

Attributes Binding67%

Compositionality89%

Counting44%

Negation22%

Relative Position83%

Scale & Proportions56%

Human realism55%

Faces & Expressions92%

Full Body8%

Hands67%

Multi-Subject50%

Truthfulness44%

Photorealism100%

Physics & Reflections42%

World Knowledge33%

Professional Studio89%

Camera & Lighting83%

Color Precision92%

Photorealism100%

Graphical design83%

Data Visualisation33%

Layout & Design89%

Style Diversity92%