ImageBench

ImageBench V1 —

192 evaluations across 6 categories

Benchmark V1 verdicts are produced by VLM judges and can contain mistakes. Treat PASS/FAIL labels as machine-assisted assessments, and inspect the images yourself. Learn more about the methodology.

Generation Details

Source-backed model context, size, cost, and request settings for this ImageBench V1 run.

local/sefi-image-2b-turbo

Local

SeFi Image 2B Turbo is a locally fine-tuned text-to-image model produced by the SeFi image-generation fine-tuning pipeline and run on an NVIDIA DGX Spark. It is the ~2B turbo (few-step) variant of the SeFi Image family. It is not a publicly released hosted product; no external model card or citation is disclosed.

Maker
SeFi pipeline
Family
SeFi Image
Model Size
~2B
estimated
Cost
local run; no API price
not_applicable
Run Target
gx10/sefi-image-2b-turbo
Effective Request
Effective request fields unknown
33.6
Overall
41%
Capability
26.1
Est. Preference
79
Pass
113
Fail
3.6s
Avg Latency
3.2s
Min Latency
4.4s
Max Latency
Text Rendering20%Spatial Reasoning51%Human realism12%Truthfulness33%Professional Studio85%Graphical design42%Preference26%Latency62%

All 192 generations

Text Rendering20%

Typography Style33%

Writing accuracy17%

Spatial Reasoning51%

Attributes Binding89%

Compositionality67%

Counting11%

Negation22%

Relative Position75%

Scale & Proportions33%

Human realism12%

Faces & Expressions33%

Full Body0%

Hands0%

Multi-Subject17%

Truthfulness33%

Photorealism33%

Physics & Reflections50%

World Knowledge17%

Professional Studio85%

Camera & Lighting75%

Color Precision100%

Photorealism67%

Graphical design42%

Data Visualisation0%

Layout & Design11%

Style Diversity75%