ImageBench

ImageBench V1 —

192 evaluations across 6 categories

Benchmark V1 verdicts are produced by VLM judges and can contain mistakes. Treat PASS/FAIL labels as machine-assisted assessments, and inspect the images yourself. Learn more about the methodology.

Generation Details

Source-backed model context, size, cost, and request settings for this ImageBench V1 run.

local/sefi-image-5b-turbo

Local

SeFi Image 5B Turbo is a locally fine-tuned text-to-image model produced by the SeFi image-generation fine-tuning pipeline and run on an NVIDIA DGX Spark. It is the ~5B turbo (few-step) variant of the SeFi Image family. It is not a publicly released hosted product; no external model card or citation is disclosed.

Maker
SeFi pipeline
Family
SeFi Image
Model Size
~5B
estimated
Cost
local run; no API price
not_applicable
Run Target
gx10/sefi-image-5b-turbo
Effective Request
Effective request fields unknown
41.9
Overall
53%
Capability
31.2
Est. Preference
101
Pass
91
Fail
5.9s
Avg Latency
5.7s
Min Latency
6.6s
Max Latency
Text Rendering53%Spatial Reasoning63%Human realism26%Truthfulness26%Professional Studio93%Graphical design58%Preference31%Latency48%

All 192 generations

Text Rendering53%

Typography Style100%

Writing accuracy42%

Spatial Reasoning63%

Attributes Binding78%

Compositionality78%

Counting44%

Negation78%

Relative Position67%

Scale & Proportions33%

Human realism26%

Faces & Expressions58%

Full Body17%

Hands0%

Multi-Subject33%

Truthfulness26%

Photorealism0%

Physics & Reflections42%

World Knowledge17%

Professional Studio93%

Camera & Lighting83%

Color Precision100%

Photorealism100%

Graphical design58%

Data Visualisation0%

Layout & Design44%

Style Diversity83%