ImageBench

vs

192 evaluations across 6 categories

Benchmark V1 verdicts are produced by VLM judges and can contain mistakes. Treat PASS/FAIL labels as machine-assisted assessments, and inspect the images yourself. Learn more about the methodology.

Generation Details

Source-backed model context, size, cost, and request settings for this ImageBench V1 run.

openai/gpt-image-2

API

GPT Image 2 is OpenAI's current image generation and editing model for fast, high-quality image creation, with flexible image sizes and high-fidelity image inputs through the OpenAI Images API.

Maker
OpenAI
Family
GPT Image
Model Size
not disclosed
unknown
Cost
token-based
high
Run Target
openai/gpt-image-2
Effective Request
model: gpt-image-2 · size: 1024x1024 · quality: auto
Sources
GPT Image 2 model docsOpenAI image generation guideOpenAI API pricing

fal/bytedance/seedream-v5-pro

API

Seedream 5.0 Pro is ByteDance Seed's flagship Seedream 5.0 text-to-image model, generating high-resolution images with strong prompt adherence; served here through fal.

Maker
ByteDance Seed
Family
Seedream 5.0
Model Size
not disclosed
unknown
Cost
from $0.0675 / image
medium
Run Target
fal/bytedance/seedream/v5/pro/text-to-image
Effective Request
seed: 7
Sources
Seedream 5.0 Pro on fal
78.5vs65.4
Overall
84%vs70%
Capability
73.0vs60.9
Est. Preference
45.3svs147.4s
Avg Latency
Text Rendering100%93%Spatial Reasoning91%81%Human realism55%36%Truthfulness74%56%Professional Studio100%93%Graphical design100%83%Preference73%61%Latency0%0%

All 192 generations

Text Rendering100%vs100%

openai/gpt-image-2fal/bytedance/seedream-v5-pro

Typography Style100%vs100%

Writing accuracy100%vs100%

Spatial Reasoning91%vs81%

openai/gpt-image-2fal/bytedance/seedream-v5-pro

Attributes Binding100%vs89%

Compositionality100%vs89%

Counting89%vs78%

Negation100%vs100%

Relative Position83%vs67%

Scale & Proportions78%vs67%

Human realism55%vs36%

openai/gpt-image-2fal/bytedance/seedream-v5-pro

Faces & Expressions92%vs75%

Full Body17%vs17%

Hands33%vs8%

Multi-Subject100%vs50%

Truthfulness74%vs56%

openai/gpt-image-2fal/bytedance/seedream-v5-pro

Photorealism100%vs67%

Physics & Reflections58%vs58%

World Knowledge83%vs50%

Professional Studio100%vs93%

openai/gpt-image-2fal/bytedance/seedream-v5-pro

Camera & Lighting100%vs83%

Color Precision100%vs100%

Photorealism100%vs100%

Graphical design100%vs83%

openai/gpt-image-2fal/bytedance/seedream-v5-pro

Layout & Design100%vs89%

Data Visualisation100%vs67%

Style Diversity100%vs83%