ImageBench

vs

192 evaluations across 6 categories

Benchmark V1 verdicts are produced by VLM judges and can contain mistakes. Treat PASS/FAIL labels as machine-assisted assessments, and inspect the images yourself. Learn more about the methodology.

Generation Details

Source-backed model context, size, cost, and request settings for this ImageBench V1 run.

fal/google/nano-banana-2

API

Nano Banana 2 is Google's fast Gemini image generation and editing model, exposed here through fal, with emphasis on high-quality image creation, grounded world knowledge, and practical generation speed.

Maker
Google DeepMind
Family
Nano Banana / Gemini image generation
Model Size
not disclosed
unknown
Cost
$0.08 / image at 1K
high
Run Target
fal/fal-ai/nano-banana-2
Effective Request
aspect_ratio: 1:1 · resolution: 1K · num_images: 1 · output_format: png

openai/gpt-image-2

API

GPT Image 2 is OpenAI's current image generation and editing model for fast, high-quality image creation, with flexible image sizes and high-fidelity image inputs through the OpenAI Images API.

Maker
OpenAI
Family
GPT Image
Model Size
not disclosed
unknown
Cost
token-based
high
Run Target
openai/gpt-image-2
Effective Request
model: gpt-image-2 · size: 1024x1024 · quality: auto
73.0vs78.5
Overall
73%vs84%
Capability
72.6vs73.0
Est. Preference
28.1svs45.3s
Avg Latency
Text Rendering73%100%Spatial Reasoning88%91%Human realism38%55%Truthfulness56%74%Professional Studio93%100%Graphical design100%100%Preference73%73%Latency2%0%

All 192 generations

Text Rendering73%vs100%

fal/google/nano-banana-2openai/gpt-image-2

Typography Style100%vs100%

Writing accuracy67%vs100%

Spatial Reasoning88%vs91%

fal/google/nano-banana-2openai/gpt-image-2

Attributes Binding100%vs100%

Compositionality100%vs100%

Counting78%vs89%

Negation89%vs100%

Relative Position92%vs83%

Scale & Proportions67%vs78%

Human realism38%vs55%

fal/google/nano-banana-2openai/gpt-image-2

Faces & Expressions92%vs92%

Full Body8%vs17%

Hands25%vs33%

Multi-Subject17%vs100%

Truthfulness56%vs74%

fal/google/nano-banana-2openai/gpt-image-2

Photorealism67%vs100%

Physics & Reflections58%vs58%

World Knowledge50%vs83%

Professional Studio93%vs100%

fal/google/nano-banana-2openai/gpt-image-2

Camera & Lighting92%vs100%

Color Precision100%vs100%

Photorealism67%vs100%

Graphical design100%vs100%

fal/google/nano-banana-2openai/gpt-image-2

Data Visualisation100%vs100%

Layout & Design100%vs100%

Style Diversity100%vs100%