ImageBench

vs

192 evaluations across 6 categories

Benchmark V1 verdicts are produced by VLM judges and can contain mistakes. Treat PASS/FAIL labels as machine-assisted assessments, and inspect the images yourself. Learn more about the methodology.

Generation Details

Source-backed model context, size, cost, and request settings for this ImageBench V1 run.

fal/google/nano-banana-pro

API

Nano Banana Pro is Google DeepMind's higher-end image generation and editing model built on Gemini 3 Pro, designed for more accurate visuals, stronger reasoning, and better text rendering across Google products and APIs.

Maker
Google DeepMind
Family
Nano Banana Pro / Gemini image generation
Model Size
not disclosed
unknown
Cost
$0.15 / image
high
Run Target
fal/fal-ai/nano-banana-pro
Effective Request
aspect_ratio: 1:1 · resolution: 1K · num_images: 1 · output_format: png

fal/qwen-image-2-pro

API

Qwen Image 2.0 Pro is Alibaba's Qwen (Tongyi Lab) flagship hosted text-to-image model, a top-10 model on the Artificial Analysis image arena known for best-in-class typography, infographics, and poster/layout rendering. Distinct from the older local Qwen-Image checkpoint on this board; released ~April 2026.

Maker
Alibaba (Qwen)
Family
Qwen Image 2.0
Model Size
not disclosed
unknown
Cost
$0.075 / image
high
Run Target
fal/fal-ai/qwen-image-2/pro/text-to-image
Effective Request
image_size: square_hd · seed: 7
68.8vs66.9
Overall
79%vs71%
Capability
59.1vs63.1
Est. Preference
23.4svs12.8s
Avg Latency
Text Rendering100%100%Spatial Reasoning90%75%Human realism57%38%Truthfulness56%59%Professional Studio89%93%Graphical design92%88%Preference59%63%Latency7%25%

All 192 generations

Text Rendering100%vs100%

fal/google/nano-banana-profal/qwen-image-2.0-pro

Typography Style100%vs100%

Writing accuracy100%vs100%

Spatial Reasoning89%vs75%

fal/google/nano-banana-profal/qwen-image-2.0-pro

Attributes Binding100%vs89%

Compositionality89%vs89%

Counting78%vs67%

Negation89%vs89%

Relative Position100%vs83%

Scale & Proportions78%vs33%

Human realism57%vs38%

fal/google/nano-banana-profal/qwen-image-2.0-pro

Faces & Expressions83%vs92%

Full Body8%vs17%

Hands92%vs0%

Multi-Subject33%vs50%

Truthfulness56%vs59%

fal/google/nano-banana-profal/qwen-image-2.0-pro

Physics & Reflections42%vs50%

Photorealism33%vs33%

World Knowledge75%vs75%

Professional Studio89%vs93%

fal/google/nano-banana-profal/qwen-image-2.0-pro

Camera & Lighting83%vs83%

Color Precision100%vs100%

Photorealism67%vs100%

Graphical design92%vs88%

fal/google/nano-banana-profal/qwen-image-2.0-pro

Data Visualisation100%vs67%

Layout & Design78%vs78%

Style Diversity100%vs100%