ImageBench

vs

192 evaluations across 6 categories

Benchmark V1 verdicts are produced by VLM judges and can contain mistakes. Treat PASS/FAIL labels as machine-assisted assessments, and inspect the images yourself. Learn more about the methodology.

Generation Details

Source-backed model context, size, cost, and request settings for this ImageBench V1 run.

fal/google/nano-banana-2

API

Nano Banana 2 is Google's fast Gemini image generation and editing model, exposed here through fal, with emphasis on high-quality image creation, grounded world knowledge, and practical generation speed.

Maker
Google DeepMind
Family
Nano Banana / Gemini image generation
Model Size
not disclosed
unknown
Cost
$0.08 / image at 1K
high
Run Target
fal/fal-ai/nano-banana-2
Effective Request
aspect_ratio: 1:1 · resolution: 1K · num_images: 1 · output_format: png

local/sana-1.5-1.6b

Local

Sana 1.5 1.6B is an NVIDIA/Sana linear Diffusion Transformer model for efficient text-to-image generation, focused on scaling training and inference with comparatively small parameter counts.

Maker
NVIDIA / Sana team
Family
Sana 1.5
Model Size
1.6B
high
Cost
local run; no API price
not_applicable
Run Target
sana-local/sana-1.5-1.6b
Effective Request
size: 1024x1024
74.9vs34.5
Overall
77%vs35%
Capability
72.6vs34.2
Est. Preference
28.1svs11.1s
Avg Latency
Text Rendering73%13%Spatial Reasoning88%33%Human realism55%21%Truthfulness56%30%Professional Studio93%67%Graphical design100%46%Preference73%34%Latency2%29%

All 192 generations

Text Rendering73%vs13%

fal/google/nano-banana-2local/sana-1.5-1.6b

Typography Style100%vs33%

Writing accuracy67%vs8%

Spatial Reasoning88%vs33%

fal/google/nano-banana-2local/sana-1.5-1.6b

Attributes Binding100%vs33%

Compositionality100%vs67%

Counting78%vs22%

Negation89%vs22%

Relative Position92%vs25%

Scale & Proportions67%vs33%

Human realism55%vs21%

fal/google/nano-banana-2local/sana-1.5-1.6b

Faces & Expressions92%vs17%

Full Body8%vs0%

Hands83%vs50%

Multi-Subject17%vs17%

Truthfulness56%vs30%

fal/google/nano-banana-2local/sana-1.5-1.6b

Photorealism67%vs0%

Physics & Reflections58%vs42%

World Knowledge50%vs25%

Professional Studio93%vs67%

fal/google/nano-banana-2local/sana-1.5-1.6b

Camera & Lighting92%vs67%

Color Precision100%vs75%

Photorealism67%vs33%

Graphical design100%vs46%

fal/google/nano-banana-2local/sana-1.5-1.6b

Data Visualisation100%vs0%

Layout & Design100%vs0%

Style Diversity100%vs92%