vs

192 evaluations across 6 categories

Benchmark V1 verdicts are produced by VLM judges and can contain mistakes. Treat PASS/FAIL labels as machine-assisted assessments, and inspect the images yourself. Learn more about the methodology.

Generation Details

Source-backed model context, size, cost, and request settings for this ImageBench V1 run.

fal/microsoft/mai-image-2.5

API

MAI-Image-2.5 is Microsoft AI’s flagship photorealistic text-to-image and editing model, built for high-quality generation and controllable, identity-preserving edits at production scale. Strong at readable embedded text, composition, and studio/product visuals; ships a faster MAI-Image-2.5-Flash variant. Places top-3 on Arena.ai T2I. Note: a strict content filter refuses some benign prompts (e.g. involving children).

Maker: Microsoft
Family: MAI-Image
Model Size: not disclosed
unknown
Cost: ~$0.05 / image
medium
Run Target: fal/microsoft/mai-image-2.5
Effective Request: aspect_ratio: 1:1 · num_images: 1 · output_format: png
Sources: MAI-Image-2.5 (Text to Image) on fal Microsoft Foundry Labs — MAI-Image-2.5

xai/grok-imagine-2

API

Grok Imagine Image 2.0 is xAI's text-to-image model (released Aug 2026), emphasizing photorealism, natural lighting, physics, and textures. Served via xAI's first-party API (OpenAI-images-compatible). The first xAI model on this board.

Maker: xAI
Family: Grok Imagine 2.0
Model Size: not disclosed
unknown
Cost: $0.04 / image
high
Run Target: xai/grok-imagine-image-2.0
Effective Request: aspect_ratio: 1:1 · resolution: 1k
Sources: Grok Imagine Image 2.0 — xAI xAI image generation API docs