BizGenEval

BizGenEval: A Systematic Benchmark for Commercial Visual Content Generation BizGenEval is a benchmark for evaluating image generation models on real-world commercial design tasks. It covers **5 document types** × **4 capability dimensions** = **20 evaluation tasks**, with **400** curated prompts and **8,000** checklist questions (4,000 easy + 4,000 hard). Overview Document Types | Domain | Description | Count | |---|---|---| | **Slides** | Presentation slides used in reports, lectures, and business scenarios, characterized by hierarchical structure, bullet lists, and aligned visual elements. | 80 | | **Webpages** | Webpage designs that integrate structured layouts, textual content, and functional interface elements such as headers, sections, buttons, etc. | 80 | | **Posters** | Promotional or informational posters combining typography, graphics, and layout design, often emphasizing visual hierarchy and balanced composition. | 80 | | **Charts** | Data visualization graphics such as bar charts, line charts, and multi-series plots, involving precise rendering of numeric values, axes, and legends. | 80 | | **Scientific Figures** | Figures in academic papers including diagrams, pipelines, and illustrations, where components, arrows, and annotations form clear structure. | 80 | Capability Dimensions | Dimension | What It Tests | Count | |---|---|---| | **Text Rendering** | Textual content rendering, including short titles, long paragraphs, tables, and integration with other components. | 100 | | **Layout Control** | Spatial and structural organization, including overall layout, complex flows, arrows, blocks, and hierarchical arrangement of elements. | 100 | | **Attribute Binding** | Visual attributes such as color, shape, style, icons, and quantity, emphasizing fine-grained control. | 100 | | **Knowledge Reasoning** | Reasoning and domain knowledge, including applying world knowledge across diverse domains such as physics, chemistry, arts, history, etc. | 100 | Every doma