WebWorldData

WebWorldData 🌐 Overview WebWorldData** is a large-scale dataset of **1.06M web interaction trajectories** collected from the open web, designed for training browser world models. It is the training data behind the WebWorld model series. Each trajectory consists of sequences of `(state, action, next_state)` transitions, where states are represented as A11y Trees extracted from real websites using Playwright. Dataset Statistics | | | |---|---| | **Total Trajectories** | 1,059,348 | | **Total Size** | ~50.9 GB | | **Languages** | English, Chinese | | **Max Context Length** | 30K tokens | | **Max Trajectory Turns** | 30+ steps | | **State Format** | A11y Tree (primary), HTML, XML, Markdown, Natural Language | | **Source Websites** | 680K+ URLs from FineWeb, CCI 3.0, and curated lists | Data Sources The dataset is collected through a **scalable hierarchical pipeline**: | Source | Strategy | Scale | Description | |---|---|---|---| | **Level 1: Randomized Crawling** | Rule-based crawlers | 293K | Randomized exploration on websites from pre-training corpora (FineWeb, CCI 3.0), aligned with the base model's linguistic priors | | **Level 2: Autonomous Exploration** | LLM-driven agents | 38K | Agents autonomously explore websites by generating their own objectives, producing long-horizon trajectories up to 30 steps | | **Level 3: Task-Oriented Execution** | Synthetic tasks | 94K | Agents execute synthesized web tasks through seed extraction, diversification, and paraphrasing | | **Open Source** | AgentTrek, etc. | 38K | Reformatted open-source agent trajectories | | **Multi-Format** | Format conversion | 48K | Trajectories converted to HTML, XML, Markdown, Playwright formats | | **Interaction** | General QA + chat | 548K | General instruction-following and QA data to preserve conversational abilities | Data Format Each sample is a multi-turn conversation in JSONL format: Domain Distribution The dataset covers diverse web domains: | Domain | Share | |---|---| | Technology | 15.