seamless-interaction

Seamless Interaction Dataset A large-scale multimodal dataset of 4,000+ hours of human interactions for AI research** 🖼️ Blog 🌐 Website 🎮 Demo 📦 GitHub 📄 Paper Human communication involves a complex interplay of verbal and nonverbal signals, essential for conveying meaning and achieving interpersonal goals. The **Seamless Interaction Dataset** is a large-scale collection of over 4,000 hours of face-to-face interaction footage from more than 4,000 participants in diverse contexts. This dataset enables the development of AI technologies that understand human interactions and communication, unlocking breakthroughs in: 🤖 Virtual agents and embodied AI 🎭 Natural human-computer interaction 📡 Advanced telepresence experiences 📊 Multimodal content analysis tools 🎬 Animation and synthetic content generation 🚀 Quick Start Explore the dataset with our interactive browser: Features:** 🔍 **Hierarchical Navigation**: Browse by Label → Split → Batch → Interaction 🎲 **Random Sampling**: Discover interactions with one-click random selection 📥 **Download Interface**: Download specific batches with size estimation and progress tracking 🎬 **Video Viewer**: Side-by-side participant videos with synchronized playback 📊 **Data Analysis**: Overview statistics and distribution plots 📁 **File Management**: Organize and preview audio, JSON, and NPZ files with expandable dropdowns Download Options We provide comprehensive download methods supporting all research scales and requirements: | **Scale** | **Size** | **Method** | **Use Case** | **Script** | **Sampling** | |-----------|----------|------------|--------------|------------|-------------| | 🔍 **Single Example** | ~100MB | S3 | Quick exploration, understanding data structure | `download_s3.py` | Auto-sample from preferred vendors | | 👥 **Interaction Pair** | ~200MB | S3 | Study conversational dynamics between participants | `download_s3.py` | Auto-detect conversation pairs | | 📂 **Sample Set** | ~1GB | S3/HF | Initial prototyping, algorith