Vera-Layered-Video-Dataset

Dataset for Vera: A Layered Diffusion Model for Content-Preserving Video Editing Hongkai Zheng ¹²*  ·  Ta-Ying Cheng ²  ·  Benjamin Klein ²  ·  Yisong Yue ¹  ·  Zhuoning Yuan ²† ¹California Institute of Technology    ²Netflix, Inc. Work done during an internship at Netflix   †Project Lead **TL;DR**: A layered diffusion framework for video editing. Vera jointly generates an edit layer, an alpha matte, and a composite video, separating what to generate from what to preserve. **Disclaimer:** This is a research prototype, not an official product. 📋 Dataset Description **Curated by:** Hongkai Zheng, Ta-Ying Cheng, Benjamin Klein, Yisong Yue, Zhuoning Yuan **License:** Apache License 2.0 **Paper:** Vera: A Layered Diffusion Model for Content-Preserving Video Editing 📦 Dataset Structure 🎞️ Splits — 49 Frames (3 sec) Note:** The current Vera models are trained on 49-frame sequences. | Split | Edit Type | # Samples | | ---------------------------------------------- | ------------------ | ---------- | | train / 49-frames / realistic-set1-bg-change | background_replace | 914 | | train / 49-frames / realistic-set1-obj-add | obj_add | 470 | | train / 49-frames / realistic-set2-obj-add | obj_add | 770 | | train / 49-frames / synthetic-bg-change | background_replace | 4,994 | | train / 49-frames / synthetic-obj-add | obj_add | 4,848 | | **49-Frame Train Total** | | **11,996** | 🎞️ Splits — 81 Frames (5 sec) | Split | Edit Type | # Samples | | ---------------------------------------------- | ------------------ | ---------- | | train / 81-frames / realistic-set1-bg-change | background_replace | 457 | | train / 81-frames / realistic-set1-obj-add | obj_add | 235 | | train / 81-frames / realistic-set2-obj-add | obj_add | 385 | | train / 81-frames / synthetic-bg-change | background_replace | 2,497 | | train / 81-frames / synthetic-obj-add | obj_add | 2,431 | | **81-Frame Train Total** | | **6,005** | 🧪 Te