Cosmos-H-Surgical

Cosmos-H-Surgical Overview Description: Cosmos-H-Surgical-Predict*** is a fine-tuned world foundation model for surgical robotics applications, built on NVIDIA's Cosmos platform. Fine-tuned from Cosmos-Predict2.5-2B, the model takes a first frame image and a text description as input and predicts the next 92 future frames of surgical video. This enables synthetic data generation (SDG) for training downstream policy models for surgical robotics. The model is adapted from the Cosmos foundation model to the surgical domain. The functionality is the same as the original Cosmos-Predict2.5-2B, with one key difference: Cosmos-H-Surgical-Predict drops text-only video generation and requires a first frame image as input alongside the text description. Cosmos-H-Surgical-Transfer*** is a fine-tuned world foundation model for surgical robotics applications, built on NVIDIA's Cosmos platform. Fine-tuned from Cosmos-Transfer2.5-2B, the model transfers control input videos (depth maps, segmentation masks, edge maps, or blurred RGB) into photorealistic surgical videos. This bridges the simulation-to-real (sim2real) gap by converting synthetic/CG-rendered videos into photorealistic equivalents. License/Terms of Use: This repository contains two checkpoint editions with different license terms: | Checkpoint edition | Paths | Model keys | License | | --- | --- | --- | --- | | Legacy | `predict/`, `transfer/` | `2B/post-trained`, `depth`, `edge`, `seg`, `vis` | NVIDIA-OneWay-Noncommercial-License | | OpenMDW-1.1 | `openmdw-1.1/` | `2B/post-trained/openmdw-1.1`, `depth/openmdw-1.1`, `edge/openmdw-1.1`, `seg/openmdw-1.1`, `vis/openmdw-1.1` | OpenMDW-1.1 | For the OpenMDW-1.1 checkpoint edition: This model is ready for commercial and non-commercial use.** Only artifacts explicitly identified as `OpenMDW-1.1` in `release-manifest.json` are provided under OpenMDW-1.1. Existing legacy artifacts are not relicensed. See `LICENSE.weights`, `LICENSE.OpenMDW-1.1`, `NOTICE.weights`, and `release-m