Nemotron-RL-Ultra-Training-Blends

Dataset Description: This dataset provides Reinforcement Learning (RL) and Multi-teacher On-Policy Distillation (MOPD) training-data blends used by the public **Nemotron-3-Ultra** post-training recipe. The blends are consumed by the NeMo RL training recipes through the NeMo Gym agent framework, in which each prompt is paired with an agent/environment that returns a verifiable or judge-based reward. Each subset is a separate blend; see the recipe for how the blends are used. The blends mix NVIDIA-released datasets with several external datasets (see **Data Preparation** below). This dataset is ready for commercial or non-commercial uses. Dataset Owner(s): NVIDIA Corporation Dataset Creation Date: Created on: 2026-05-29 Last Modified on: 2026-06-03 License/Terms of Use: This dataset is licensed under CC BY-SA 4.0, CC BY 4.0, ODC-BY 1.0, MIT, and Apache 2.0. Intended Usage: This dataset is intended for researchers and developers post-training large language models with reinforcement learning using the NeMo RL recipes and the NeMo Gym agent framework. See the Nemotron-3-Ultra training guide for end-to-end instructions. Dataset Composition Each subset is a separate blend, composed of the following datasets (percentage of the blend). rlvr1 | Component (HF dataset) | Ratio | |---|--:| | nvidia/Nemotron-RL-Agentic-Conversational-Tool-Use-v1 | 20.36% | | nebius/SWE-rebench-V2 + SWE-Gym/SWE-Gym | 14.12% | | nvidia/Nemotron-RL-instruction_following | 12.02% | | nvidia/Nemotron-RL-Math-v2 | 10.86% | | nvidia/Nemotron-RL-coding-competitive_coding | 8.06% | | nvidia/Nemotron-RLHF-GenRM-v1 | 4.87% | | nvidia/Nemotron-RL-ARC-AGI-v1 | 4.23% | | nvidia/Nemotron-RL-Instruction-Following-MultiTurnChat-v1 | 4.09% | | nvidia/Nemotron-RL-QA-Abstention-v1 | 4.09% | | nvidia/Nemotron-RL-Agentic-Function-Calling-Pivot-v1 | 4.08% | | nvidia/Nemotron-RL-Safety-v1 | 2.91% | | nvidia/Nemotron-RL-knowledge-mcqa | 2.13% | | nvidia/Nemotron-RL-ReasoningGym-v1 | 2.12% | | nvidia/Nemotron-RL-Instruct