NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4

NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 Model Summary | | | |:---|:---| | **Total Parameters** | 120B (12B active) | | **Architecture** | LatentMoE - Mamba-2 + MoE + Attention hybrid with Multi-Token Prediction (MTP) | | **Context Length** | Up to 1M tokens | | **Minimum GPU Requirement** | 1× B200 OR 1× DGX Spark| | **Supported Languages** | English, French, German, Italian, Japanese, Spanish, Chinese | | **Best For** | Agentic workflows, long-context reasoning, high-volume workloads (e.g. IT ticket automation), tool use, RAG | | **Reasoning Mode** | Configurable on/off via chat template (`enable_thinking=True/False`) | | **License** | NVIDIA Nemotron Open Model License | | **Release Date** | March 11, 2026 | Quick Start Use `temperature=1.0` and `top_p=0.95` across **all tasks and serving backends** — reasoning, tool calling, and general chat alike. For more details on how to deploy and use the model - see the Quick Start Guide below! Model Overview Model Developer:** NVIDIA Corporation Model Dates:** December 2025 - March 2026 Data Freshness:** The post-training data has a cutoff date of February 2026. The pre-training data has a cutoff date of June 2025. What is Nemotron? NVIDIA Nemotron™ is a family of open models with open weights, training data, and recipes, delivering leading efficiency and accuracy for building specialized AI agents. Description Nemotron-3-Super-120B-A12B-NVFP4** is a large language model (LLM) trained by NVIDIA, designed to deliver strong agentic, reasoning, and conversational capabilities. It is optimized for collaborative agents and high-volume workloads such as IT ticket automation. Like other models in the family, it responds to user queries and tasks by first generating a reasoning trace and then concluding with a final response. The model's reasoning capabilities can be configured through a flag in the chat template. The model employs a hybrid **Latent Mixture-of-Experts (LatentMoE)** architecture, utilizing interleaved Mamba-2 and M