Nemotron-Labs-Audex-30B-A3B

Nemotron-Labs-Audex-30B-A3B Introduction We're excited to introduce Nemotron-Labs-Audex-30B-A3B, a unified audio-text LLM built on Nemotron-Cascade-2-30B-A3B, a strong text-only MoE LLM with 30B MoE model with 3B activated parameters. Audex-30B-A3B extends the vocabulary for discrete audio tokens used for speech and general audio outputs, as well as an audio encoder for speech and general audio inputs. Audex-30B-A3B delivers strong abilities on audio tasks (audio understanding, speech recognition and translation, text-to-speech, audio generation, and speech-to-speech generation) while preserving very compelling reasoning, alignment, knowledge, long-context, and agentic capabilities of its text-only LLM backbone with marginal or no regression. Audex-30B-A3B operates in both **thinking** and **instruct** (non-thinking) modes. Model Architecture Templates Multi-Stage-SFT and Cascaded-RL Pipelines Quick Start Audex-30B-A3B follows the ChatML template and supports both thinking and instruct (non-thinking) modes. Reasoning content is enclosed within ` ` and ` ` tags. To activate the instruct (non-thinking) mode, we prepend ` ` to the beginning of the assistant’s response. Audex-30B-A3B supports up to a 1M-token context length. Audex-30B-A3B follows Nemotron-Cascade-2 on text evaluation. Audex-30B-A3B has different recommended inference setups per audio-related task as described below. Environment We use **vLLM 0.20.0 container image**: vllm/vllm-openai:v0.20.0-cu129 **vLLM inference** — text-only reasoning, text-to-speech, text-to-audio, and audio understanding / speech recognition / speech translation: runs on **vLLM 0.20.0**. **Hugging Face / transformers inference** — requires transformers >= 4.53.0 (tested with 4.53.3) and also works with transformers >= 5.0. This additionally needs `mamba-ssm` and `causal-conv1d`. Build against your CUDA toolchain: Audio extras:** image does not include audio codecs. This command installs audio-related packages: . Audio QA Inference