Granary

Granary: Speech Recognition and Translation Dataset in 25 European Languages Granary** is a large-scale, open-source multilingual speech dataset covering 25 European languages for Automatic Speech Recognition (ASR) and Automatic Speech Translation (AST) tasks. | | | |:---:|:---:| | | | Overview Granary addresses the scarcity of high-quality speech data for low-resource languages by consolidating multiple datasets under a unified framework: **🗣️ ~1M hours** of high-quality pseudo-labeled ASR speech data across **25 languages** **📊 Two main tasks**: ASR (transcription) and AST (X→English translation) **🔧 Open-source pipeline** NeMo SDP Granary pipeline for generating similar datasets for additional languages **🤝 Collaborative effort** between NVIDIA NeMo, CMU, and FBK teams Supported Languages Bulgarian, Czech, Danish, German, Greek, English, Spanish, Estonian, Finnish, French, Croatian, Hungarian, Italian, Lithuanian, Latvian, Maltese, Dutch, Polish, Portuguese, Romanian, Slovak, Slovenian, Swedish, Ukrainian, Russian. Pipeline & Quality Granary employs a sophisticated two-stage processing pipeline ensuring high-quality, consistent data across all sources: Stage 1: ASR Processing 1. **Audio Segmentation**: VAD + forced alignment for optimal chunks 2. **Two-Pass Inference**: Whisper-large-v3 with language ID verification 3. **Quality Filtering**: Remove hallucinations, invalid characters, low-quality segments 4. **P&C Restoration**: Qwen-2.5-7B for punctuation/capitalization normalization Stage 2: AST Processing 1. **Translation**: EuroLLM-9B for X→English translation from ASR outputs 2. **Quality Estimation**: Automatic scoring and confidence filtering 3. **Consistency Checks**: Length ratios, language ID validation, semantic coherence This repository consolidates access to all Granary speech corpora with labels from different sources (YODAS-Granary, MOSEL) in NeMo manifests format. Refer to this blog on how to use Granary data for fine-tuning NeMo models. Dataset Co