P7-09: Preserving Spatial Information in Music Source Separation
Acerbi, Matteo*, Pezzoli, Mirco, Antonacci, Fabio, Bianchi, Lucio
Subjects (starting with primary): Spatial audio recording and reproduction ; Modelling, analysis and synthesis of acoustic environments ; Speaker separation, extraction and diarization
Presented in Poster Session 7
Music Source Separation (MSS) models based on Deep Neural Networks have reached state-of-the-art performance in splitting stereo mixtures into separate sources. However, little attention has been paid to how well these models preserve the spatial properties of each separated source. Motivated by applications in virtual/augmented reality and accessibility, we propose Spatially-Aware HT-Demucs (SA-HTDemucs), a novel deep learning framework that extends HT-Demucs with a per-source SpatialCueModule, which corrects the Interaural Level Difference (ILD) in the time-frequency domain to preserve the azimuth panning of each estimated source. The model is trained and evaluated on binauralMUSDB18-HQ, a novel binaural dataset synthesized by convolving each source stem in MUSDB18-HQ with open-source Head-Related Transfer Functions (HRTFs) at randomized horizontal positions. Results show that SA-HTDemucs consistently improves spatial location preservation across all sources compared to the HT-Demucs baseline, opening promising directions at the intersection of MSS and immersive audio.
This PDF is password protected. Enter the proceedings password in the PDF viewer when prompted.