P5-16: GAN-Based Joint Dereverberation and Directional Filtering

Huang, Weilong*, Shetu, Shrishti Saha, Habets, Emanuël A. P.

Subjects (starting with primary): Dereverberation ; Microphone array processing

Presented in Poster Session 5

Abstract:

Recently, neural directional filtering (NDF) enables reconstruction of a virtual directional microphone (VDM) with a desired directivity pattern, accurately rendering multi-source scenes by preserving spatial cues. In strongly reverberant environments, spatial cues become perceptually difficult to distinguish, limiting NDF-based spatial sound capture. This paper addresses this limitation with three contributions: First, we propose a neural dereverberation and directional filtering (NDDF) approach to reconstruct dereverberated VDM signals. Second, NDDF is implemented with discriminatively trained and GAN-based models, compared with cascaded dereverberation and directional-filtering baselines. Experimental results show GAN-based NDDF outperforms other approaches. Third, we introduce a method for directivity pattern estimation that relies solely on the input and output signals. This method is suitable for signal-mapping-based spatial filtering, which synthesizes the output signal directly without explicit filtering or masking.

This PDF is password protected. Enter the proceedings password in the PDF viewer when prompted.