D03: Diffusion on Your Phone: On-Device AEC and Postfilter Speech Communication Framework
Ernst Seidel*, Haljan Lugo, Marvin Sach, Pejman Mowlaee, Tim Fingscheidt
Subjects (starting with primary): Acoustic echo feedback and suppression
Presented in Demo Session
Related paper: P1-07: DiffVQE2: An Efficient Low-Delay Diffusion Model for Acoustic Echo and Noise Control
In speech communication, background noise and acoustic echo are challenging obstacles to overcome. This is especially the case for applications where a loudspeaker is close to the microphone and the acoustic environment can change quickly, e.g., when using smartphones in hands-free mode. We propose a flexible speech communication demonstrator which not only allows easy implementation of various models (including our newest published models), but also realizes a full-duplex connection with on-device processing for arbitrary devices. Demo participants are encouraged to try our models on their own smartphones through our web interface. Presented models include a classical subband NLMS echo canceller with our own data-driven CGGN16 postfilter as well as our end-to-end DiffVQE2-S model. With the latter, to our knowledge, we are the first to showcase diffusion-based acoustic echo and noise control running in real time on a smartphone. Our framework will be publicly released.