D02: Interactive Graph-based 6DoF Ambisonic Rendering from Sparse Microphone Arrays

Gioele Greco*, Filippo Marri, Mirco Pezzoli, Fabio Antonacci

Subjects (starting with primary): Spatial audio recording and reproduction; Acoustic sensor networks

Presented in Demo Session

Related paper: P3-13: Graph Neural Network for Wide-Area 6DoF Ambisonic Rendering

Abstract:

This demonstration presents a real-time, interactive system for wide-area six-degrees-of-freedom (6DoF) Ambisonic rendering from a sparse set of first-order Ambisonic microphone arrays. The system implements a graph neural network (GNN) that predicts scene-dependent interpolation weights for Directional Audio Coding (DirAC) descriptors, while preserving an analytical spatial-audio rendering stage. Attendees can move and rotate a listener on a metric map, reposition the microphone arrays, switch between learned GNN interpolation and a Delaunay baseline, inspect the graph features, and immediately hear the resulting binaural rendering over headphones.