P7-17: Whistle Sketch: Contour Sketch-Conditioned Dolphin Whistle Generation with Diffusion Models

Wang, Luobin, Zhao, Zhengqiao*, Chen, Yankun, Xiang, Ming, Li, Kangrong, Chen, Jie

Subjects (starting with primary): Acoustic event detection and scene classification ; New and emerging topics in speech and audio processing

Presented in Poster Session 7

Abstract:

Dolphin whistles are essential for social communication, and controllable synthesis of such signals is critical to studying behavioral mechanisms and enabling human-designed interaction stimuli. We propose a diffusion-based framework for dolphin whistle generation conditioned on a user-defined fundamental frequency (F0) contour sketch. This formulation allows humans to directly specify interpretable acoustic structures, which are transformed into realistic time–frequency spectra by the generative model. Compared with previous bioacoustic synthesis approaches, the proposed method provides explicit control over whistle semantics while preserving spectral fidelity. We further evaluate its utility for data augmentation in a CRNN9-based whistle classification system, where the generated samples improve robustness over conventional augmentation strategies. The proposed approach establishes a new paradigm for controllable bioacoustic signal generation, with potential applications in animal communication analysis and human–animal interaction studies.

This PDF is password protected. Enter the proceedings password in the PDF viewer when prompted.