P5-05: An SVD View of Conv-TasNet: Signal-processing Structure, Spectral Dynamics, and Low-rank Compression
Liu, Jingwei*, Sandler, Mark
Subjects (starting with primary): New and emerging topics in speech and audio processing ; Speaker separation, extraction and diarization
Presented in Poster Session 5
Conv-TasNet is often presented as a neural time-domain separator, but its design is deeply rooted in acoustic signal processing: a learned analysis-synthesis filter bank replaces the STFT, masking is retained as the separation mechanism, and temporal convolutions implement structured finite-impulse-response filtering. This paper studies Conv-TasNet through singular value decomposition (SVD). For depthwise temporal convolutions, we view each filter as a Toeplitz operator, linking its singular spectrum to the filter frequency response through Szeg˝o-type theory. For pointwise 1 × 1 convolutions, we analyze the evolution of singular values and singular subspaces during training, showing rapid early spectral concentration and progressive stabilization. We then summarize a low-rank factorization scheme for the pointwise layers. On Libri2Mix, truncation near the effective rank gives the strongest compression-performance trade-off, while more aggressive truncation degrades gracefully. These results position Conv-TasNet as both an interpretable signal-processing architecture and a compressible low-rank model.
This PDF is password protected. Enter the proceedings password in the PDF viewer when prompted.