Inter-SubNet: Speech Enhancement with Subband Interaction

Accepted by ICASSP 2023

Download this project as a .zip file Download this project as a tar.gz file

Inter-SubNet: Speech Enhancement with Subband Interaction

Jun Chen, Wei Rao, Zilin Wang, Jiuxin Lin, Zhiyong Wu, Yannan Wang, Shidong Shang, Helen Meng

Abstract

Subband-based approaches process subbands in parallel through the model with shared parameters to learn the commonality of local spectrums for noise reduction. In this way, they have achieved remarkable results with fewer parameters. However, in some complex environments, the lack of global spectral information has a negative impact on the performance of these subband-based approaches. To this end, this paper introduces the subband interaction as a new way to complement the subband model with the global spectral information such as cross-band dependencies and global spectral patterns, and proposes a new lightweight single-channel speech enhancement framework called Interactive Subband Network (Inter-SubNet). Experimental results on DNS Challenge - Interspeech 2021 dataset show that the proposed Inter-SubNet yields a significant improvement over the subband model and outperforms other state-of-the-art speech enhancement approaches, which demonstrate the effectiveness of subband interaction.


Fig.1: The general schematic of the proposed Inter-SubNet, where "SIL block 1" and "SIL block 2" refer to the first and second SubInter-LSTM block respectively. The "G-norm" denotes group normalization. The Inter-SubNet \(G_{is}\) mainly consists of two stacked SIL blocks and one fully-connected layer. Taking the subband units \(\{\mathbf{b}_i\}_{i=1}^F\) as input, the model \(G_{is}\) generates the final output cIRM \(\mathbf{M}^{r}\) and \(\mathbf{M}^{i}\).

Without Reverberation

case 1

case 1  
Noisy
Subband model
noisy baseline
Inter-SubNet
Clean
proposed clean

case 2

case 2  
Noisy
Subband model
noisy baseline
Inter-SubNet
Clean
proposed clean

case 3

case 3  
Noisy
Subband model
noisy baseline
Inter-SubNet
Clean
proposed clean

case 4

case 4  
Noisy
Subband model
noisy baseline
Inter-SubNet
Clean
proposed clean

With Reverberation

case 1

case 1  
Noisy
Subband model
noisy baseline
Inter-SubNet
Clean
proposed clean

case 2

case 2  
Noisy
Subband model
noisy baseline
Inter-SubNet
Clean
proposed clean

case 3

case 3  
Noisy
Subband model
noisy baseline
Inter-SubNet
Clean
proposed clean

case 4

case 4  
Noisy
Subband model
noisy baseline
Inter-SubNet
Clean
proposed clean