Design of fully interpretable neural networks for digital coherent demodulation

In this paper, we propose a digital coherent demodulation architecture using fully interpretable deep neural networks (NNs). We show that all the conventional coherent digital signal processing (DSP) is deeply unfolded into a well-structured NN so that the established training algorithms in machine learning can be applied. In contrast to adding or replacing certain algorithms of existing DSP in coherent receivers, we replace all the coherent demodulation algorithms with a fully interpretable NN (FINN), making the whole NN interpretable. The FINN is modular and flexible to add or drop modules, including chromatic dispersion compensation (CDC), the digital back-propagation (DBP) algorithm for fiber nonlinearity compensation, carrier recovery and residual impairments. The resulted FINN can be quickly initialized by straightforwardly referring to the conventional DSP, and can also enjoy further performance enhancement in the nonlinear fiber transmissions by NN. We conduct a 132-Gb/s polarization multiplexed (PM)-16QAM transmission experiment over 600-km standard single mode fiber. The experimental results show that without fiber nonlinearity compensation, FINN-CDC obtains less than 0.06-dB SNR gain than chromatic dispersion compensation (CDC). However, with fiber nonlinearity compensation, 2-steps per span FINN-DBP (FINN-2sps-DBP) and FINN-1sps-DBP bring about 0.59-dB and 0.53-dB SNR improvement compared with the conventional 2sps-DBP and 1sps-DBP, respectively.(c) 2022 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement

Automated summary

In this paper, a digital coherent demodulation architecture using fully interpretable deep neural networks (NNs) is proposed. The conventional coherent digital signal processing (DSP) is deeply unfolded into a well-structured NN to enable the application of established training algorithms in machine learning. The results demonstrate the potential of the proposed architecture to improve the performance in fiber transmissions by utilizing the NN for nonlinear fiber compensation.