Transfer Learning for Neural Networks-Based Equalizers in Coherent Optical Systems

In this work, we address the question of the adaptability of artificial neural networks (NNs) used for impairments mitigation in optical transmission systems. We demonstrate that by using well-developed techniques based on the concept of transfer learning, we can efficaciously retrain NN-based equalizers to adapt to the changes in the transmission system, using just a fraction (down to 1%) of the initial training data or epochs. We evaluate the capability of transfer learning to adapt the NN to changes in the launch power, modulation format, symbol rate, or even fiber plants (different fiber types and lengths). The numerical examples utilize the recently introduced NN equalizer consisting of a convolutional layer coupled with bi-directional long-short term memory (biLSTM) recurrent NN element. Our analysis focuses on long-haul coherent optical transmission systems for two types of fibers: the standard single-mode fiber (SSMF) and the TrueWave Classic (TWC) fiber. We underline the specific peculiarities that occur when transferring the learning in coherent optical communication systems and draw the limits for the transfer learning efficiency. Our results demonstrate the effectiveness of transfer learning for the fast adaptation of NN architectures to different transmission regimes and scenarios, paving the way for engineering flexible and universal solutions for nonlinearity mitigation.

Automated summary

In this work, the adaptability of artificial neural networks (NNs) used for impairments mitigation in optical transmission systems is addressed through transfer learning techniques. The study demonstrates the effectiveness of retraining NN-based equalizers to adapt to changes in the transmission system with just a fraction of the initial training data or epochs. Transfer learning proves to be efficient in adapting NN architectures to different transmission regimes and scenarios, showing promise for engineering flexible and universal solutions for nonlinearity mitigation in coherent optical communication systems.