Kohn-Sham Equations as Regularizer: Building Prior Knowledge into Machine-Learned Physics

Including prior knowledge is important for effective machine learning models in physics and is usually achieved by explicitly adding loss terms or constraints on model architectures. Prior knowledge embedded in the physics computation itself rarely draws attention. We show that solving the Kohn-Sham equations when training neural networks for the exchange-correlation functional provides an implicit regularization that greatly improves generalization. Two separations suffice for learning the entire one-dimensional H-2 dissociation curve within chemical accuracy, including the strongly correlated region. Our models also generalize to unseen types of molecules and overcome self-interaction error.

Automated summary

Incorporating prior knowledge into machine learning models for physics is crucial for improving generalization performance. Solving the Kohn-Sham equations when training neural networks for the exchange-correlation functional provides implicit regularization, enhancing predictive capabilities effectively.