Decentralized Parallel SGD With Privacy Preservation in Vehicular Networks

With the prosperity of vehicular networks and intelligent transport systems, vast amount of data can be easily collected by vehicular devices from their users and widely spread in the vehicular networks for the purpose of solving large-scale machine learning problems. Hence how to preserve the data privacy of users during the learning process has become a public concern. To address this concern, under the celebrated framework of differential privacy (DP), we present in this paper a decentralized parallel stochastic gradient descent (D-PSGD) algorithm, called DP2-SGD, which can offer protection for privacy of users in vehicular networks. With thorough analysis we show that DP2-SGD satisfies (epsilon, delta)- DP while the learning efficiency is the same as D-PSGD without privacy preservation. We also propose a refined algorithm called EC-SGD by introducing an error-compensate strategy. Extensive experiments show that EC-SGD can further improve the convergence efficiency over DP2-SGD in reality.

Automated summary

This paper introduces the DP2-SGD algorithm under the framework of differential privacy to protect the privacy of users in vehicular networks, and proposes the EC-SGD algorithm with an error-compensate strategy to further improve convergence efficiency. Extensive experiments show EC-SGD can outperform DP2-SGD in reality.