VR motion sickness recognition by using EEG rhythm energy ratio based on wavelet packet transform

Background and objectives: Virtual reality motion sickness (VRMS) is one of the main factors hindering the development of VR technology. At present, the VRMS recognition methods using electroencephalogram (EEG) signals have poor applicability to multiple subjects. Methods: Aiming at this dilemma, the wavelet packet transform (WPT), was used to propose a feature extraction method for EEG rhythm energy ratios of delta (delta), theta (theta), alpha (alpha), and beta (beta) in this research. Moreover, VRMS was recognized by combining k-Nearest Neighbor classifier (k-NN), support vector machine (SVM) with polynomial kernel (polynomial-SVM) and radial basis function kernel (RBF-SVM), respectively. The method is that the raw EEG signals were de-noised by an elliptical band-pass filter and segmented by a fixed window, 7-level db4 WPT was performed on each EEG segment, and the wavelet packet energy ratios of delta, theta, alpha and beta rhythms from FP1, FP2, C3, C4, P3, P4, 01 and 02 channels were calculated and combined to form feature vectors for recognizing VRMS. Results: Under the condition of 4-s window size, the average VRMS recognition accuracy of polynomialSVM for the single subject was 92.85%, and the VRMS recognition accuracy of 18 subjects was about 79.25%. Conclusions: Compared with other VRMS recognition methods, this method does not only have a higher recognition accuracy to a single subject, but also have better applicability to multiple subjects. Meanwhile, when using the EEG four rhythm energy ratios of FP1, FP2, C3, C4, P3, P4, 01 and 02 channels as feature vectors, the polynomial-SVM achieved better VRMS recognition performance than the k-NN and RBF-SVM. (C) 2019 Elsevier B.V. All rights reserved.