期刊
PERVASIVE AND MOBILE COMPUTING
卷 75, 期 -, 页码 -出版社
ELSEVIER
DOI: 10.1016/j.pmcj.2021.101424
关键词
Wearables; Emotion monitoring; Facial expression detection; Bio-signal acquisition; Pupillometry
资金
- National Science Foundation [CNS-1704899, CNS1815274, CNS-11943396, CNS-1837022]
SPIDERS+ is a low-cost, wireless glasses-based platform for monitoring user's facial expressions and real emotions, with advanced functionalities like facial expression detection and real emotion classification. It distinguishes between different emotion states based on eye shape, eyebrow movements, pupillometry, and other bio-signals, achieving high accuracy in emotion classification.
We present a System for Processing In-situ Bio-signal Data for Emotion Recognition and Sensing (SPIDERS+) - a low-cost, wireless, glasses-based platform for continuous in-situ monitoring of user's facial expressions (apparent emotions) and real emotions. We present algorithms to provide four core functions to detect eye shape and eyebrow movements, pupillometry, zygomaticus muscle movements, and head movements, using the bio-signals acquired from three non-contact sensors (IR camera, proximity sensor, and IMU). SPIDERS+ distinguishes between different classes of apparent and real emotion states based on the aforementioned four bio-signals. We prototype advanced functionalities including facial expression detection and real emotion classification with a facial expression detector based on landmarks and optical flow that leverages changes in a user's eyebrows and eye shapes to achieve the average true positive rate up to 83.87%, as well as a pupillometry-based real emotion classifier with higher accuracy than existing low-cost wearable platforms that use sensors requiring skin contact. In addition, SPIDERS+ also includes optional contact-based sensors such as photoplethysmography (PPG) and multi-channel electroencephalogram (EEG) to monitor other bio-signals. SPIDERS+ costs less than $20 to assemble and can continuously run for up to 9 h before recharging. We design, implement and evaluate accompanying desktop and smartphone applications to demonstrate that SPIDERS+ is a truly wireless and portable platform that can impact a wide range of applications, where the knowledge of the user's emotional state is critical. (C) 2021 Elsevier B.V. All rights reserved.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据