Journal
MULTIMEDIA TOOLS AND APPLICATIONS
Volume 41, Issue 3, Pages 469-493Publisher
SPRINGER
DOI: 10.1007/s11042-008-0240-1
Keywords
User attention estimation; Head pose; Eye gaze; Facial feature detection and tracking
Categories
Funding
- FP6 IP Callas (Conveying Affectiveness in Leading-edge Living Adaptive Systems) [IST-034800, IST-034549]
Ask authors/readers for more resources
Most e-learning environments which utilize user feedback or profiles, collect such information based on questionnaires, resulting very often in incomplete answers, and sometimes deliberate misleading input. In this work, we present a mechanism which compiles feedback related to the behavioral state of the user (e.g. level of interest) in the context of reading an electronic document; this is achieved using a non-intrusive scheme, which uses a simple web camera to detect and track the head, eye and hand movements and provides an estimation of the level of interest and engagement with the use of a neuro-fuzzy network initialized from evidence from the idea of Theory of Mind and trained from expert-annotated data. The user does not need to interact with the proposed system, and can act as if she was not monitored at all. The proposed scheme is tested in an e-learning environment, in order to adapt the presentation of the content to the user profile and current behavioral state. Experiments show that the proposed system detects reading- and attention-related user states very effectively, in a testbed where children's reading performance is tracked.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available