4.7 Article

Disengagement during lectures: Media multitasking and mind wandering in university classrooms

Journal

COMPUTERS & EDUCATION
Volume 132, Issue -, Pages 76-89

Publisher

PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.compedu.2018.12.007

Keywords

Media in education; Post-secondary education; Pedagogical issues

Funding

  1. Natural Sciences and Engineering Research Council of Canada
  2. NSERC

Ask authors/readers for more resources

In university classrooms, the use of laptops or smartphones for purposes unrelated to the lecture is on the rise. Consequently, it is important to understand how frequently this behavior occurs, to track whether it increases throughout a lecture, and to quantify the potential costs to learning. In two studies, we measured rates of disengagement during lectures related to media use (i.e. media multitasking; Studies 1 & 2) and lecture-unrelated thoughts (i.e. mind wandering; Study 2). We also measured the impact of these behaviors on learning using quiz questions at the end of each lecture, and students' actual course tests. In both Study 1 and 2, we found that rates of media multitasking were relatively high and increased as time elapsed in a lecture, while in Study 2, consistent with prior work, rates of mind wandering remained relatively stable. Interestingly, media multitasking - but not mind wandering - was associated with negative learning outcomes.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Substance Abuse

A new generation of transdermal alcohol biosensing technology: practical applications, machine -learning analytics and questions for future research

Catharine E. Fairbairn, Nigel Bosch

Summary: The use of transdermal alcohol monitors has grown rapidly, with new sensors promising to expand the range of applications. Advances in machine-learning modeling approaches offer new methods for translating the data produced by transdermal devices.

ADDICTION (2021)

Article Multidisciplinary Sciences

Alcohol narrows physical distance between strangers

Laura Gurrieri, Catharine E. Fairbairn, Michael A. Sayette, Nigel Bosch

Summary: Managing pandemics will likely continue to be a global reality for years to come, but the approach to pandemic restrictions remains unclear. Alcohol consumption during COVID-19 has sparked controversy, with concerns that it may lead to decreased adherence to physical distancing guidelines. A study found that alcohol causes individuals to physically approach unfamiliar interaction partners, potentially increasing the risk of virus transmission between previously unconnected social groups.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2021)

Article Computer Science, Interdisciplinary Applications

Identifying supportive student factors for mindset interventions: A two-model machine learning approach

Nigel Bosch

Summary: This study used machine learning methods to predict the effectiveness of growth mindset interventions among students. Prior academic achievement, blocked navigations, self-reported reasons for learning, and race/ethnicity were found to be the most important predictors of intervention effectiveness. The intervention was most effective for students with prior low academic achievement, but some students, particularly those who experience blocked navigations, were predicted to benefit less from the intervention.

COMPUTERS & EDUCATION (2021)

Article Psychology, Applied

Automated Video Interview Personality Assessments: Reliability, Validity, and Generalizability Investigations

Louis Hickman, Nigel Bosch, Vincent Ng, Rachel Saef, Louis Tay, Sang Eun Woo

Summary: This study addresses the lack of research on the reliability, validity, and generalizability of automated video interviews (AVIs) for screening job applicants by developing and validating machine learning models to assess Big Five personality traits. Results show that AVI personality assessments trained on interviewer-reports exhibit stronger evidence of validity.

JOURNAL OF APPLIED PSYCHOLOGY (2022)

Article Chemistry, Multidisciplinary

Ask for Help: Online Help-Seeking and Help-Giving as Indicators of Cognitive and Social Presence for Students Underrepresented in Chemistry

Destiny Williams-Dobosz, Amos Jeng, Renato F. L. Azevedo, Nigel Bosch, Christian Ray, Michelle Perry

Summary: The study found that requests for help in an online college-level chemistry course's discussion forum were responded to equally, regardless of how explicitly students appealed for help. Furthermore, underrepresented chemistry students and non-underrepresented chemistry students requested and responded to help similarly, but the former received help at greater rates. Results indicate that productive and substantive help-seeking and help-giving discussions occur in an online discussion forum, highlighting the importance of help-seeking as a necessary learning skill in informing chemistry instruction and learning.

JOURNAL OF CHEMICAL EDUCATION (2021)

Article Computer Science, Artificial Intelligence

Automatic Detection of Mind Wandering from Video in the Lab and in the Classroom

Nigel Bosch, Sidney K. D'Mello

Summary: The study reports on the use of facial features to automatically detect mind wandering in both laboratory and classroom settings, achieving above-chance improvements. The results suggest that integrating mind wandering detectors into intelligent interfaces can enhance engagement and learning.

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING (2021)

Article Computer Science, Cybernetics

Can Computers Outperform Humans in Detecting User Zone-Outs? Implications for Intelligent Interfaces

Nigel Bosch, Sidney K. D'Mello

Summary: This study analyzed the ability to identify whether a user is zoning out from video and explored the performance differences between humans and automatic computerized approaches, as well as the potential improvement through fusion of the two. The findings showed that a state-of-the-art machine learning model had comparable accuracy to human observers, and the fusion of the two improved accuracy by focusing on complementary cues. Furthermore, adding more human observers beyond a certain number did not yield significant returns in accuracy.

ACM TRANSACTIONS ON COMPUTER-HUMAN INTERACTION (2022)

Article Psychology, Educational

The evolution of metacognitive strategy use in an open-ended learning environment: Do prior domain knowledge and motivation play a role?

Yingbin Zhang, Luc Paquette, Nigel Bosch, Jaclyn Ocumpaugh, Gautam Biswas, Stephen Hutt, Ryan S. Baker

Summary: This study investigated the evolution of metacognitive strategy use in a computer-based learning environment. The results showed that students' use of metacognitive strategies changed over time and varied among individuals. Task value and prior domain knowledge could explain this evolution and individual differences.

CONTEMPORARY EDUCATIONAL PSYCHOLOGY (2022)

Article Education & Educational Research

Sense of belonging predicts perceived helpfulness in online peer help-giving interactions

Amos Jeng, Nigel Bosch, Michelle Perry

Summary: This study examined how students' sense of belonging and demographic background can predict their perception of helpfulness in replies to requests for help on an online college course discussion forum. The researchers surveyed college students enrolled in an introductory statistics course to assess their sense of belonging to the course community and their perceived helpfulness of 20 examples of replies to help requests. The findings indicated that students with lower sense of belonging rated helpgiving replies as less helpful for their learning compared to those with higher sense of belonging. Additionally, students with lower sense of belonging were more likely to emphasize social support as a criterion for effective peer assistance.

INTERNET AND HIGHER EDUCATION (2023)

Proceedings Paper Computer Science, Theory & Methods

Novice Reflections During the Transition to a New Programming Language

Paul Denny, Brett A. Becker, Nigel Bosch, James Prather, Brent Reeves, Jacqueline Whalley

Summary: This paper investigates the transition from an interpreted language (MATLAB) to a compiled language (C) for computing students. The study analyzes the benefits and difficulties perceived by students in their own words. Surprisingly, it is found that the highest-performing students express more negative sentiments towards the language transition, which is hypothesized to be due to their stronger metacognitive skills. The most common difficulties reported by students include syntax, error messages, and the compilation process.

PROCEEDINGS OF THE 53RD ACM TECHNICAL SYMPOSIUM ON COMPUTER SCIENCE EDUCATION (SIGCSE 2022), VOL 1 (2022)

Proceedings Paper Computer Science, Interdisciplinary Applications

Tracking Individuals in Classroom Videos via Post-processing OpenPose Data

Paul Hur, Nigel Bosch

Summary: This study explores measuring posture and movement in secondary classroom video data using computer vision methods, particularly OpenPose. The researchers introduce a simple yet effective approach to automatically track movement through post-processing of OpenPose output data. Despite challenges such as occlusion and difficulty detecting lower body movement, the approach successfully tracked person IDs for the majority of detected individuals. The study also discusses the implications for supporting more scalable video data analysis and future potential explorations.

LAK22 CONFERENCE PROCEEDINGS: THE TWELFTH INTERNATIONAL CONFERENCE ON LEARNING ANALYTICS & KNOWLEDGE (2022)

Proceedings Paper Computer Science, Interdisciplinary Applications

A Social Network Analysis of Online Engagement for College Students Traditionally Underrepresented in STEM

Destiny Williams-Dobosz, Renato Ferreira Leitao Azevedo, Amos Jeng, Vyom Thakkar, Suma Bhat, Nigel Bosch, Michelle Perry

Summary: This study investigated the impact of online discussion forum engagement on the success of UR-STEM and non-UR-STEM students using the Community of Inquiry model. The results indicated a significant positive relationship between help-seeking behavior and improvement, while general posting and connectivity had nonsignificant effects on improvement.

LAK21 CONFERENCE PROCEEDINGS: THE ELEVENTH INTERNATIONAL CONFERENCE ON LEARNING ANALYTICS & KNOWLEDGE (2021)

Proceedings Paper Computer Science, Artificial Intelligence

Automating Procedurally Fair Feature Selection in Machine Learning

Clara Belitz, Lan Jiang, Nigel Bosch

Summary: In recent years, machine learning has been increasingly used in various applications, leading to studies on unfairness issues. A feature selection method inspired by fair process was proposed to reduce unfairness while maintaining accuracy. Experimental results showed that the method effectively decreases unfairness in most cases.

AIES '21: PROCEEDINGS OF THE 2021 AAAI/ACM CONFERENCE ON AI, ETHICS, AND SOCIETY (2021)

Article Industrial Relations & Labor

Developing and evaluating language-based machine learning algorithms for inferring applicant personality in video interviews

Louis Hickman, Rachel Saef, Vincent Ng, Sang Eun Woo, Louis Tay, Nigel Bosch

Summary: Organizations are increasingly turning to people analytics for human resources decision-making, including using machine learning to infer applicant characteristics from employment interviews. However, research on the validity of these algorithms in organizational decision-making is lacking. This study used text mining on mock video interviews to predict interviewee's self-reported and interviewer-rated personality traits, finding that predicting interviewer ratings was more accurate than predicting self-reports, with implications for future research and practice.

HUMAN RESOURCE MANAGEMENT JOURNAL (2021)

Proceedings Paper Computer Science, Theory & Methods

The relationship between confusion and metacognitive strategies in Betty's Brain

Yingbin Zhang, Luc Paquette, Ryan S. Baker, Jaclyn Ocumpaugh, Nigel Bosch, Anabil Munshi, Gautam Biswas

LAK20: THE TENTH INTERNATIONAL CONFERENCE ON LEARNING ANALYTICS & KNOWLEDGE (2020)

Article Computer Science, Interdisciplinary Applications

Supporting students' basic psychological needs and satisfaction in a blended learning environment through learning analytics

Elise Ameloot, Tijs Rotsaert, Thomas Ameloot, Bart Rienties, Tammy Schellens

Summary: This study investigates the impact of using learning analytics to support students' autonomy and competence needs in a blended learning environment. The findings show that teachers' adaptation based on learning analytics positively influences students' satisfaction with the adapted learning environment. However, students' basic psychological needs vary depending on the face-to-face workshop subject. The study emphasizes the importance of thoughtful blended learning course design and provides recommendations for effective learning analytics utilization in university settings.

COMPUTERS & EDUCATION (2024)

Article Computer Science, Interdisciplinary Applications

Enhancing elementary school students' computational thinking and programming learning with graphic organizers

Tzu-Chi Yang, Zhi-Shen Lin

Summary: Computational thinking is essential in the current era and learning programming is the most effective way to develop it. Introducing computational thinking and programming at an early age is recommended. Graphic organizers serve as a bridge between students' existing knowledge and new learning, enhancing their learning process. The study found that using graphic organizers improved elementary school students' computational thinking, programming skills, and learning experiences.

COMPUTERS & EDUCATION (2024)

Article Computer Science, Interdisciplinary Applications

Collaborative analytics-enhanced reflective assessment to foster conducive epistemic emotions in knowledge building

Yuqin Yang, Kaicheng Yuan, Gaoxia Zhu, Lizhen Jiao

Summary: The study finds that the design of collaborative analytics-enhanced reflective assessment can promote conducive epistemic emotions to knowledge building among undergraduates, and enriches our understanding of the relationships between metacognition, epistemic emotions, and knowledge building practices.

COMPUTERS & EDUCATION (2024)

Article Computer Science, Interdisciplinary Applications

A novel quantitative assessment of engagement in virtual reality: Task-unrelated thought is reduced compared to 2D videos.

Vishal Kiran Kuvar, Jeremy N. Bailenson, Caitlin Mills

Summary: Recent research suggests that students' minds often wander off-task during learning, regardless of the learning modality. This study explores the potential of virtual reality (VR) to reduce task-unrelated thoughts (TUT) and finds that learning with VR leads to lower TUT and better performance.

COMPUTERS & EDUCATION (2024)

Article Computer Science, Interdisciplinary Applications

Adopt or abandon: Facilitators and barriers of in-service teachers' integration of game learning analytics in K-12 classrooms?

Yiming Liu, Jeremy Tzi Dong Ng, Xiao Hu, Zhengyang Ma, Xiaoyan Lai

Summary: This study examines teachers' usage intention and behavior towards the Game Learning Analytics (GLA) system in K-12 classrooms. The study found that personal, environmental, and technological factors influenced teachers' intention and behavior, and that technostress moderated the intention-behavior relationship. The study also identified the heterogeneity of GLA usage among teachers with different individual characteristics.

COMPUTERS & EDUCATION (2024)

Article Computer Science, Interdisciplinary Applications

Supporting the monitoring of the digital capacity of schools through optimal shortening of the SELFIE tool

Romina Cachia, Artur Pokropek, Nikoleta Giannoutsou

Summary: This article introduces a shortened version of the European Commission's SELFIE tool for measuring the digital capacity of schools. Two shorter measurement instruments, called midi-SELFIE and mini-SELFIE, are proposed based on the original tool. The validity and uses of these shortened versions are explored through various cases and compared to the complete instrument. The results suggest that the shortened versions of SELFIE are reliable alternatives for specific purposes.

COMPUTERS & EDUCATION (2024)