The Video Engagement Scale (VES): measurement properties of the full and shortened VES across studies

The Video Engagement Scale (VES) is a quality indicator to assess engagement in experimental video-vignette studies, but its measurement properties warrant improvement. Data from previous studies were combined (N = 2676) and split into three subsamples for a stepped analytical approach. We tested construct validity, criterion validity, reliability, and measurement invariance. Confirmatory factor analysis (CFA) reiterated poor fit of the previously suggested subscales. An alternative 2-factor structure is presented, which was cross-validated and further shortened (VES-sf). Reliability of both subscales (Immersion, Emotional Impact) was very high (alpha > .86). Multi-group CFAs demonstrated partial and complete measurement invariance among male/female and differently educated participants respectively. Invariance between healthy versus ill participants was not established, but CFAs supported the VES-sf structure in both groups separately. To conclude, we provide the VES-sf with sound measurement properties and demonstrated the appropriateness of comparing certain subgroups. Overall, we recommend the VES-sf to assess engagement/ecological validity in video-vignette research.

Automated summary

This study improved the measurement properties of the Video Engagement Scale (VES) and proposed a more effective 2-factor structure (VES-sf). The reliability of both subscales (Immersion, Emotional Impact) was found to be very high. Furthermore, multi-group CFAs demonstrated measurement invariance among different subgroups. The study concludes that VES-sf is a reliable tool for assessing engagement/ecological validity in video-vignette research.