4.3 Article

The Robust Reliability of Neuropsychological Measures: Meta-Analyses of Test-Retest Correlations

期刊

CLINICAL NEUROPSYCHOLOGIST
卷 27, 期 7, 页码 1077-1105

出版社

TAYLOR & FRANCIS INC
DOI: 10.1080/13854046.2013.809795

关键词

Reliability generalization; Neuropsychological assessment; Serial testing

向作者/读者索取更多资源

Test-retest reliability is an important psychometric property relevant to assessment instruments typically used in neuropsychological assessment. This review presents a quantitative summary of test-retest reliability coefficients for a variety of widely used neuropsychological measures. In general, the meta-analytic test-retest reliabilities of the test scores ranged from adequate to high (i.e., r=.7 and higher). Furthermore, the reliability values were largely robust across factors such as age, clinical diagnosis, and the use of alternate forms. The values for some of the memory and executive functioning scores were lower (i.e., less than r=.7). Some of the possible reasons for these lower values include ceiling effects, practice effects, and across time variability in cognitive abilities measured by those tests. In general, neuropsychologists who use these measures in their assessments can be encouraged by the magnitude of the majority of the meta-analytic test-retest correlations obtained.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.3
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Geriatrics & Gerontology

Resilience as a moderator of depression and anxiety: a bidimensional approach to predictors of subjective cognition in older adults

Luke R. Miller, Ross Divers, Christopher Reed, Erika Pugh, Matthew Calamia

Summary: This study aimed to investigate the influence of positive psychology factors on subjective cognitive complaints (SCCs) in older adults. The results showed that resilience can mitigate the negative effects of depression and anxiety on complaints.

AGING & MENTAL HEALTH (2023)

Article Geriatrics & Gerontology

Longitudinal Predictors of Informant-Rated Everyday Function in Mild Cognitive Impairment

Ross M. Divers, Alyssa N. De Vito, Erika A. Pugh, Anthony Robinson, Daniel S. Weitzner, Matthew R. Calamia

Summary: This study aimed to examine predictors of everyday functioning in mild cognitive impairment (MCI) and its relation to conversion to dementia. The results showed consistent associations between depression, speed/executive function, and memory with everyday functioning. Race, education, and age showed more variability in their associations. Impairments in financial and memory/orientation domains predicted future conversion to dementia. The study highlights the importance of monitoring declines in financial and memory/orientation domains and addressing depression as a modifiable risk factor for functional impairment over time.

JOURNAL OF GERIATRIC PSYCHIATRY AND NEUROLOGY (2023)

Article Gerontology

Religiosity and Social Support Predict Resilience in Older Adults After a Flood

Katie E. Cherry, Matthew R. Calamia, Emily M. Elliott, Katelyn J. McKneely, Quyen P. Nguyen, Cayman A. Loader, Luke R. Miller, Laura Sampson, Sandro Galea

Summary: This study examined the predictors of resilience after a devastating flood, focusing on religiosity and social support. The results showed that older age was associated with higher religiosity, charitable work done for others, and resilience. Regression analyses revealed that religious beliefs and coping, social support, and charitable work were all associated with higher levels of resilience, while flood damage was not related to resilience. Implications for current views on post-disaster adversity and resilience in later life are discussed.

INTERNATIONAL JOURNAL OF AGING & HUMAN DEVELOPMENT (2023)

Article Psychology, Clinical

Examination of the Relationship Between Dimensions of Perfectionism, Harm Avoidance and Incompleteness in College Students

Anthony Robinson, Sara M. Stasik-O'Brien, Jonathan Schneider, Matthew Calamia

Summary: The present study examined the relationship between perfectionism, OCD symptom dimensions, harm avoidance, and incompleteness in college students. Results showed that all five higher-order dimensions of perfectionism were related to incompleteness, while only three were related to harm avoidance. Incompleteness played a stronger role than harm avoidance in the relationship. These findings highlight the importance of targeting interventions to address incompleteness in order to potentially prevent the development or worsening of obsessive-compulsive symptoms.

JOURNAL OF COGNITIVE PSYCHOTHERAPY (2023)

Article Psychology, Developmental

Settling the Score: Can CPT-3 Embedded Validity Indicators Distinguish Between Credible and Non-Credible Responders Referred for ADHD and/or SLD?

Anthony Robinson, Christopher Reed, Katrail Davis, Ross Divers, Luke Miller, Laszlo A. Erdodi, Matthew Calamia

Summary: The present study aimed to investigate the clinical utility of individual and composite indicators within the CPT-3 as embedded validity indicators. The results showed that several indicators had low classification accuracy and sensitivity, indicating a need for further research to determine the cutoff values to be used in psychoeducational assessment.

JOURNAL OF ATTENTION DISORDERS (2023)

Article Psychology, Clinical

Failing The b Test: The influence of cutoff scores and criterion group approaches in a sample of adults referred for psychoeducational evaluation

Anthony Robinson, Marissa Huber, Eathan Breaux, Erika Pugh, Matthew Calamia

Summary: This study aimed to examine the influence of cutoff scores and criterion grouping approaches on The b Test classification accuracy. The results demonstrated that setting cutoff scores to 82, 90, and 120, and using 0 PVT failures vs. ≥ 2 PVT failures and 0 PVT failures vs. ≥ 1 PVT failures as criterion grouping approaches resulted in the highest classification accuracy.

JOURNAL OF CLINICAL AND EXPERIMENTAL NEUROPSYCHOLOGY (2023)

Article Criminology & Penology

M is For Performance Validity: The IOP-M Provides a Cost-Effective Measure of the Credibility of Memory Deficits during Neuropsychological Evaluations

Laszlo Erdodi, Matthew Calamia, Matthew Holcomb, Anthony Robinson, Lauren Rasmussen, Kevin Bianchini

Summary: This study examined the classification accuracy of the Memory module of the Inventory of Problems in a sample of real-world patients. The IOP-M accurately classified between 73% and 91% of the sample, demonstrating its potential as an effective tool for evaluating performance validity in neuropsychological assessments.

JOURNAL OF FORENSIC PSYCHOLOGY RESEARCH AND PRACTICE (2023)

Article Geriatrics & Gerontology

Longitudinal assessment of mental health after a flood: roles of social support, hope, recovery stressors, and prior lifetime trauma

Katie E. Cherry, Luke R. Miller, Piper J. Bordes, Matthew R. Calamia, Emily M. Elliott, Laura Sampson, Sandro Galea

Summary: This study longitudinally assessed the mental health of three groups of middle-aged and older adults who had experienced severe flooding. The results showed that flooded individuals had elevated depression and PTSD symptoms at Wave 1, but these symptoms reduced at Wave 2. Older age was associated with fewer mental health symptoms. Recovery stressors and lifetime trauma predicted more PTSD symptoms. Greater agency predicted fewer PTSD and depression symptoms, while pathways predicted less worry.

AGING & MENTAL HEALTH (2023)

Article Psychology, Clinical

Serial position effects and mild cognitive impairment: a comparison of measures and scoring approaches

Daniel Weitzner, Matthew Calamia

Summary: Serial position effects (SPEs) have shown promise as predictors of future cognitive decline and conversion from mild cognitive impairment (MCI) to Alzheimer's disease (AD), even when accounting for total learning and memory scores. However, conflicting results have been found in the literature, which may be at least partially related to the many ways in which SPEs are calculated.

JOURNAL OF CLINICAL AND EXPERIMENTAL NEUROPSYCHOLOGY (2023)

Article Geriatrics & Gerontology

Baseline Differences in Driving Frequency as a Predictor of Cognitive Decline and Alzheimer's Disease

Luke R. Miller, Christopher Reed, Ross Divers, Matthew Calamia

Summary: By investigating the daily driving frequency as a predictor of cognitive decline and later diagnosis of Alzheimer's disease, our study extends prior research. We found that lower daily driving frequency at baseline was associated with greater cognitive decline over time, except for working memory. However, when considering other factors such as activities of daily living (ADLs), driving frequency did not uniquely predict Alzheimer's disease development. Future research could explore the utility of driving habits, especially changes in driving, as measures of everyday functioning in older adults.

JOURNAL OF GERIATRIC PSYCHIATRY AND NEUROLOGY (2023)

Article Clinical Neurology

Four year practice effects on the RBANS in a longitudinal study of older adults

Christopher Reed, Matthew Calamia, Mark Sanderson-Cimino, Alyssa DeVito, Robert Toups, Jeffrey Keller

Summary: This study aimed to investigate the practice effects on the RBANS in cognitively healthy older adults four years after baseline. The results showed that scores on the immediate memory, delayed memory, and total score indices continued to increase with repeated assessments. These findings suggest that memory measures of the RBANS are susceptible to practice effects, raising concerns about using the same form of the RBANS for multiple years in longitudinal studies to recruit those at risk for cognitive decline.

APPLIED NEUROPSYCHOLOGY-ADULT (2023)

Article Clinical Neurology

Logical memory, visual reproduction, and verbal paired associates are effective embedded validity indicators in patients with traumatic brain injury

Brad T. Tyson, Sadie R. Pyne, Iulia Crisan, Matthew Calamia, Matthew Holcomb, Luciano Giromini, Laszlo A. Erdodi

Summary: This study evaluates the potential of using the subtests of the Wechsler Memory Scales-Fourth Edition (WMS-IV) as embedded performance validity tests (PVTs). The classification accuracy of the subtests was computed against different criterion PVTs in a sample of traumatic brain injury (TBI) patients. The results show that the subtests can function as PVTs with good sensitivity and specificity.

APPLIED NEUROPSYCHOLOGY-ADULT (2023)

Article Psychology, Clinical

Factor Structure and Measurement Invariance of the Suicide Status Form-IV

Nicolas Oakey-Frost, Ross Divers, Emma H. Moscardini, Sarah Pardue-Bourgeois, Jessica Gerner, Anthony Robinson, Eathan Breaux, Kathleen A. Crapanzano, Matthew Calamia, David A. Jobes, Raymond P. Tucker

Summary: This study replicated previous factor analyses and used measurement invariance to identify differences in the Core Assessment by race and gender. The findings indicated that a one-factor solution for the SSF-IV Core Assessment is measurement invariant, and race and gender do not significantly moderate the relationship between the Core Assessment total score and clinical outcomes.

ASSESSMENT (2023)

Article Psychology, Clinical

The structure of apathy symptoms

Matthew Calamia, Kristian Markon, Daniel Tranel

Summary: The study found that a bifactor model with a general dimension and three specific symptom factors best fit the apathy symptoms. The use of this more comprehensive assessment showed incremental validity in predicting cognition.

JOURNAL OF CLINICAL AND EXPERIMENTAL NEUROPSYCHOLOGY (2023)

Article Psychology, Clinical

Toward a More Perfect Conceptualization of Perfectionism: An Exploratory Factor Analysis in Undergraduate College Students

Anthony Robinson, Sara Stasik-O'Brien, Matthew Calamia

Summary: This study aimed to identify the underlying factor structure of perfectionism using multiple measures and examine its relationship with psychopathology and personality. The results revealed five dimensions of perfectionism, including Achievement Striving, Evaluative Concerns, Expectations From Others, Narcissistic Perfectionism, and Organization. These dimensions were found to be associated with psychopathology and personality to varying degrees, supporting a multidimensional perspective of perfectionism.

ASSESSMENT (2022)

暂无数据