4.6 Article

Users identified challenges in applying GRADE to complex interventions and suggested an extension to GRADE

Journal

JOURNAL OF CLINICAL EPIDEMIOLOGY
Volume 70, Issue -, Pages 191-199

Publisher

ELSEVIER SCIENCE INC
DOI: 10.1016/j.jclinepi.2015.09.010

Keywords

GRADE; Complex interventions; Systematic reviews; Quality of evidence; Qualitative research methods; User perspectives

Funding

  1. Centre for Evidence Based Intervention, University of Oxford
  2. ESRC [ES/N012267/1, ES/K00087X/1] Funding Source: UKRI
  3. Economic and Social Research Council [ES/N012267/1, ES/K00087X/1] Funding Source: researchfish

Ask authors/readers for more resources

Objectives: To explore user perspectives on applying the Grading of Recommendations Assessment, Development and Evaluation (GRADE) to systematic reviews of complex interventions. Study Design and Setting: Thirty-three authors of recent (2013 onward) systematic reviews were contacted regarding their perspectives on using GRADE from three Cochrane review groups: Cochrane Developmental, Psychosocial, and Learning Problems Group; Cochrane Public Health Group; and Cochrane Depression, Anxiety, and Neurosis Group. Framework Analysis was applied to the data to identify the challenges in applying GRADE and suggestions for its extension, that is, adaptation. These two themes were cross compared between the groups of answers from simple vs. complex intervention review authors to identify the specific perspectives on using GRADE in reviews of complex interventions. Results: Specific challenges were identified in applying GRADE to reviews of complex interventions. These were related to the assessment of nonrandomized studies and performance bias in GRADE. Authors perceived these challenges to contribute to frequent downgrading of the best evidence possible for complex interventions. Meanwhile, GRADE was found to lack an analytic approach to enable adequate evidence synthesis and assessment of intervention implementation elements. Conclusion: Users suggest that the GRADE guidance be extended to address-specific considerations for complex interventions. (C) 2016 Elsevier Inc. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Review Criminology & Penology

Association Between Adverse Childhood Experiences and a Combination of Psychosis and Violence Among Adults: A Systematic Review and Meta-Analysis

Jasmin Ranu, Natasha Kalebic, G. J. Melendez-Torres, Pamela J. Taylor

Summary: There is a relationship between adverse childhood experiences (ACEs) and later psychosis and violence, especially in cases of childhood maltreatment. Studies show that histories of physical abuse, sexual abuse, having a criminal/violent parent or living with family alcohol/drug use are each associated with around twice the odds of psychosis with violence as psychosis alone. However, due to methodological differences and divergent measurement results, the pathways between ACEs and later problems remain unclear.

TRAUMA VIOLENCE & ABUSE (2023)

Article Health Care Sciences & Services

Alternatives to the quality-adjusted life year: How well do they address common criticisms?

Leah Z. Rand, G. J. Melendez-Torres, Aaron S. Kesselheim

Summary: This study analyzed whether other outcome measures used in health technology assessment (HTA) address the criticisms of quality-adjusted life years (QALYs). The study found that among the seven alternative outcome measures currently used for HTA, none of them address all the criticisms of QALYs while retaining their advantageous features.

HEALTH SERVICES RESEARCH (2023)

Review Social Work

A Systematic Review of Measures of Child Neglect

Simon Haworth, Jason Schaub, Elaine Kidney, Paul Montgomery

Summary: This article systematically reviews the assessment tools for child neglect, and finds that only two tools meet the inclusion criteria but still have limitations. The study highlights the lack of suitable assessment tools for child neglect and the need for robust testing in the social work setting.

RESEARCH ON SOCIAL WORK PRACTICE (2024)

Article Psychiatry

Estimated impact of the COVID-19 pandemic on the prevalence and treatment of depressive symptoms in Peru: an interrupted time series analysis in 2014-2021

David Villarreal-Zegarra, C. Mahony Reategui-Rivera, Sharlyn Otazu-Alfaro, Gloria Yantas-Alcantara, Percy Soto-Becerra, G. J. Melendez-Torres

Summary: The COVID-19 pandemic has increased the burden of mental disorders globally. Peru, one of the countries most affected by COVID-19, lacks studies evaluating the medium and long-term consequences of the pandemic on mental health. This study aimed to estimate the impact of the pandemic on the prevalence and treatment of depressive symptoms in Peru using nationally representative surveys.

SOCIAL PSYCHIATRY AND PSYCHIATRIC EPIDEMIOLOGY (2023)

Review Criminology & Penology

Social Norms About Dating and Relationship Violence and Gender Among Adolescents: Systematic Review of Measures Used in Dating and Relationship Violence Research

Rebecca Meiksin, Chris Bonell, Amiya Bhatia, G. J. Melendez-Torres, Nambusi Kyegombe, Anjalee Kohli

Summary: Adolescent dating and relationship violence (DRV) is a prevalent issue with negative impacts on mental health outcomes and partner violence. This study aimed to assess how social norms related to DRV and gender were measured in existing literature. A total of 24 eligible studies were identified, using 40 measures of DRV norms and gender norms. The measures showed significant association with DRV outcomes and had defined reference groups, but evidence on measure quality was mixed. Future research should focus on developing valid and reliable measures for DRV and gender norms, and exploring the mediating role of norms in interventions' impact on DRV.

TRAUMA VIOLENCE & ABUSE (2023)

Editorial Material Public, Environmental & Occupational Health

Using Habermas' theory of communicative action to transform sociological analyses of evidence-based policy

Chris Bonell, G. J. Melendez-Torres

Summary: Many sociological analyses view evidence-based policy as rationalizing social relations and being influenced by systems of knowledge/power. However, these analyses often overlook the emancipatory potential of evidence and the possibility of rational adjudication of truth claims. By incorporating Habermas' work, sociological engagement with evidence-based policy could be transformed by taking into account whether it leads to depoliticization or marginalization of citizens' voices. Habermas' idea of the ideal speech situation as a procedural basis for truth can serve as a standard for exploring power asymmetries and evaluating truth claims in relation to evidence-based policy.

CRITICAL PUBLIC HEALTH (2023)

Article Social Sciences, Interdisciplinary

A Delphi Study to Develop Items for a New Tool for Measuring Child Neglect for Use by Multi-Agency Practitioners in the UK

Simon Haworth, Paul Montgomery, Jason Schaub

Summary: Social work and allied professions face challenges in accurately assessing child neglect. Our research project aims to develop a new measurement tool for multi-agencies to address this issue. The project employed a Delphi study to gather expert opinions and reach consensus on the tool's items and elements.

SOCIAL SCIENCES-BASEL (2023)

Article Clinical Neurology

Profiles of depressive symptoms in Peru: An 8-year analysis in population-based surveys

David Villarreal-Zegarra, Sharly Otazu-Alfaro, Piero Segovia-Bacilio, Jackeline Garcia-Serna, C. Mahony Reategui-Rivera, G. J. Melendez-Torres

JOURNAL OF AFFECTIVE DISORDERS (2023)

Review Public, Environmental & Occupational Health

Whole-school interventions promoting student commitment to school to prevent substance use and violence: a systematic review

G. J. Melendez-Torres, R. Ponsford, J. Falconer, C. Bonell

Summary: This study found that whole-school interventions have the potential to reduce health inequalities by promoting student commitment to school through school-level change. However, there is a lack of comprehensive evidence on the effectiveness of these interventions in improving policy-relevant health outcomes such as substance use and violence.

PUBLIC HEALTH (2023)

Article Psychology, Clinical

Investigation of the Factor Structure and Differential Item Functioning of the Child and Adolescent Mindfulness Measure (CAMM): Analysis of Data from a School-Based Cluster Randomised Controlled Trial

Amy Sanders, Hayley Gains, Ruth Baer, Susan Ball, Benjamin Jones, Hazel Banks, G. J. Melendez-Torres, Obioha C. Ukoumunne

Summary: This study examined the structure and performance of the Child and Adolescent Mindfulness Measure (CAMM) in a school-based mindfulness program in the UK. The results showed that the CAMM has a 2-factor structure and there were small differences in item functioning across groups.

MINDFULNESS (2023)

Article Social Work

Residential Social Care Experiences of LGBTQ plus Young People in England: A Qualitative Interview Study

Jason Schaub, Willem J. Stander, Paul Montgomery

Summary: Lesbian, gay, bisexual, transgender and queer or questioning (LGBTQ+) young people in residential care face discrimination, unmet health needs, but also show resilience. This study conducted interviews with twenty LGBTQ+ young people in England and identified four themes: discrimination, unmet health needs, importance of professional relationships, and resilience. The findings highlight the need for inclusive policies, training, and incorporating the voices of LGBTQ+ youth in service delivery.

BRITISH JOURNAL OF SOCIAL WORK (2023)

Review Criminology & Penology

The Prevalence of Sexual Assault Among Higher Education Students: A Systematic Review With Meta-Analyses

Bridget Steele, Mackenzie Martin, Alessandra Sciarra, G. J. Melendez-Torres, Michelle Degli Esposti, David K. Humphreys

Summary: Sexual assault among higher education students has detrimental impacts on survivors' health and educational outcomes. This systematic review synthesizes quantitative evidence on sexual assault prevalence among this population. The meta-analysis reveals that the prevalence of sexual assault is 17.5% for women, 7.8% for men, and 18.1% for transgender and gender diverse individuals. Different types of sexual assault were identified, with forced sexual touching being the most common. It is crucial for higher education institutions, particularly those outside the United States, to conduct surveys and allocate more resources to support student survivors.

TRAUMA VIOLENCE & ABUSE (2023)

Article Social Sciences, Interdisciplinary

Demographic predictors of experiences of homelessness among lesbian, gay, bisexual, trans, gender-diverse and queer-identifying (LGBTIQ) young people in Australia

Gene Lim, G. J. Melendez-Torres, Natalie Amos, Joel Anderson, Thomas Norman, Jennifer Power, Jami Jones, Adam Bourne

Summary: Homelessness is highly prevalent among young LGBTQ+ individuals, posing a structural risk to their health and future prospects. The distribution of homelessness burden varies among different LGBTQ+ subgroups and is associated with experiences of harassment, alcohol consumption, and psychological distress.

JOURNAL OF YOUTH STUDIES (2023)

Article Social Work

Effectiveness of an LGBTQ plus E-Learning Module for Social Workers: A Randomized Controlled Trial

Jason Schaub, Jolie R. Keemink, Willem J. Stander, Paul Montgomery

Summary: The study demonstrates the effectiveness of an e-learning training module in improving social workers' knowledge of, and attitudes toward, LGBTQ+ young people. Participants who underwent the training showed decreased heteronormative attitudes and beliefs, and increased perceived LGBTQ+ knowledge compared to those who did not undergo the training.

RESEARCH ON SOCIAL WORK PRACTICE (2023)

Article Health Policy & Services

Evaluation of an acute trust Domestic Abuse Coordinator role: Impact findings and a budget impact model

G. J. Melendez-Torres, Louise Crathorne, Eleanor Hepworth, Vanessa Sloane, Sally Jackson, Rachel Nicholas, Charlotte E. Cohen

Summary: The role of Domestic Abuse Coordinators in healthcare institutions has a positive impact in increasing the rate of referrals for high-risk domestic abuse cases. It improves the response to victim-survivors at the highest risk and proves to be cost-saving for the employing acute trust.

INTERNATIONAL JOURNAL OF HEALTH PLANNING AND MANAGEMENT (2023)

No Data Available