4.2 Article

Evaluation of Mobile Health Applications: Is Regulatory Policy Up to the Challenge?

Journal

Publisher

CAMBRIDGE UNIV PRESS
DOI: 10.1017/S0266462319000461

Keywords

Mobile applications; Health policy; standards; Technology assessment; Mobile health

Funding

  1. Australian Government Research Training Program Scholarship
  2. University of Adelaide, School of Public Health, Higher Degree Research Student Support Fund

Ask authors/readers for more resources

Objectives The aim of this study is to determine whether the approach used in Australia to regulate mobile medical applications (MMA) is consistent with international standards and is suitable to address the unique challenges of these technologies. Methods The policies of members of the International Medical Device Regulator's Forum (IMDRF) were analyzed, to determine whether these regulatory bodies address IMDRF recommendations for the clinical evaluation of software as a medical device (SaMD). Case-studies of varying types of regulated MMAs in Australia and the United States were also reviewed to determine how well the guidance in the IMDRF's SaMD: Clinical Evaluation (2017) document was operationalized. Results All included jurisdictions evaluated the effectiveness of MMAs and addressed the majority of the key sub-categories recommended in the IMDRF guidance document. However, safety principles concerning information security (cybersecurity) and potential dangers of misinformation (risk-classification) were generally not addressed in either the case-studies or in the policy documents of international regulatory bodies. Australia's approach was consistent with MMA regulation conducted internationally. None of the approaches used by global regulatory bodies adequately addressed the risk of misinformation from apps and the potential for adverse clinical consequences. Conclusions The risks posed by MMAs are mainly through the information they provide and how this is used in clinical decision-making. Policy in Australia and elsewhere should be adjusted to follow the IMDRF risk-classification criteria to address potential harms from misinformation. Australian regulatory information should also be updated so the harm posed by cybersecurity and connectivity can be comprehensively evaluated.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.2
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Health Care Sciences & Services

Development of a health technology assessment module for evaluating mobile medical applications

Magdalena Ruth Moshi, Rebecca Tooher, Tracy Merlin

INTERNATIONAL JOURNAL OF TECHNOLOGY ASSESSMENT IN HEALTH CARE (2020)

Article Health Care Sciences & Services

Understanding Canadian Health Technology Assessment through a systems lens

Edilene Lopes, Jackie Street, Drew Carter, Tracy Merlin, Tania Stafinski

HEALTH POLICY (2020)

Article Health Care Sciences & Services

The rationale and design of public involvement in health-funding decision making: focus groups with the Canadian public

Edilene Lopes, Jackie Street, Tania Stafinski, Tracy Merlin, Drew Carter

INTERNATIONAL JOURNAL OF TECHNOLOGY ASSESSMENT IN HEALTH CARE (2020)

Article Health Care Sciences & Services

The representation of public values in health technology assessment to inform funding decisions: the case of Australia's national funding bodies

Hossein Haji Ali Afzali, Jackie Street, Tracy Merlin, Jonathan Karnon

Summary: Public involvement in health technology assessment (HTA) is increasingly recognized as important for ensuring legitimacy and fairness in public funding decisions. However, challenges remain in reorienting HTA to reflect public priorities. Australia has historically led in applying HTA to assess new health technologies, but current processes lack meaningful public inputs.

INTERNATIONAL JOURNAL OF TECHNOLOGY ASSESSMENT IN HEALTH CARE (2021)

Article Environmental Sciences

Factors That Impact the Adoption of Clinical Decision Support Systems (CDSS) for Antibiotic Management

Mah Laka, Adriana Milazzo, Tracy Merlin

Summary: This study evaluated factors influencing clinicians' perception regarding the use of clinical decision support systems (CDSS) for antibiotic management, finding that clinical experience, CDSS use, and care setting were important predictors. The research revealed that CDSS users were more confident and less likely to see it as a threat to professional autonomy compared to nonusers, while experienced clinicians were more likely to distrust CDSS due to fear of compromising their clinical judgement.

INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH (2021)

Article Geriatrics & Gerontology

Effect of an ongoing pharmacist service to reduce medicine-induced deterioration and adverse reactions in aged-care facilities (nursing homes): a multicentre, randomised controlled trial (the ReMInDAR trial)

Elizabeth E. Roughead, Nicole L. Pratt, Gaynor Parfitt, Debra Rowett, Lisa M. Kalisch-Ellett, Luke Bereznicki, Tracy Merlin, Megan Corlis, Ai Choo Kang, Joseph Whitehouse, Rebecca Bilton, Camille Schubert, Stacey Torode, Thu-Lan Kelly, Andre Q. Andrade, Dannielle Post, Gereltuya Dorj, Justin Cousins, Mackenzie Williams, Renly Lim

Summary: This study aimed to assess the effectiveness of a pharmacist-led intervention using validated tools to reduce medicine-induced deterioration and adverse reactions. The results showed promising results, particularly in improved cognition. However, there was no significant difference in frailty, 24-hour movement behavior, grip strength, adverse events, and quality of life between the intervention and control groups.

AGE AND AGEING (2022)

Article Radiology, Nuclear Medicine & Medical Imaging

Evidence-based funding of new imaging applications and technologies by Medicare in Australia: How it happens and how it can be improved

Hayley Hill, Ruchi Mittal, Tracy Merlin

Summary: This study aimed to determine the evidentiary and economic factors that have the most impact on the funding decisions of medical imaging tests by the Medical Services Advisory Committee (MSAC). The results showed that uncertainty about the cost-effectiveness of the imaging service is the biggest contributor to negative funding decisions.

JOURNAL OF MEDICAL IMAGING AND RADIATION ONCOLOGY (2022)

Review Economics

Modelling the Future Clinical and Economic Burden of Antimicrobial Resistance: The Feasibility and Value of Models to Inform Policy

Nadine T. Hillock, Tracy L. Merlin, John Turnidge, Jonathan Karnon

Summary: Due to the increasing threat to public health and the economy, governments internationally are interested in models to estimate the future clinical and economic burden of antimicrobial resistance (AMR) and to evaluate the cost-effectiveness of interventions to prevent or control resistance and to inform resource-allocation decision making. The accuracy of models predicting the future economic burden of AMR depends on the accuracy of predicting future resistance rates. However, there is substantial uncertainty in predicting future resistance rates, which could mislead policy decision-making.

APPLIED HEALTH ECONOMICS AND HEALTH POLICY (2022)

Article Health Policy & Services

Challenges and opportunities in implementing clinical decision support systems (CDSS) at scale: Interviews with Australian policymakers

Mah Laka, Drew Carter, Adriana Milazzo, Tracy Merlin

Summary: The implementation of CDSS in Australia faces challenges and opportunities, with key issues including lack of integration and collaboration, as well as insufficient interoperability increasing the risk of conflicting interests. Solutions include developing a clear shared vision for innovation, enhancing clinicians' skills and organizational capacity, and establishing national consensus on data standards.

HEALTH POLICY AND TECHNOLOGY (2022)

Article Economics

Challenges in the Evaluation of Emerging Highly Specialised Technologies: Is There a Role for Living HTA?

Tracy Merlin, Jackie Street, Drew Carter, Hossein Haji Ali Afzali

Summary: There is deep uncertainty about the clinical benefits and cost effectiveness of highly specialised technologies (HSTs). Standard health technology assessment processes have failed to address these uncertainties. A Living HTA framework is proposed to address these challenges by incorporating societal values, real-time data collection, and updating of reference models.

APPLIED HEALTH ECONOMICS AND HEALTH POLICY (2023)

Meeting Abstract Infectious Diseases

IS IT WORTH THE MONEY? HEALTHCARE PRACTITIONERS' WILLINGNESS TO PAY FOR NARROW SPECTRUM AND OTHER ATTRIBUTES OF ANTIMICROBIALS

N. Hillock, G. Chen, J. Turnidge, J. Louise, T. Merlin, J. Karnon

JOURNAL OF GLOBAL ANTIMICROBIAL RESISTANCE (2022)

Meeting Abstract Infectious Diseases

NAUSP METHODOLOGY UPDATES AND APPLICATION OF THE PRIORITY ANTIBACTERIAL LIST IN AUSTRALIAN ACUTE-CARE HOSPITALS, 2019-21

N. Hillock, G. Chen, J. Turnidge, J. Louise, T. Merlin, J. Karnon

JOURNAL OF GLOBAL ANTIMICROBIAL RESISTANCE (2022)

Article Health Care Sciences & Services

Inappropriate antibiotic prescribing: understanding clinicians' perceptions to enable changes in prescribing practices

Mah Laka, Adriana Milazzo, Tracy Merlin

Summary: The study identified diagnostic uncertainty and limited access to prescribing information as significant barriers to appropriate antibiotic prescribing. Years of experience, healthcare settings, and clinician use of guidelines were important predictors of antibiotic prescribing behavior. Tailored interventions are needed to promote rational antibiotic prescribing practices in general practice and hospital settings.

AUSTRALIAN HEALTH REVIEW (2022)

Meeting Abstract Public, Environmental & Occupational Health

Challenges and opportunities to appropriate antibiotic prescribing: a survey of clinicians' perceptions in Australia

Mah Laka, Adriana Milazzo, Tracy Merlin

INTERNATIONAL JOURNAL OF EPIDEMIOLOGY (2021)

Review Health Care Sciences & Services

South Australian Medicines Evaluation Panel in review: providing evidence-based guidance on the use of high-cost medicines in the South Australian public health system

Robyn Lambert, Naomi Burgess, Nadine Hillock, Joy Gailer, Pravin Hissaria, Tracy Merlin, Chris Pearson, Benjamin Reddi, Michael Ward, Catherine Hill

Summary: The South Australian Medicines Evaluation Panel (SAMEP) was established in 2011 to make evidence-based recommendations on the funding of high-cost medicines in South Australian public hospitals. SAMEP has reviewed 29 applications, with 14 listed on the high-cost medicines formulary, and a retrospective review of the committee experience suggests that state-based HTA as operationalised by SAMEP is feasible and provides greater equity of access to high-cost medicines in the South Australian public hospital system.

AUSTRALIAN HEALTH REVIEW (2021)

No Data Available