4.3 Editorial Material

Trust does not need to be human: it is possible to trust medical AI

期刊

JOURNAL OF MEDICAL ETHICS
卷 47, 期 6, 页码 437-438

出版社

BMJ PUBLISHING GROUP
DOI: 10.1136/medethics-2020-106922

关键词

philosophical ethics; clinical ethics; information technology

向作者/读者索取更多资源

In response to Hatherley's article on the limits of trust in medical AI, the authors argue that it is possible to discuss trust in medical artificial intelligence without simply applying trust to human-human interactions. They propose a new account of trust that involves relying on medical AI with minimal monitoring and control. This approach can be particularly applicable when a physician relies on AI predictions to support decision making.
In his recent article 'Limits of trust in medical AI,' Hatherley argues that, if we believe that the motivations that are usually recognised as relevant for interpersonal trust have to be applied to interactions between humans and medical artificial intelligence, then these systems do not appear to be the appropriate objects of trust. In this response, we argue that it is possible to discuss trust in medical artificial intelligence (AI), if one refrains from simply assuming that trust describes human-human interactions. To do so, we consider an account of trust that distinguishes trust from reliance in a way that is compatible with trusting non-human agents. In this account, to trust a medical AI is to rely on it with little monitoring and control of the elements that make it trustworthy. This attitude does not imply specific properties in the AI system that in fact only humans can have. This account of trust is applicable, in particular, to all cases where a physician relies on the medical AI predictions to support his or her decision making.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.3
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Editorial Material Ethics

In Search of a Mission: Artificial Intelligence in Clinical Ethics COMMENT

Nikola Biller-Andorno, Andrea Ferrario, Sophie Gloeckler

AMERICAN JOURNAL OF BIOETHICS (2022)

Article Psychology

Evaluating the Effects of a Programming Error on a Virtual Environment Measure of Spatial Navigation Behavior

Steven M. Weisberg, Victor R. Schinazi, Andrea Ferrario, Nora S. Newcombe

Summary: Relying on shared tasks and stimuli enhances replicability of findings by allowing researchers to collect large data sets. In spatial navigation experiments, the use of unfamiliar virtual environments can pose challenges. This study discusses the discovery of a software bug in Virtual Silcton, a platform used for studying spatial navigation. The bug affected the accuracy of pointing tasks and had varying effects on participants.

JOURNAL OF EXPERIMENTAL PSYCHOLOGY-LEARNING MEMORY AND COGNITION (2023)

Article Ethics

Ethics of the algorithmic prediction of goal of care preferences: from theory to practice

Andrea Ferrario, Sophie Gloeckler, Nikola Biller-Andorno

Summary: This paper discusses the application of artificial intelligence systems in healthcare and clinical decision-making, focusing on decision-making based on incapacitated patients' values and goals of care. The authors propose viewing preference predicting AI as sociotechnical systems with distinct life-cycles and explore the challenges and strategies for their resolution at different stages of development.

JOURNAL OF MEDICAL ETHICS (2023)

Editorial Material Ethics

AI knows best? Avoiding the traps of paternalism and other pitfalls of AI-based patient preference prediction

Andrea Ferrario, Sophie Gloeckler, Nikola Biller-Andorno

JOURNAL OF MEDICAL ETHICS (2023)

Article Health Care Sciences & Services

Investigating Employees' Concerns and Wishes Regarding Digital Stress Management Interventions With Value Sensitive Design: Mixed Methods Study

Jasmine Kerr, Mara Naegelin, Michaela Benk, Florian Wangenheim, Erika Meins, Eleonora Vigano, Andrea Ferrario

Summary: This study used the value sensitive design (VSD) framework to identify relevant values of a digital stress management intervention (dSMI) at the workplace and assess users' comprehension of these values and derive specific design requirements informed by ethics. Results showed that while most employees were willing to use dSMI, there were significant concerns regarding its effectiveness and perpetuation of problems. Privacy and accountability concerns must be well addressed, especially when incorporating a machine learning-based monitoring component. The findings of this study will contribute to future VSD-based interventions and the integration of ethics in digital health.

JOURNAL OF MEDICAL INTERNET RESEARCH (2023)

Article Psychology, Multidisciplinary

Virtual reality-supported biofeedback for stress management: Beneficial effects on heart rate variability and user experience

Raphael P. Weibel, Jasmine I. Kerr, Mara Naegelin, Andrea Ferrario, Victor R. Schinazi, Roberto La Marca, Christoph Hoelscher, Urs M. Nater, Florian von Wangenheim

Summary: Heart rate variability biofeedback (HRV-BF) is commonly used for stress management. This study explored the effects of different technologies and breathing techniques on HRV-BF. The results showed that practicing HRV-BF using a head-mounted display (HMD) led to greater improvements in HRV and cardiac coherence compared to standardised paced breathing on a screen. Immersing oneself in virtual reality with an HMD for HRV-BF also enhanced user experience. Further research is needed to validate the long-term effects of this mode of delivery.

COMPUTERS IN HUMAN BEHAVIOR (2023)

Article Philosophy

How I Would have been Differently Treated. Discrimination Through the Lens of Counterfactual Fairness

Michele Loi, Francesco Nappo, Eleonora Vigano

Summary: The use of algorithms for prediction-based decisions necessitates a consideration of what constitutes discrimination. We propose a counterfactual condition, building upon previous work, as a necessary requirement. By examining existing definitions of discrimination, we demonstrate the limitations of these definitions and showcase the significance of our proposed condition. This defense of the counterfactual condition helps establish the conceptual boundaries for claims about discriminatory acts or practices in society, which has practical implications for the ethics of algorithmic decision-making.

RES PUBLICA-A JOURNAL OF MORAL LEGAL AND POLITICAL PHILOSOPHY (2023)

Article History & Philosophy Of Science

How much do you trust me? A logico-mathematical analysis of the concept of the intensity of trust

Michele Loi, Andrea Ferrario, Eleonora Vigano

Summary: This article introduces a theory of trust and monitoring, which utilizes mathematical models based on two classes of functions to quantify trust and relate it to monitoring costs. Unlike other accounts of trust that focus on identifying specific factors, this theory characterizes trust as a quantifiable property of reliance relations. It is applicable to both human-human and human-artificial agent interactions and provides a rigorous methodology for measuring trust in empirical studies.

SYNTHESE (2023)

Article Economics

Fair equality of chances for prediction-based decisions

Michele Loi, Anders Herlitz, Hoda Heidari

Summary: This article presents a fairness principle for evaluating decision-making based on predictions, which states that a decision rule is unfair if individuals directly impacted by the decisions, who are equal in terms of features justifying inequalities in outcomes, do not have equal statistical prospects of being benefited or harmed by them. The principle can be used to evaluate prediction-based decision-making from various perspectives of justice in outcome distributions.

ECONOMICS AND PHILOSOPHY (2023)

Article Political Science

Towards Rawlsian 'property-owning democracy' through personal data platform cooperatives

Michele Loi, Paul-Olivier Dehaye, Ernst Hafen

Summary: This paper discusses the role of personal data platform cooperatives in realizing a just social system and applies Rawls's political philosophy to analyze the relationship between the institutional forms of a just society and the economic power derived from aggregating personal data. It argues that a society involving a significant number of personal data platform cooperatives is more suitable for realizing Rawls's principle of fair equality of opportunity.

CRITICAL REVIEW OF INTERNATIONAL SOCIAL AND POLITICAL PHILOSOPHY (2023)

Article Computer Science, Information Systems

The Robustness of Counterfactual Explanations Over Time

Andrea Ferrario, Michele Loi

Summary: This paper introduces counterfactual explanations as a prominent interpretable artificial intelligence method and shows that retraining machine learning models over time may invalidate the counterfactual explanations. The authors propose a method called counterfactual data augmentation to improve the robustness of counterfactual explanations over time.

IEEE ACCESS (2022)

Article Geriatrics & Gerontology

Predicting Working Memory in Healthy Older Adults Using Real-Life Language and Social Context Information: A Machine Learning Approach

Andrea Ferrario, Minxia Luo, Angelina J. Polsinelli, Suzanne A. Moseley, Matthias R. Mehl, Kristina Yordanova, Mike Martin, Burcu Demiray

Summary: Machine learning and natural language processing (NLP) techniques can be used to predict working memory in older adults. Linguistic measures, part-of-speech (POS) tags, and social context information improve the performance of prediction models, which is important for designing an early warning system for detecting cognitive decline.

JMIR AGING (2022)

Article Business

Highway to (Digital) Surveillance: When Are Clients Coerced to Share Their Data with Insurers?

Michele Loi, Christian Hauser, Markus Christen

Summary: Clients may feel coerced into sharing personal data with insurance companies, which violates their autonomy. This choice to accept digital surveillance also threatens the client's autonomy. The adoption of digital surveillance by insurers creates further threats against autonomy. More moral and empirical research is needed on this issue.

JOURNAL OF BUSINESS ETHICS (2022)

暂无数据