4.4 Article

Analyzing patient experiences using natural language processing: development and validation of the artificial intelligence patient reported experience measure (AI-PREM)

期刊

出版社

BMC
DOI: 10.1186/s12911-022-01923-5

关键词

Natural language processing; Sentiment analysis; Unsupervised machine learning; Patient satisfaction; Patient-centered care

向作者/读者索取更多资源

The study developed an Artificial Intelligence Patient-Reported Experience Measures (AI-PREM) tool that combines an open-ended questionnaire, NLP pipeline, and visualization to effectively evaluate patient experiences. The AI-PREM tool automates the analysis of open-ended questions, saving time for healthcare professionals and providing valuable feedback.
Background Evaluating patients' experiences is essential when incorporating the patients' perspective in improving healthcare. Experiences are mainly collected using closed-ended questions, although the value of open-ended questions is widely recognized. Natural language processing (NLP) can automate the analysis of open-ended questions for an efficient approach to patient-centeredness. Methods We developed the Artificial Intelligence Patient-Reported Experience Measures (AI-PREM) tool, consisting of a new, open-ended questionnaire, an NLP pipeline to analyze the answers using sentiment analysis and topic modeling, and a visualization to guide physicians through the results. The questionnaire and NLP pipeline were iteratively developed and validated in a clinical context. Results The final AI-PREM consisted of five open-ended questions about the provided information, personal approach, collaboration between healthcare professionals, organization of care, and other experiences. The AI-PREM was sent to 867 vestibular schwannoma patients, 534 of which responded. The sentiment analysis model attained an F1 score of 0.97 for positive texts and 0.63 for negative texts. There was a 90% overlap between automatically and manually extracted topics. The visualization was hierarchically structured into three stages: the sentiment per question, the topics per sentiment and question, and the original patient responses per topic. Conclusions The AI-PREM tool is a comprehensive method that combines a validated, open-ended questionnaire with a well-performing NLP pipeline and visualization. Thematically organizing and quantifying patient feedback reduces the time invested by healthcare professionals to evaluate and prioritize patient experiences without being confined to the limited answer options of closed-ended questions.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.4
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Genetics & Heredity

SDHB variant type impacts phenotype and malignancy in pheochromocytoma-paraganglioma

Jean Pierre Bayley, Birke Bausch, Jeroen C. Jansen, Erik F. Hensen, Karin van der Tuin, Eleonora P. M. Corssmit, Peter Devilee, Hartmut P. H. Neumann

Summary: This study investigates the genotype-phenotype associations of SDHB gene variants and finds that truncating variants are associated with a higher risk of developing both PPGL and malignancy compared to missense variants. These findings further support the previously established associations between truncating variants and PPGL, and suggest that the two variant types differ in their impact on complex II function.

JOURNAL OF MEDICAL GENETICS (2023)

Article Otorhinolaryngology

Long-Term Quality of Life of Vestibular Schwannoma Patients: A Longitudinal Analysis

Olaf M. Neve, Jeroen C. Jansen, Radboud W. Koot, Mischa de Ridder, Peter Paul G. van Benthem, Anne M. Stiggelbout, Erik F. Hensen

Summary: This study assessed the long-term quality of life (QoL) of patients with vestibular schwannoma in relation to treatment modality and decisional regret. The results showed that the long-term QoL was comparable for patients under active surveillance and those who received active treatment, and it remained stable over time. This suggests that, on average, preservation of QoL of patients with vestibular schwannoma is feasible when adequately managed.

OTOLARYNGOLOGY-HEAD AND NECK SURGERY (2023)

Article Clinical Neurology

The Combined TL-RS Approach: Advantages and Disadvantages of Working 360 Degrees around the Sigmoid Sinus

Maarten C. Kleijwegt, Radboud W. Koot, Andel G. L. van der Mey, Erik F. Hensen, Martijn J. A. Malessy

Summary: This study retrospectively analyzed the advantages and disadvantages of combining the translabyrinthine and classic retrosigmoid approaches. The results showed that the combined approach can safely remove large meningiomas and schwannomas in selected cases. This technique provides sufficient exposure.

JOURNAL OF NEUROLOGICAL SURGERY PART B-SKULL BASE (2023)

Article Medicine, General & Internal

Assessing Performance and Clinical Usefulness in Prediction Models With Survival Outcomes: Practical Guidance for Cox Proportional Hazards Models

David J. McLernon, Daniele Giardiello, Ben Van Calster, Laure Wynants, Nan van Geloven, Maarten van Smeden, Terry Therneau, Ewout W. Steyerberg, STRATOS Initiative

Summary: Risk prediction models need validation to assess their performance. This article focuses on evaluating predictions and improving clinical decision making using survival models based on Cox proportional hazards regression. The authors present a case study on breast cancer patients, where a Cox regression model is developed and validated for prediction of recurrence or death.

ANNALS OF INTERNAL MEDICINE (2023)

Article Critical Care Medicine

Predicting Readmission or Death After Discharge From the ICU: External Validation and Retraining of a Machine Learning Model

Anne A. H. de Hond, Ilse M. J. Kant, Mattia Fornasa, Giovanni Cina, Paul W. G. Elbers, Patrick J. J. Thoral, M. Sesmu Arbous, Ewout W. W. Steyerberg

Summary: This study aimed to assess the performance of a decision support tool based on a machine learning model in predicting readmission or death within 7 days after ICU discharge. Through independent validation and retraining on multiple datasets, it was found that the model performed well in new settings and can be considered as an effective clinical tool.

CRITICAL CARE MEDICINE (2023)

Article Gastroenterology & Hepatology

Clinical consequences of nonadherence to Barrett's esophagus surveillance recommendations: a Multicenter prospective cohort study

Carlijn A. M. Roumans, Ruben D. van der Bogt, Daan Nieboer, Ewout W. Steyerberg, Dimitris Rizopoulos, Iris Lansdorp-Vogelaar, Katharina Biermann, Marco J. Bruno, Manon C. W. Spaander

Summary: In this multicenter prospective cohort study, it was found that half of Barrett's esophagus (BE) surveillance endoscopies do not adhere to guideline recommendations. However, there was no clear association between nonadherence and endoscopic curability of esophageal adenocarcinoma (EAC) or mortality, indicating the need for optimization of BE surveillance guidelines to minimize the burden of endoscopies.

DISEASES OF THE ESOPHAGUS (2023)

Article Cardiac & Cardiovascular Systems

Factors influencing post-surgical survival in degenerative mitral regurgitation

Steele C. Butcher, Benjamin Essayagh, Ewout W. Steyerberg, Giovanni Benfari, Clemence Antoine, Francesco Grigioni, Thierry Le Tourneau, Jean-Christian Roussel, Aniek van Wijngaarden, Nina Ajmone Marsan, Christophe Tribouilloy, Dan Rusinaru, Aviram Hochstadt, Yan Topilsky, Hector Michelena, Victoria Delgado, Jeroen J. Bax, Maurice Enriquez-Sarano

Summary: This study examined the impact of secondary outcome determinants on post-operative survival in patients with degenerative mitral regurgitation (DMR) and found that the number of these determinants was independently associated with increased mortality after surgery, providing better outcome discrimination than traditional indications for surgery.

EUROPEAN HEART JOURNAL (2023)

Review Health Care Sciences & Services

Minimal reporting improvement after peer review in reports of COVID-19 prediction models: systematic review

Mohammed T. Hudda, Lucinda Archer, Maarten van Smeden, Karel G. M. Moons, Gary S. Collins, Ewout W. Steyerberg, Charlotte Wahlich, Johannes B. Reitsma, Richard D. Riley, Ben Van Calster, Laure Wynants

Summary: The study aims to assess the improvement in reporting completeness of COVID-19 prediction models after peer review. The findings suggest that the reporting quality of preprints is poor and did not improve significantly after peer review, indicating that peer review had minimal effect on the completeness of reporting during the COVID-19 pandemic.

JOURNAL OF CLINICAL EPIDEMIOLOGY (2023)

Article Otorhinolaryngology

The Course of Hearing Loss in Patients With a Progressive Vestibular Schwannoma

Kimberley S. S. Koetsier, Heiko Locher, Radboud W. W. Koot, Andel G. L. van Der Mey, Peter-Paul G. van Benthem, Jeroen C. C. Jansen, Erik F. F. Hensen

Summary: This study evaluates the natural course of hearing loss prior to treatment in patients with progressive tumors and an indication for active intervention. The majority of patients (58%) with radiologically confirmed progressive vestibular schwannomas experience progressive sensorineural HL during observation.

OTOLARYNGOLOGY-HEAD AND NECK SURGERY (2023)

Article Clinical Neurology

Labyrinthine Fluid Signal Intensity on T2-Weighted MR Imaging in Patients With Vestibular Schwannomas Undergoing Proton Radiotherapy: A Longitudinal Assessment

Kimberley S. Koetsier, William A. Mehan, Karen Buch, D. Bradley Welling, Peter Paul G. van Benthem, Erik F. Hensen, Helen A. Shih

Summary: This study aimed to quantitatively evaluate the occurrence and course of signal intensity (SI) loss on T2-weighted MRI in vestibular schwannoma patients, and its possible association with proton radiotherapy and hearing loss. The results demonstrated that the relative mean cochlear SI was diminished on the treated side, but did not further decrease after proton radiotherapy. The diminished cochlear SI was not correlated with subsequent loss of hearing.

OTOLOGY & NEUROTOLOGY (2023)

Article Multidisciplinary Sciences

Clinical relevance of timing of assessment of ICU mortality in patients with moderate-to-severe Acute Respiratory Distress Syndrome

Jesus Villar, Jesus M. Gonzalez-Martin, Jose M. Anon, Carlos Ferrando, Juan A. Soler, Fernando Mosteiro, Juan M. Mora-Ordonez, Alfonso Ambros, Lorena Fernandez, Raquel Montiel, Anxela Vidal, Tomas Munoz, Lina Perez-Mendez, Pedro Rodriguez-Suarez, Cristina Fernandez, Rosa L. L. Fernandez, Tamas Szakmany, Karen E. A. Burns, Ewout W. Steyerberg, Arthur S. Slutsky

Summary: Mortality assessment in clinical studies of acute respiratory distress syndrome (ARDS) has not been well-defined. This study aimed to determine the timing of mortality assessment in ICU patients with moderate-to-severe ARDS, and its predictive value for treatment response. Observational cohorts and a randomized trial were analyzed, and it was found that ICU mortality rates closely approximated 28-day mortality rates. ICU mortality assessment within the first week of a trial could serve as an early predictor of treatment response for moderate-to-severe ARDS patients.

SCIENTIFIC REPORTS (2023)

Article Mathematical & Computational Biology

A Bayesian (meta-)regression model for treatment effects on the risk difference scale

Doranne Thomassen, Ewout Steyerberg, Saskia le Cessie

Summary: In clinical practice, it is crucial to determine the absolute risk reduction of treatment for individual patients. However, logistic regression in trials with binary outcomes provides estimates of treatment effects in terms of log odds differences. In this study, we propose a new Bayesian regression model for binary outcomes on the additive risk scale, allowing for direct estimation of treatment effects on the linear scale of clinical interest. Comparisons were made with a previously proposed additive risk model and backtransforming predictions from a logistic model. Results showed that modelling untransformed risk can yield significantly different treatment effect estimates, particularly for small sample sizes or extreme predicted risks close to 0% or 100%. Our proposed model proved to be more sensitive in detecting all information in the data in a network meta-analysis.

STATISTICS IN MEDICINE (2023)

Article Medicine, General & Internal

Impact of Sociodemographic, Premorbid, and Injury-Related Factors on Patient-Reported Outcome Trajectories after Traumatic Brain Injury (TBI)

Nicole von Steinbuechel, Stefanie Hahm, Holger Muehlan, Juan Carlos Arango-Lasprilla, Fabian Bockhop, Amra Covic, Silke W. Schmidt, Ewout Steyerberg, Andrew I. R. Maas, David Menon, Nada Andelic, Marina Zeldovich, CTR TBI Participants Investigators

Summary: Traumatic brain injury (TBI) is a major cause of death and disability worldwide. This study aims to understand the impact of TBI on various outcome domains, evaluating factors contributing to worsening or improving outcomes. The study used patient-reported outcome measures and identified different trajectory classes for outcome after TBI, including stable good health, persistent impairments, improving health, and deteriorating health. Individuals with persistent impairments and deterioration need special attention and long-term clinical monitoring and therapy.

JOURNAL OF CLINICAL MEDICINE (2023)

Article Otorhinolaryngology

Automated 2-Dimensional Measurement of Vestibular Schwannoma: Validity and Accuracy of an Artificial Intelligence Algorithm

Olaf M. Neve, Stephan R. Romeijn, Yunjie Chen, Larissa Nagtegaal, Willem Grootjans, Jeroen C. Jansen, Marius Staring, Berit M. Verbist, Erik F. Hensen

Summary: This study validates the accuracy of automated 2D diameter measurements of vestibular schwannomas on MRI by comparing them with manual measurements. The results show high correlation and agreement between automated and human measurements, with automated measurements performing better in tumor progression detection.

OTOLARYNGOLOGY-HEAD AND NECK SURGERY (2023)

Article Clinical Neurology

Reestablishment of the Smile after Hypoglossal-Facial Nerve Transfer: What Can We Learn?

M. C. Kleijwegt, C. Wever, E. F. Hensen, J. C. Jansen, R. W. Koot, M. J. A. Malessy

Summary: This study assessed the ability to smile after a hypoglossal-facial nerve transfer (N12-N7). It was found that there was good facial symmetry at rest but asymmetry during smiling. Additional procedures are needed to improve the ability to smile after N12-N7 transfer.

JOURNAL OF NEUROLOGICAL SURGERY PART B-SKULL BASE (2023)

暂无数据