4.6 Article

Evaluation of Major Online Diabetes Risk Calculators and Computerized Predictive Models

期刊

PLOS ONE
卷 10, 期 11, 页码 -

出版社

PUBLIC LIBRARY SCIENCE
DOI: 10.1371/journal.pone.0142827

关键词

-

资金

  1. Swiss National Science Foundation through a SCOPES Joint Research Projects [IZ73Z0_152415]
  2. Swiss National Science Foundation (SNF) [IZ73Z0_152415] Funding Source: Swiss National Science Foundation (SNF)

向作者/读者索取更多资源

Classical paper-and-pencil based risk assessment questionnaires are often accompanied by the online versions of the questionnaire to reach a wider population. This study focuses on the loss, especially in risk estimation performance, that can be inflicted by direct transformation from the paper to online versions of risk estimation calculators by ignoring the possibilities of more complex and accurate calculations that can be performed using the online calculators. We empirically compare the risk estimation performance between four major diabetes risk calculators and two, more advanced, predictive models. National Health and Nutrition Examination Survey (NHANES) data from 1999-2012 was used to evaluate the performance of detecting diabetes and pre-diabetes. American Diabetes Association risk test achieved the best predictive performance in category of classical paper-and-pencil based tests with an Area Under the ROC Curve (AUC) of 0.699 for undiagnosed diabetes (0.662 for pre-diabetes) and 47% (47% for pre-diabetes) persons selected for screening. Our results demonstrate a significant difference in performance with additional benefits for a lower number of persons selected for screening when statistical methods are used. The best AUC overall was obtained in diabetes risk prediction using logistic regression with AUC of 0.775 (0.734) and an average 34% (48%) persons selected for screening. However, generalized boosted regression models might be a better option from the economical point of view as the number of selected persons for screening of 30%(47%) lies significantly lower for diabetes risk assessment in comparison to logistic regression (p < 0.001), with a significantly higher AUC (p < 0.001) of 0.774 (0.740) for the pre-diabetes group. Our results demonstrate a serious lack of predictive performance in four major online diabetes risk calculators. Therefore, one should take great care and consider optimizing the online versions of questionnaires that were primarily developed as classical paper questionnaires.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.6
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Endocrinology & Metabolism

Development and validation of the type 2 diabetes mellitus 10-year risk score prediction models from survey data

Gregor Stiglic, Fei Wang, Aziz Sheikh, Leona Cilar

Summary: This study developed and validated a 10-year T2DM risk prediction model using large survey data, showing the importance of recalibration and data pooling across multiple countries to increase precision.

PRIMARY CARE DIABETES (2021)

Article Environmental Sciences

Internet Use and Psychosomatic Symptoms among University Students: Cross-Sectional Study

Gregor Stiglic, Ruth Masterson Creber, Leona Cilar Budler

Summary: This study explores the relationship between internet use and psychosomatic symptoms among university students in Slovenia. It found that computer science students reported more frequent psychological symptoms, while health science students reported more somatic symptoms.

INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH (2022)

Review Computer Science, Artificial Intelligence

Explaining artificial intelligence with visual analytics in healthcare

Jeroen Ooge, Gregor Stiglic, Katrien Verbert

Summary: Healthcare is increasingly applying advanced AI algorithms to make predictions and explore large datasets. In order to make trustworthy decisions, healthcare professionals need ways to understand the outputs of these algorithms, one approach being visual analytics. Despite the development of many visual analytics systems for healthcare, there is a lack of clear overview of their explanation techniques. This study reviews 71 systems and analyzes how they explain advanced algorithms through visualization, interaction, and other methods.

WILEY INTERDISCIPLINARY REVIEWS-DATA MINING AND KNOWLEDGE DISCOVERY (2022)

Article Health Care Sciences & Services

The KIDSCREEN-27 scale: translation and validation study of the Slovenian version

Leona Cilar Budler, Majda Pajnkihar, Ulrike Ravens-Sieberer, Owen Barr, Gregor Stiglic

Summary: This study translated and validated the KIDSCREEN-27 scale among adolescents in Slovenia, finding that the scale has good psychometric properties and reliability, making it suitable for assessing the quality of life of adolescents.

HEALTH AND QUALITY OF LIFE OUTCOMES (2022)

Article Health Care Sciences & Services

Extracting New Temporal Features to Improve the Interpretability of Undiagnosed Type 2 Diabetes Mellitus Prediction Models

Simon Kocbek, Primoz Kocbek, Lucija Gosak, Nino Fijacko, Gregor Stiglic

Summary: Type 2 diabetes mellitus is a significant health issue, and developing accurate and interpretable prediction models is crucial. This study proposes a framework that combines logic regression and least absolute shrinkage and selection operator to predict undiagnosed T2DM. The models developed using this framework perform well in terms of predictive accuracy and simplicity, making them suitable for healthcare experts to interpret.

JOURNAL OF PERSONALIZED MEDICINE (2022)

Article Health Care Sciences & Services

The Impact of Mobile Health Use on the Self-care of Patients With Type 2 Diabetes: Protocol for a Randomized Controlled Trial

Lucija Gosak, Majda Pajnkihar, Gregor Stiglic

Summary: This study aims to assess the impact of mobile app use on self-care in patients with type 2 diabetes and test the practicality of the forDiabetes app. A double-blind randomized controlled trial will be conducted, collecting data including self-care questionnaire, illness perception questionnaire, as well as measurements of blood sugar, blood pressure, glycated hemoglobin, and weight. The research results will be published in 2023.

JMIR RESEARCH PROTOCOLS (2022)

Review Management

Artificial intelligence based prediction models for individuals at risk of multiple diabetic complications: A systematic review of the literature

Lucija Gosak, Kristina Martinovic, Mateja Lorber, Gregor Stiglic

Summary: The aim of this review is to examine the effectiveness of artificial intelligence in predicting multimorbid diabetes-related complications. Artificial intelligence can accurately predict the risks of diabetes complications and provide an important tool for nurses in preventive healthcare. Using artificial intelligence contributes to better quality of care, better autonomy of patients in diabetes management, and reduction of complications, costs of medical care, and mortality.

JOURNAL OF NURSING MANAGEMENT (2022)

Article Environmental Sciences

Health Conditions and Long Working Hours in Europe: A Retrospective Study

Darja Korosec, Dominika Vrbnjak, Gregor Stiglic

Summary: This study examined the relationship between working hours and health outcomes in European countries. It found that men worked longer hours compared to women, and that different industries had varying levels of increase in health conditions. Healthcare workers had a slower increase in the prevalence of health conditions compared to workers in other industries, particularly regarding diabetes and hypertension. The study suggests the importance of implementing preventive health activities in the workplace to improve employee health.

INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH (2022)

Review Computer Science, Artificial Intelligence

Review of artificial intelligence-based question-answering systems in healthcare

Leona Cilar Budler, Lucija Gosak, Gregor Stiglic

Summary: The use of conversational agents in health care is increasing globally, but their effectiveness is not well-understood. This advanced review aimed to assess the use and effectiveness of conversational agents in various health care fields. Most of the reviewed articles reported the effectiveness, while less information was available on the use. The study findings provide evidence-based knowledge about artificial intelligence-based question-answering systems in health care.

WILEY INTERDISCIPLINARY REVIEWS-DATA MINING AND KNOWLEDGE DISCOVERY (2023)

Review Chemistry, Multidisciplinary

Artificial Intelligence Based Prediction of Diabetic Foot Risk in Patients with Diabetes: A Literature Review

Lucija Gosak, Adrijana Svensek, Mateja Lorber, Gregor Stiglic

Summary: Diabetic foot is a common complication of diabetes, causing a significant economic and societal problem due to the increased risk of lower limb amputation. Artificial intelligence can help predict the development of diabetic foot, leading to more effective preventive treatment. However, further research is needed to determine the most effective technique.

APPLIED SCIENCES-BASEL (2023)

Article Computer Science, Interdisciplinary Applications

Hybrid visualization-based framework for depressive state detection and characterization of atypical patients

Leon Kopitar, Peter Kokol, Gregor Stiglic

Summary: This paper proposes a hybrid visualization approach for detecting depression and builds a prediction model using NHANES data, achieving an average AUC score of 0.748. The model identifies crucial features such as chest pain, the ratio of family income to poverty, and smoking status in predicting depressive states in both the original and local environments.

JOURNAL OF BIOMEDICAL INFORMATICS (2023)

Review Health Care Sciences & Services

E-Learning in Nursing and Midwifery during the COVID-19 Pandemic

Natasa Mlinar Reljic, Maja Drescek Dolinar, Gregor Stiglic, Sergej Kmetec, Zvonka Fekonja, Barbara Donik

Summary: The aim of this study was to evaluate the advantages and limitations of e-learning for nursing and midwifery students during the COVID-19 pandemic. Through literature review and thematic analysis, e-learning was found to be an effective learning method for nursing and midwifery students during this period, but it also presented challenges related to internet access, technical equipment, finances, and work-family commitments.

HEALTHCARE (2023)

Article Health Care Sciences & Services

Emotional Intelligence among Nursing Students: Findings from a Longitudinal Study

Leona Cilar Budler, Lucija Gosak, Dominika Vrbnjak, Majda Pajnkihar, Gregor Stiglic

Summary: Emotional intelligence is an important factor for the success and work performance of nursing students. However, research results on emotional intelligence in nursing students vary. A longitudinal study found that emotional intelligence of nursing students changes over time, with years of education and age as influencing factors. Further research is needed to determine the gendered nature of emotional intelligence in nursing students.

HEALTHCARE (2022)

Review Health Care Sciences & Services

Digital Tools in Behavior Change Support Education in Health and Other Students: A Systematic Review

Lucija Gosak, Gregor Stiglic, Leona Cilar Budler, Isa Brito Felix, Katja Braam, Nino Fijacko, Mara Pereira Guerreiro, Mateja Lorber

Summary: This study aims to review the outcomes of digital tools in behavior change support education and to examine existing instruments to assess their effectiveness. A systematic literature review was conducted, and 15 studies were included in the final analysis. The results showed that digital tools can enhance students' knowledge of behavior change techniques in individuals with chronic diseases, leading to increased self-confidence, improved cooperation, and practical experience and skills. However, time and space constraints are the most common limitations identified in using these tools.

HEALTHCARE (2022)

Article Health Care Sciences & Services

Perception of the Online Learning Environment of Nursing Students in Slovenia: Validation of the DREEM Questionnaire

Lucija Gosak, Nino Fijacko, Carolina Chabrera, Esther Cabrera, Gregor Stiglic

Summary: This study validated the tool for assessing the educational environment in the Slovenian nursing student population using the DREEM tool. Despite the impact of the coronavirus pandemic on the educational process, students still perceive the educational environment as positive, especially in terms of learning outcomes, teacher evaluation, and academic self-perception.

HEALTHCARE (2021)

暂无数据