4.5 Article

Unveiling the ChatGPT phenomenon: Evaluating the consistency and accuracy of endodontic question answers

期刊

INTERNATIONAL ENDODONTIC JOURNAL
卷 -, 期 -, 页码 -

出版社

WILEY
DOI: 10.1111/iej.13985

关键词

artificial intelligence; chatbot; ChatGPT; dentistry; endodontics; large language models

向作者/读者索取更多资源

The study aimed to evaluate the consistency and accuracy of ChatGPT-generated answers to clinical questions in endodontics, compared to answers provided by human experts.
AimChatbot Generative Pre-trained Transformer (ChatGPT) is a generative artificial intelligence (AI) software based on large language models (LLMs), designed to simulate human conversations and generate novel content based on the training data it has been exposed to. The aim of this study was to evaluate the consistency and accuracy of ChatGPT-generated answers to clinical questions in endodontics, compared to answers provided by human experts.MethodologyNinety-one dichotomous (yes/no) questions were designed and categorized into three levels of difficulty. Twenty questions were randomly selected from each difficulty level. Sixty answers were generated by ChatGPT for each question. Two endodontic experts independently answered the 60 questions. Statistical analysis was performed using the SPSS program to calculate the consistency and accuracy of the answers generated by ChatGPT compared to the experts. Confidence intervals (95%) and standard deviations were used to estimate variability.ResultsThe answers generated by ChatGPT showed high consistency (85.44%). No significant differences in consistency were found based on question difficulty. In terms of answer accuracy, ChatGPT achieved an average accuracy of 57.33%. However, significant differences in accuracy were observed based on question difficulty, with lower accuracy for easier questions.ConclusionsCurrently, ChatGPT is not capable of replacing dentists in clinical decision-making. As ChatGPT's performance improves through deep learning, it is expected to become more useful and effective in the field of endodontics. However, careful attention and ongoing evaluation are needed to ensure its accuracy, reliability and safety in endodontics.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.5
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Review Nutrition & Dietetics

Role of Probiotics in Halitosis of Oral Origin: A Systematic Review and Meta-Analysis of Randomized Clinical Studies

Nansi Lopez-Valverde, Antonio Lopez-Valverde, Bruno Macedo de Sousa, Cinthia Rodriguez, Ana Suarez, Juan Manuel Aragoneses

Summary: The use of probiotics for treating oral halitosis needs further clinical trials to establish real evidence of efficacy, although some studies have provided support for their beneficial effects.

FRONTIERS IN NUTRITION (2022)

Article Environmental Sciences

Application of the Intraoral Scanner in the Diagnosis of Dental Wear: An In Vivo Study of Tooth Wear Analysis

Victor Diaz-Flores Garcia, Yolanda Freire, Susana David Fernandez, Beatriz Tomas Murillo, Margarita Gomez Sanchez

Summary: This study analyzed the sensitivity and specificity of an intraoral scanner for measuring dental wear and evaluated patient satisfaction with its use. The results showed that the intraoral scanner can be used as a diagnostic tool and received high satisfaction ratings.

INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH (2022)

Review Medicine, General & Internal

Possible Association of Periodontal Diseases With Helicobacter pylori Gastric Infection: A Systematic Review and Meta-Analysis

Nansi Lopez-Valverde, Bruno Macedo de Sousa, Antonio Lopez-Valverde, Ana Suarez, Cinthia Rodriguez, Juan Manuel Aragoneses

Summary: Some research suggests an association between periodontal diseases and Helicobacter pylori infection, but there is currently no clear evidence that H. pylori in the oral cavity causes gastric infection.

FRONTIERS IN MEDICINE (2022)

Article Environmental Sciences

Using a Virtual Patient via an Artificial Intelligence Chatbot to Develop Dental Students' Diagnostic Skills

Ana Suarez, Alberto Adanero, Victor Diaz-Flores Garcia, Yolanda Freire, Juan Algar

Summary: The study involved dental students interacting with an artificially intelligent chatbot recreating a virtual patient. Most students were satisfied with the interaction, with fifth-year students showing higher satisfaction levels. Students who reached a correct diagnosis rated the technology more positively, indicating potential benefits for incorporating this technology into dental curricula.

INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH (2022)

Review Surgery

The clinical manifestations of cocaine-induced midline destructive lesion: a real challenge for maxillo-facial surgeons, mapping evidence review

Michele Di Cosola, Salvatore Sembronio, Mario Dioguardi, Massimo Robiony, Victor Diaz-Flores Garcia, Resi Pucci, Marco Della Monaca, Lorenzo Lo Muzio, Francesca Spirito, Edoardo Brauner, Katherine A. Piacentile, Riccardo Nocini, Chiara Copelli

Summary: Cocaine abuse can lead to oral and maxillo-facial lesions, including nasal septa perforations and cocaine-induced midline destructive lesions (CIMDL) characterized by centrofacial midline necrosis. The pathophysiology involves ischemia of cartilage and mucosa caused by cocaine, as well as inflammation and ulceration caused by powdered substances. CIMDL is an important differential diagnosis in developed countries for centrofacial destructive processes.

CHIRURGIA-ITALY (2022)

Article Dentistry, Oral Surgery & Medicine

Influence of the use of social media on patients changing dental practice: a web-based questionnaire study

Yolanda Freire, Margarita Gomez Sanchez, Ana Suarez, Gerardo Joves, Marlen Nowak, Victor Diaz-Flores Garcia

Summary: The use of social media in dental practice can influence patients' decision to change their practice, particularly among those who have changed practice in the last few years. Dental practices should consider using social media as communication and marketing tools.

BMC ORAL HEALTH (2023)

Review Chemistry, Multidisciplinary

Prevalence of Root Canal Treatments among Diabetic Patients: Systematic Review and Meta-Analysis

Maria Leon-Lopez, Daniel Cabanillas-Balsera, Jenifer Martin-Gonzalez, Victor Diaz-Flores, Victoria Areal-Quecuty, Isabel Crespo-Gallardo, Paloma Montero-Miralles, Juan J. Segura-Egea

Summary: This study conducted a systematic review and meta-analysis to determine the prevalence of root-filled teeth (RFT) among diabetic patients. The results showed that the prevalence of RFT among diabetic patients is 5.5%, and more than 40% of diabetics have at least one RFT. In clinical practice, dentists should consider the possibility of undiagnosed diabetes when observing multiple RCT failures in the same patient.

APPLIED SCIENCES-BASEL (2023)

Article Dentistry, Oral Surgery & Medicine

Oral immune-related adverse events caused by immune checkpoint inhibitors: a retrospective study

Michele Di Cosola, Francesca Spirito, Piermichele Saracino, Vito C. Caponio, Victor Diaz-Flores Garcia, Gabriele Madonna, Paolo Ascierto, Lorenzo Lo Muzio

Summary: This retrospective study aimed to report on the oral immune-related adverse events caused by immune checkpoint inhibitors. The study analyzed the medical history and clinical data of patients treated with anti-PD1 (nivolumab, pembrolizumab) and identified oral lesions as adverse effects, including stomatitis, xerostomia, candidiasis, and taste disturbances. The incidence of oral lesions did not significantly differ between the two drugs investigated.

MINERVA DENTAL AND ORAL SCIENCE (2022)

暂无数据