Can artificial intelligence replace manual search for systematic literature? Review on cutaneous manifestations in primary Sjogren's syndrome

Objectives: Manual systematic literature reviews are becoming increasingly challenging due to the sharp rise in publications. The primary objective of this literature review was to compare manual and computer software using artificial intelligence retrieval of publications on the cutaneous manifestations of primary SS, but we also evaluated the prevalence of cutaneous manifestations in primary SS. Methods: We compared manual searching and searching with the in-house computer software BIbliography BOT (BIBOT) designed for article retrieval and analysis. Both methods were used for a systematic literature review on a complex topic, i.e. the cutaneous manifestations of primary SS. Reproducibility was estimated by computing Cohen's kappa coefficients and was interpreted as follows: slight, 0-0.20; fair, 0.21-0.40; moderate, 0.41-0.60; substantial, 0.61-0.80; and almost perfect, 0.81-1. Results: The manual search retrieved 855 articles and BIBOT 1042 articles. In all, 202 articles were then selected by applying exclusion criteria. Among them, 155 were retrieved by both methods, 33 by manual search only, and 14 by BIBOT only. Reliability (kappa = 0.84) was almost perfect. Further selection was performed by reading the 202 articles. Cohort sizes and the nature and prevalence of cutaneous manifestations varied across publications. In all, we found 52 cutaneous manifestations reported in primary SS patients. The most described ones were cutaneous vasculitis (561 patients), xerosis (651 patients) and annular erythema (215 patients). Conclusion: Among the final selection of 202 articles, 155/202 (77%) were found by the two methods but BIBOT was faster and automatically classified the articles in a chart. Combining the two methods retrieved the largest number of publications.