Getting More Out of Large Databases and EHRs with Natural Language Processing and Artificial Intelligence

Electronic health records (EHRs) have created great opportunities to collect various information from clinical patient encounters. However, most EHR data are stored in unstructured form (e.g., clinical notes, surgical notes, and medication instructions), and researchers need data to be in computable form (structured) to extract meaningful relationships involving variables that can influence patient outcomes. Clinical natural language processing (NLP) is the field of extracting structured data from unstructured text documents in EHRs. Clinical text has several characteristics that mandate the use of special techniques to extract structured information from them compared with generic NLP methods. In this article, we define clinical NLP models, introduce different methods of information extraction from unstructured data using NLP, and describe the basic technical aspects of how deep learning-based NLP models work. We conclude by noting the challenges of working with clinical NLP models and summarizing the general steps needed to launch an NLP project.

Automated summary

Electronic health records (EHRs) provide opportunities for researchers to collect information from clinical patient encounters. However, most EHR data are stored in unstructured form, and clinical natural language processing (NLP) is needed to extract structured data and meaningful relationships.