Publication Date

5-1-2023

Journal

Clinical Gastroenterology and Hepatology

DOI

10.1016/j.cgh.2022.09.005

PMID

36115659

PMCID

PMC10014472

PubMedCentral® Posted Date

5-1-2024

PubMedCentral® Full Text Version

Author MSS

Published Open-Access

yes

Keywords

Humans, Barrett Esophagus, Natural Language Processing, Software, Algorithms, Hyperplasia, Barrett’s esophagus, dysplasia, natural language processing, accuracy

Abstract

BACKGROUND & AIMS: Identifying dysplasia of Barrett's esophagus (BE) in the electronic medical record (EMR) requires manual abstraction of unstructured data. Natural language processing (NLP) creates structure to unstructured free text. We aimed to develop and validate an NLP algorithm to identify dysplasia in BE patients on histopathology reports with varying report formats in a large integrated EMR system.

METHODS: We randomly selected 600 pathology reports for NLP development and 400 reports for validation from patients with suspected BE in the national Veterans Affairs databases. BE and dysplasia were verified by manual review of the pathology reports. We used NLP software (Clinical Language Annotation, Modeling, and Processing Toolkit; Melax Tech, Houston, TX) to develop an algorithm to identify dysplasia using findings. The algorithm performance characteristics were calculated as recall, precision, accuracy, and F-measure.

RESULTS: In the development set of 600 patients, 457 patients had confirmed BE (60 with dysplasia). The NLP identified dysplasia with 98.0% accuracy, 91.7% recall, and 93.2% precision, with an F-measure of 92.4%. All 7 patients with confirmed high-grade dysplasia were classified by the algorithm as having dysplasia. Among the 400 patients in the validation cohort, 230 had confirmed BE (39 with dysplasia). Compared with manual review, the NLP algorithm identified dysplasia with 98.7% accuracy, 92.3% recall, and 100.0% precision, with an F-measure of 96.0%.

CONCLUSIONS: NLP yielded a high degree of sensitivity and accuracy for identifying dysplasia from diverse types of pathology reports for patients with BE. The application of this algorithm would facilitate research and clinical care in an EMR system with text reports in large data repositories.

Share

COinS
 
 

To view the content in your browser, please download Adobe Reader or, alternately,
you may Download the file to your hard drive.

NOTE: The latest versions of Adobe Reader do not support viewing PDF files within Firefox on Mac OS and if you are using a modern (Intel) Mac, there is no official plugin for viewing PDF files within the browser window.