Development and Application of Natural Language Processing on Unstructured Data in Hypertension: A Scoping Review

Data Sources and Search Strategy

We conducted a comprehensive search using six databases: PubMed/MEDLINE, Embase, Cochrane Library, Scopus, Web of Science, ACM Digital Library, and IEEE Xplore Digital Library, to identify relevant studies published until the end of 2022. We prepared the search terms using the PICOS approach, which stands for patients, problem or population (P), issue of interest or intervention (I), comparison, control or comparator (C), outcome (O), and study type (S). As the search aimed to be as comprehensive as possible and corresponding to the research questions, three domains including NLP, unstructured data, and hypertension, were used to develop the search strategy. A combination of keywords and controlled vocabulary terms related to the target concepts was used. The search strategy was designed and developed by two authors (JY, LH) independently and confirmed with an experienced librarian (MB). Details of the search strategy are provided in Supplemental Table 1.

Study Selection

Studies were included in this review if they met the following criteria: (1) investigated the application of NLP on unstructured data related to hypertension; (2) data were from both clinical and research practices or applications; (3) used various types of unstructured data, such as clinical notes, EHRs, and other textual sources; (4) provided sufficient details on the NLP methods employed; (5) published in English. The exclusion criteria were as follows: (1) did not focus on hypertension or did not use unstructured data.; (2) the primary research question was non-clinical (i.e., cost-analysis study); (3) not available in full text; (4) conference abstracts or posters; (5) non-research articles (i.e., perspectives, commentaries, letters, and reviews).

First, duplicate articles were eliminated from the retrieved records. Then, two independent reviewers (JY, LH) conducted the initial screening of titles and abstracts to identify potentially relevant articles. Subsequently, the full texts of the selected articles were assessed for eligibility based on the inclusion and exclusion criteria. Any discrepancies were resolved through discussion and consensus between the two reviewers. In cases of persistent disagreement, a third reviewer was consulted.

Data Extraction

A standardized data extraction form was developed to collect relevant information from the included studies. The extracted data included study characteristics (e.g., author(s), year of publication, country, field of publication), data sources, NLP techniques utilized, outcomes, challenges, and implications for hypertension research. We randomly selected 10 papers at the beginning for which all team members extracted data to calibrate. For the remaining papers, data extraction was performed by one reviewer and cross-verified by a second reviewer to ensure accuracy.

Data Synthesis and Analysis

The extracted data was synthesized using a narrative approach. Themes related to the types of unstructured data, NLP models, outcomes, challenges, and potential benefits were identified and summarized. The findings were then presented in a descriptive and tabular format.

Quality Assessment

Given the scoping nature of this review, a formal quality assessment of the included studies was not conducted. However, similar to Wang et al.,[7] we reported two relevant metrics to assess the quality of the selected studies: (1) NLP validation (Single center, Multiple centers, Benchmark dataset, Single center + Benchmark, Unspecified, etc); (2) Replicability (i.e., if the code and data are not available).

Summary of results

This review underscores the nascent stage of employing NLP on unstructured data in hypertension research is still at its nascent stage, with a smaller number of studies and less use of advanced NLP methods, compared to in other fields such as cancer and Intensive Care Units.[14] We discussed the data sources, NLP methods, and clinical implications derived. We provide suggestions both for NLP researchers and hypertension clinicians and researchers to collectively advance the use of more rigorous and advanced NLP methods to fully exploit the value of unstructured clinical texts and eventually benefit hypertension care.

Major strengths

Among the 45 studies examined, several common major strengths in the application of NLP emerge. One notable strength lies in the successful application of NLP for the identification and extraction of disease hypertension risk factors. The ability to discern and extract specific risk factors, whether related to heart disease, physiological data, lifestyle, or medication, highlights the power of NLP in automating the information retrieval process from diverse and complex medical narratives.

Another prominent strength observed across the studies is the efficacy of simple rule-based approaches with expert input or customization to study contexts. While simple, these rule-based systems often prove valuable in achieving high precision and recall rates, with relatively less requirement of technical expertise and computational resources. In addition, when used in conjunction with machine learning-based systems and medical ontologies, they show promising performances. For example, a rule-based NLP system integrating the Unified Medical Language System (UMLS) and regular expression developed by Shivadda et al. achieved an F1 score of 90.7 for extracting risk factors of heart diseases.[15] Roberts et al. also showed by augmenting the training data with fine-grained annotations and negative examples, a Support Vector Machine (SVM)-based classifier can also achieve a F1 score of 0.9276 on the same task.[16]

Furthermore, a recurrent theme involves the integration of structured and unstructured data for disease prediction.[17] Several studies recognize the complementary nature of structured and unstructured clinical data, combining information from diverse sources to enhance the accuracy and robustness of predictive models and patient cohort selection.[18] This integration not only improves the overall performance of the NLP systems but also enables a more comprehensive understanding of patient health by considering both clinical narratives and structured data fields. Hypertension research will greatly benefit from this data integration because important risk factors such as medication adherence and social determinants of health are not commonly well-captured in structured data fields, and applying NLP on unstructured narratives will generate information that together provides a more comprehensive picture of patients’ conditions.[19]

Challenges

While NLP has demonstrated remarkable capabilities in extracting valuable information from unstructured clinical texts, a series of common limitations and challenges emerge from the studies reviewed.

A persistent challenge noted across several studies is the limited generalizability of NLP models to diverse patient populations. Many studies acknowledge that the effectiveness of their developed NLP systems may be contingent on specific characteristics or documentation practices within the datasets they were trained on. This raises concerns about the scalability and applicability of these models when applied to broader patient cohorts or datasets with different demographics, healthcare systems, EHR systems, or documentation styles.[20, 21] The challenge lies in developing NLP systems that can robustly handle the variability inherent in clinical texts across diverse populations.

Another common challenge relates to the development of rules and their effectiveness in varied contexts. Rule-based approaches, while providing high precision and recall rates in certain scenarios, often face limitations in terms of generalization. Challenges include the need for extensive rule engineering, potential biases introduced by the rule design process, and difficulties in adapting rule-based systems to new or evolving healthcare contexts. Striking the right balance between specificity and adaptability remains a persistent challenge in the development of rule-based NLP systems.

Furthermore, several studies highlight the lack of clear descriptions for some NLP models and methods, contributing to challenges in replicability and transparency. Incomplete reporting of NLP algorithms, techniques, and system architectures hinders the broader understanding of how these models operate and how their performance can be assessed. Transparent reporting is crucial not only for facilitating reproducibility within the scientific community but also for promoting trust and confidence in the application of NLP techniques in real-world healthcare settings.

Implications for hypertension

By extracting relevant information from unstructured clinical narratives, NLP can contribute to the identification of risk factors, disease progression, and treatment outcomes associated with hypertension. This knowledge generation not only aids healthcare professionals in making informed decisions but also facilitates the development of targeted interventions and personalized care plans for patients with hypertension.[22] Clinical decision making and workflows can benefit from the use of NLP in hypertension.

Rule-based approaches, in particular, demonstrate their worth in recognizing and monitoring risk factors specific to hypertension. By automating the identification of relevant information, NLP systems can assist healthcare providers in efficiently assessing and managing hypertensive conditions, ultimately enhancing the quality of care delivered to patients.

Moreover, the implications for hypertension extend beyond clinical applications to include areas such as medication adherence and adverse event detection, which are of particular importance to ensure patient safety and outcomes.[23] NLP can help identify and predict patients with lower medication adherence and even discontinuation and facilitate in-time interventions to improve adherence. In addition, adverse drug events may not be thoroughly and routinely captured in structured EHR fields, and using NLP to continuously monitor and report such events to clinicians can significantly enhance patient safety and contribute to the overall management of hypertension without burdening clinicians.

While some studies highlight the strengths of NLP in disease prediction and risk factor identification, others recognize its limitations and the need for careful consideration when applying these techniques to hypertension. This is particularly challenging for hypertension because it is a prevalent health condition affecting patients from diverse backgrounds and likely have heterogeneous clinical documentations. Challenges such as limited generalizability and rule adaptability are acknowledged, emphasizing the importance of refining and externally validating NLP models to suit the complexities of hypertension across diverse patient populations.

Only six studies extracted non-clinical variables such as lifestyle information,[24] demographics and medication adherence,[25–27] and family history and smoking status.[28, 29] This finding suggests that unstructured clinical texts are significantly underutilized for studying social determinants of health in hypertension, which holds great promises for personalized prevention, treatment, and management of hypertension.[4] In addition, while temporal information is critical to understand hypertensive patients’ progression, no studies developed or applied NLP to extract it from clinical narratives. This underutilization of clinical narratives in hypertension, again, suggests room for future development.

The lack of using NLP for extracting non-clinical and temporal variables may be in part due to the fact that there is a lack of benchmark datasets with annotated non-clinical variables for developing and evaluating NLP tools in hypertension. In addition, there are no standard guidelines for annotating non-clinical variables in hypertension. Therefore, the hypertension community may consider initiating efforts to develop guidelines for annotating and extracting non-clinical variables that are critical for hypertension care, which can facilitate the development of high-quality NLP tools to assist the extraction from unstructured clinical notes. A critical insight emerges on the imperative to not only embrace but also tailor more advanced NLP methodologies specifically for the unique challenges and intricacies of hypertension studies.

This necessity stems from the potential of such technologies to unlock deeper insights from the complex, multifaceted data associated with hypertension, thereby enhancing diagnostic accuracy, treatment efficacy, and patient outcomes. Concurrently, there exists an equally important call for the standardization of research practices and reporting protocols when employing NLP in this domain. Standardization would ensure that findings are reproducible, verifiable, and comparable across studies, fostering a more cohesive body of research. The rigorously standardized research methodologies will not only propel the field forward but also ensure that the advancements are built on a solid, reliable foundation, ultimately accelerating the integration of NLP into clinical practice for hypertension management.

While NLP has shown immense potential in various fields of medicine, its application in specific domains like hypertension has been comparatively limited, especially when compared to more extensively researched areas like cancer.[30] Historically, research efforts in NLP have been directed towards high-profile diseases such as cancer, where large-scale datasets and significant funding are often available. Availability of high-quality, annotated datasets is essential for training and validating NLP models. In the case of hypertension, obtaining large, well-annotated datasets with diverse sources of unstructured data (e.g., clinical notes, research articles) can be a challenging endeavor.

NLP’s ability to extract and analyze information from diverse unstructured data sources allows for the customization of treatment plans. By considering individual patient histories, genetic factors, and lifestyle patterns, healthcare providers can tailor interventions to optimize outcomes. This personalized approach not only improves patient satisfaction but also enhances treatment effectiveness by accounting for unique physiological responses and preferences across diverse and heterogenous patient populations. Timely identification of hypertension and related complications is paramount for effective management.[31] NLP-powered systems can scan through extensive datasets, including clinical notes, imaging reports, and research articles, to identify subtle trends or risk indicators. Early intervention strategies can then be implemented, potentially preventing the progression of hypertensive disorders and reducing associated morbidity and mortality rates. By seamlessly integrating with EHRs, these systems can provide real-time, contextually relevant information at the point of care.[32] This not only aids in accurate diagnosis but also assists in selecting appropriate treatment options, monitoring patient progress, and minimizing errors in clinical decision-making.

In addition, the advent and evolution of large language models (LLMs) stand as a cornerstone in the field of NLP, offering unprecedented capabilities in understanding, generating, and extracting meaningful information from vast swaths of unstructured data.[33] In the context of hypertension research, LLMs present a particularly promising avenue for innovation. These models, with their deep learning architectures, can analyze complex clinical narratives, decipher medical jargon, and identify nuanced patterns and indicators relevant to hypertension care that may elude traditional analysis methods. Their ability to process and interpret large datasets—ranging from EHRs to academic literature—enables a more comprehensive and nuanced understanding of hypertension, its determinants, and its manifestations across diverse patient populations. As such, LLMs hold the potential to significantly enhance diagnostic accuracy, personalize treatment approaches, and ultimately, improve patient outcomes by providing insights that are both deep and scalable. The integration of LLMs into hypertension research represents a forward leap, promising to bridge gaps in current knowledge and paving the way for more informed, data-driven decision-making in clinical practice.