Abstract
Objective We address a first step towards using social media data to supplement current efforts in monitoring population-level medication non-adherence: detecting changes to medication treatment. Medication treatment changes, like changes to dosage or to frequency of intake, that are not overseen by a physician are, by that, non-adherence to medication. Despite the consequences, including worsening health conditions or death, 50% of patients are estimated to not take medications as indicated. Current methods to identify non-adherence have major limitations. Direct observation may be intrusive or expensive, and indirect observation through patient surveys relies heavily on patients’ memory and candor. Using social media data in these studies may address these limitations.
Methods We annotated 9,835 tweets mentioning medications and trained a convolutional neural network (CNN) to find mentions of medication treatment changes, regardless of whether the change was recommended by a physician. We used active and transfer learning from 12,972 reviews we annotated from WebMD to address the class imbalance of our Twitter corpus. To validate our CNN and explore future directions, we annotated 1,956 positive tweets as to whether they reflect non-adherence and categorized the reasons given.
Results Our CNN achieved state-of-the-art performance with 0.50 F1-score. The manual analysis of positive tweets revealed that non-adherence is evident in a subset with nine categories of reasons for non-adherence.
Conclusion We showed that social media users publicly discuss medication treatment changes and may explain their reasons including when it constitutes non-adherence. This approach may be useful to supplement current efforts in adherence monitoring.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
This work was supported by National Library of Medicine grant number R01LM011176 to GG-H. The content is solely the responsibility of the authors and does not necessarily represent the official view of National Library of Medicine.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
A certificate of exemption was obtained from the Institutional Review Board of the University of Pennsylvania.
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Data Availability
All data will be released during the text mining competition #SMM4H'21 at NAACL'21