Abstract
Objectives To validate the diagnoses of AMI and stroke recorded in EMR and to estimate the population prevalence of both diseases in people aged ≥ 18 years
Design Cross-sectional validation study Setting: 45 primary care centres
Participants Simple random sampling of diagnoses of AMI and stroke (ICPC-2 codes K75 and K90, respectively) registered by 55 physicians and random age- and sex-matched sampling of the records that included in primary care EMRs in Madrid (Spain).
Primary and Secondary Outcomes Measures Sensitivity, specificity, positive and negative predictive values, and overall agreement were calculated using the kappa statistic. Applied gold standards were electrocardiograms, brain imaging studies, hospital discharge reports, cardiology reports, and neurology reports. In the case of AMI, the ESC/ACCF/AHA/WHF Expert Consensus Document was also used. Secondary outcomes were the estimated prevalence of both diseases considering the sensitivity and specificity obtained (true prevalence).
Results The sensitivity of a diagnosis of AMI was 98.11% (95% CI, 96.29-99.03), and the specificity was 97.42% (95% CI, 95.44-98.55). The sensitivity of a diagnosis of stroke was 97.56% (95% CI, 95.56-98.68), and the specificity was 94.51% (95% CI, 91.96-96.28). No differences in the results were found after stratification by age and sex (both diseases). The prevalence of AMI and stroke was 1.38% and 1.27%, respectively.
Conclusion The validation results show that diagnoses of AMI and stroke in primary care EMRs constitute a helpful tool in epidemiological studies. The prevalence of AMI and stroke was lower than 2% in the population aged over 18 years.
Strengths and limitations of this study
The major strength of the e-MADVEVA study is the individual validation (manual validation) of electronic medical records by comparing each case and non-case, matched by age, with an accepted reference gold standard.
The validation method allows for calculating PPV, NPV, Sensitivity, and Specificity, in contrast with other methods such as questionnaires for healthcare practitioners or patients and comparing rates in a comparable population.
In-hospital mortality due to AMI and stroke may not have been recorded in primary care EMRs, with the result that the prevalence of patients who die in hospital due to a first AMI or stroke may be underestimated.
The ICPC-2 codes studied for AMI (ICPC-2 K75) and stroke (ICPC-2 K90) do not allow differentiation between the different types of AMI and stroke.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
This work was supported by the Fondo de Investigaciones Sanitarias or Health Research Fund, Instituto de Salud Carlos III grant no. PI13/00632, and co-funded by the European Union through the Fondo Europeo de Desarrollo Regional, A way of shaping Europe. The funders had no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript).
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
The e-MADVEVA Study protocol was approved by the Ethics Committee of Hospital Universitario Ramon y Cajal, Madrid (code 345) and the Central Research Commission of the Madrid Primary Care Management (code 02/2015).
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Data Availability
The datasets generated during the e-MADVEVA Study are available from the corresponding author on reasonable request.
Abbreviations
- AMI
- Acute myocardial infarction
- EMR
- Electronic medical records
- ESC/ACCF/AHA/WHF
- European Society of Cardiology, the American College of Cardiology Foundation, American Heart Association and the World Heart Federation
- ICD-9
- International Classification of Diseases, Ninth Revision
- ICD-10
- International Classification of Diseases, Tenth Revision
- ICPC-2
- Second edition of the International Classification of Primary Care
- CI
- Confidence interval
- PPV
- Positive predictive value
- NPV
- Negative predictive value