Can we trust the prediction model? Demonstrating the importance of external validation by investigating the COVID-19 Vulnerability (C-19) Index across an international network of observational healthcare datasets
Jenna M. Reps, Chungsoo Kim, Ross D. Williams, Aniek F. Markus, Cynthia Yang, Talita Duarte Salles, Thomas Falconer, Jitendra Jonnagaddala, Andrew Williams, Sergio Fernández-Bertolín, Scott L. DuVall, Kristin Kostka, Gowtham Rao, Azza Shoaibi, Anna Ostropolets, Matthew E Spotnitz, Lin Zhang, Paula Casajust, Ewout W. Steyerberg, Fredrik Nyberg, Benjamin Skov Kaas-Hansen, Young Hwa Choi, Daniel Morales, Siaw-Teng Liaw, Maria Tereza Fernandes Abrahão, Carlos Areia, Michael E. Matheny, María Aragón, Rae Woong Park, George Hripcsak, Christian G. Reich, Marc A. Suchard, Seng Chan You, Patrick B. Ryan, Daniel Prieto-Alhambra, Peter R. Rijnbeek
doi: https://doi.org/10.1101/2020.06.15.20130328
Jenna M. Reps
1Janssen Research & Development, Titusville, NJ, USA
Chungsoo Kim
2Department of Biomedical Sciences, Ajou University Graduate School of Medicine, Suwon, Republic of Korea
Ross D. Williams
23Department of Medical Informatics, Erasmus University Medical Center, Rotterdam, The Netherlands
Aniek F. Markus
23Department of Medical Informatics, Erasmus University Medical Center, Rotterdam, The Netherlands
Cynthia Yang
23Department of Medical Informatics, Erasmus University Medical Center, Rotterdam, The Netherlands
Talita Duarte Salles
5Fundacio Institut Universitari per a la recerca a l’Atencio Primaria de Salut Jordi Gol i Gurina (IDIAPJGol)
Thomas Falconer
3Department of Biomedical Informatics, Columbia University, New York, NY
Jitendra Jonnagaddala
4School of Public Health and Community Medicine, UNSW Sydney
Andrew Williams
7Tufts Institute for Clinical Research and Health Policy Studies, Boston, MA, 02111, USA
Sergio Fernández-Bertolín
5Fundacio Institut Universitari per a la recerca a l’Atencio Primaria de Salut Jordi Gol i Gurina (IDIAPJGol)
Scott L. DuVall
6Department of Veterans Affairs, USA; University of Utah, USA
Kristin Kostka
17Real World Solutions, IQVIA, Cambridge, MA, United States
Gowtham Rao
1Janssen Research & Development, Titusville, NJ, USA
Azza Shoaibi
1Janssen Research & Development, Titusville, NJ, USA
Anna Ostropolets
3Department of Biomedical Informatics, Columbia University, New York, NY
Matthew E Spotnitz
3Department of Biomedical Informatics, Columbia University, New York, NY
Lin Zhang
20School of Public Health, Peking Union Medical College, Beijing, China
16Melbourne School of Public Health, The University of Melbourne, Victoria, Australia
Paula Casajust
12Department of Real-World Evidence, Trial Form Support, Barcelona, Spain
Ewout W. Steyerberg
25Department of Public Health, Erasmus University Medical Center, Rotterdam, The Netherlands
26Department of Biomedical Data Sciences, Leiden University Medical Center, Leiden, The Netherlands
Fredrik Nyberg
22School of Public Health and Community Medicine, Institute of Medicine, Sahlgrenska Academy, University of Gothenburg Gothenburg, Sweden
Benjamin Skov Kaas-Hansen
14Clinical Pharmacology Unit, Zealand University Hospital, Roskilde, Denmark
15NNF Centre for Protein Research, University of Copenhagen, Denmark
Young Hwa Choi
11Department of Infectious Diseases, Ajou University School of Medicine, Suwon, Republic of Korea
Daniel Morales
21Division of Population Health and Genomics, University of Dundee, UK
Siaw-Teng Liaw
4School of Public Health and Community Medicine, UNSW Sydney
Maria Tereza Fernandes Abrahão
13Faculty of Medicine, University of Sao Paulo, Sao Paulo, Brazil
Carlos Areia
9Nuffield Department of Clinical Neurosciences, University of Oxford
Michael E. Matheny
8Department of Veterans Affairs, USA; Vanderbilt University, USA
María Aragón
5Fundacio Institut Universitari per a la recerca a l’Atencio Primaria de Salut Jordi Gol i Gurina (IDIAPJGol)
Rae Woong Park
18Department of Biomedical Informatics, Ajou University School of Medicine, Suwon, Republic of Korea
George Hripcsak
3Department of Biomedical Informatics, Columbia University, New York, NY
Christian G. Reich
17Real World Solutions, IQVIA, Cambridge, MA, United States
Marc A. Suchard
19Department of Biostatistics, UCLA Fielding School of Public Health, University of California, Los Angeles, CA, USA
Seng Chan You
18Department of Biomedical Informatics, Ajou University School of Medicine, Suwon, Republic of Korea
Patrick B. Ryan
1Janssen Research & Development, Titusville, NJ, USA
Daniel Prieto-Alhambra
10Centre for Statistics in Medicine, NDORMS, University of Oxford
Peter R. Rijnbeek
23Department of Medical Informatics, Erasmus University Medical Center, Rotterdam, The Netherlands
Data Availability
Data is not publicly available due to patient privacy concerns.
Posted June 17, 2020.
Can we trust the prediction model? Demonstrating the importance of external validation by investigating the COVID-19 Vulnerability (C-19) Index across an international network of observational healthcare datasets
Jenna M. Reps, Chungsoo Kim, Ross D. Williams, Aniek F. Markus, Cynthia Yang, Talita Duarte Salles, Thomas Falconer, Jitendra Jonnagaddala, Andrew Williams, Sergio Fernández-Bertolín, Scott L. DuVall, Kristin Kostka, Gowtham Rao, Azza Shoaibi, Anna Ostropolets, Matthew E Spotnitz, Lin Zhang, Paula Casajust, Ewout W. Steyerberg, Fredrik Nyberg, Benjamin Skov Kaas-Hansen, Young Hwa Choi, Daniel Morales, Siaw-Teng Liaw, Maria Tereza Fernandes Abrahão, Carlos Areia, Michael E. Matheny, María Aragón, Rae Woong Park, George Hripcsak, Christian G. Reich, Marc A. Suchard, Seng Chan You, Patrick B. Ryan, Daniel Prieto-Alhambra, Peter R. Rijnbeek
medRxiv 2020.06.15.20130328; doi: https://doi.org/10.1101/2020.06.15.20130328
Can we trust the prediction model? Demonstrating the importance of external validation by investigating the COVID-19 Vulnerability (C-19) Index across an international network of observational healthcare datasets
Jenna M. Reps, Chungsoo Kim, Ross D. Williams, Aniek F. Markus, Cynthia Yang, Talita Duarte Salles, Thomas Falconer, Jitendra Jonnagaddala, Andrew Williams, Sergio Fernández-Bertolín, Scott L. DuVall, Kristin Kostka, Gowtham Rao, Azza Shoaibi, Anna Ostropolets, Matthew E Spotnitz, Lin Zhang, Paula Casajust, Ewout W. Steyerberg, Fredrik Nyberg, Benjamin Skov Kaas-Hansen, Young Hwa Choi, Daniel Morales, Siaw-Teng Liaw, Maria Tereza Fernandes Abrahão, Carlos Areia, Michael E. Matheny, María Aragón, Rae Woong Park, George Hripcsak, Christian G. Reich, Marc A. Suchard, Seng Chan You, Patrick B. Ryan, Daniel Prieto-Alhambra, Peter R. Rijnbeek
medRxiv 2020.06.15.20130328; doi: https://doi.org/10.1101/2020.06.15.20130328
Subject Area
Subject Areas
- Addiction Medicine (62)
- Allergy and Immunology (142)
- Anesthesia (46)
- Cardiovascular Medicine (415)
- Dermatology (47)
- Emergency Medicine (144)
- Epidemiology (4855)
- Gastroenterology (183)
- Geriatric Medicine (70)
- Health Economics (192)
- Health Informatics (629)
- Health Policy (320)
- Hematology (85)
- HIV/AIDS (156)
- Medical Education (93)
- Medical Ethics (24)
- Nephrology (75)
- Neurology (686)
- Nursing (42)
- Nutrition (115)
- Oncology (439)
- Ophthalmology (140)
- Orthopedics (36)
- Otolaryngology (89)
- Pain Medicine (35)
- Palliative Medicine (16)
- Pathology (129)
- Pediatrics (194)
- Public and Global Health (1816)
- Radiology and Imaging (324)
- Respiratory Medicine (255)
- Rheumatology (86)
- Sports Medicine (62)
- Surgery (100)
- Toxicology (23)
- Transplantation (29)
- Urology (37)