Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Test performance evaluation of SARS-CoV-2 serological assays

View ORCID ProfileJeffrey D. Whitman, View ORCID ProfileJoseph Hiatt, View ORCID ProfileCody T. Mowery, Brian R. Shy, Ruby Yu, View ORCID ProfileTori N. Yamamoto, Ujjwal Rathore, Gregory M. Goldgof, Caroline Whitty, Jonathan M. Woo, Antonia E. Gallman, Tyler E. Miller, Andrew G. Levine, David N. Nguyen, Sagar P. Bapat, Joanna Balcerek, Sophia A. Bylsma, Ana M. Lyons, Stacy Li, Allison Wai-yi Wong, Eva Mae Gillis-Buck, Zachary B. Steinhart, Youjin Lee, Ryan Apathy, Mitchell J. Lipke, Jennifer Anne Smith, Tina Zheng, Ian C. Boothby, Erin Isaza, Jackie Chan, Dante D. Acenas II, Jinwoo Lee, Trisha A. Macrae, Than S. Kyaw, David Wu, Dianna L. Ng, Wei Gu, Vanessa A. York, Haig Alexander Eskandarian, Perri C. Callaway, Lakshmi Warrier, Mary E. Moreno, Justine Levan, Leonel Torres, Lila A. Farrington, Rita Loudermilk, Kanishka Koshal, Kelsey C. Zorn, Wilfredo F. Garcia-Beltran, Diane Yang, Michael G. Astudillo, Bradley E. Bernstein, Jeffrey A. Gelfand, Edward T. Ryan, Richelle C. Charles, A. John Iafrate, Jochen K. Lennerz, View ORCID ProfileSteve Miller, Charles Y. Chiu, View ORCID ProfileSusan L. Stramer, Michael R. Wilson, Aashish Manglik, Chun Jimmie Ye, Nevan J. Krogan, Mark S. Anderson, Jason G. Cyster, Joel D. Ernst, Alan H. B. Wu, Kara L. Lynch, View ORCID ProfileCaryn Bern, Patrick D. Hsu, Alexander Marson
doi: https://doi.org/10.1101/2020.04.25.20074856
Jeffrey D. Whitman
1Department of Laboratory Medicine, University of California, San Francisco, San Francisco, CA 94143, USA
M.D., M.S.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Jeffrey D. Whitman
Joseph Hiatt
2Medical Scientist Training Program, University of California, San Francisco, CA 94143, USA
3Biomedical Sciences Graduate Program, University of California, San Francisco, CA 94143, USA
4J. David Gladstone Institutes, San Francisco, CA 94158, USA
5Department of Microbiology and Immunology, University of California, San Francisco, CA 94143, USA
6Innovative Genomics Institute, University of California, Berkeley, CA 94720, USA
7Diabetes Center, University of California, San Francisco, San Francisco, CA 94143, USA
B.A.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Joseph Hiatt
Cody T. Mowery
2Medical Scientist Training Program, University of California, San Francisco, CA 94143, USA
3Biomedical Sciences Graduate Program, University of California, San Francisco, CA 94143, USA
5Department of Microbiology and Immunology, University of California, San Francisco, CA 94143, USA
6Innovative Genomics Institute, University of California, Berkeley, CA 94720, USA
7Diabetes Center, University of California, San Francisco, San Francisco, CA 94143, USA
B.S.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Cody T. Mowery
Brian R. Shy
1Department of Laboratory Medicine, University of California, San Francisco, San Francisco, CA 94143, USA
M.D., Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ruby Yu
5Department of Microbiology and Immunology, University of California, San Francisco, CA 94143, USA
7Diabetes Center, University of California, San Francisco, San Francisco, CA 94143, USA
Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tori N. Yamamoto
5Department of Microbiology and Immunology, University of California, San Francisco, CA 94143, USA
6Innovative Genomics Institute, University of California, Berkeley, CA 94720, USA
7Diabetes Center, University of California, San Francisco, San Francisco, CA 94143, USA
Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Tori N. Yamamoto
Ujjwal Rathore
4J. David Gladstone Institutes, San Francisco, CA 94158, USA
5Department of Microbiology and Immunology, University of California, San Francisco, CA 94143, USA
6Innovative Genomics Institute, University of California, Berkeley, CA 94720, USA
7Diabetes Center, University of California, San Francisco, San Francisco, CA 94143, USA
Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Gregory M. Goldgof
1Department of Laboratory Medicine, University of California, San Francisco, San Francisco, CA 94143, USA
M.D., Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Caroline Whitty
1Department of Laboratory Medicine, University of California, San Francisco, San Francisco, CA 94143, USA
5Department of Microbiology and Immunology, University of California, San Francisco, CA 94143, USA
7Diabetes Center, University of California, San Francisco, San Francisco, CA 94143, USA
B.S.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jonathan M. Woo
5Department of Microbiology and Immunology, University of California, San Francisco, CA 94143, USA
6Innovative Genomics Institute, University of California, Berkeley, CA 94720, USA
7Diabetes Center, University of California, San Francisco, San Francisco, CA 94143, USA
B.S.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Antonia E. Gallman
2Medical Scientist Training Program, University of California, San Francisco, CA 94143, USA
5Department of Microbiology and Immunology, University of California, San Francisco, CA 94143, USA
8Howard Hughes Medical Institute, University of California, San Francisco
B.S.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tyler E. Miller
36Department of Pathology, Massachusetts General Hospital/Harvard Medical School, Boston, MA, USA
M.D., Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Andrew G. Levine
1Department of Laboratory Medicine, University of California, San Francisco, San Francisco, CA 94143, USA
M.D., Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
David N. Nguyen
5Department of Microbiology and Immunology, University of California, San Francisco, CA 94143, USA
6Innovative Genomics Institute, University of California, Berkeley, CA 94720, USA
9Department of Medicine, Division of Infectious Diseases, University of California, San Francisco, San Francisco, CA 94143, USA
M.D., Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sagar P. Bapat
1Department of Laboratory Medicine, University of California, San Francisco, San Francisco, CA 94143, USA
5Department of Microbiology and Immunology, University of California, San Francisco, CA 94143, USA
7Diabetes Center, University of California, San Francisco, San Francisco, CA 94143, USA
M.D., Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Joanna Balcerek
1Department of Laboratory Medicine, University of California, San Francisco, San Francisco, CA 94143, USA
M.D., Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sophia A. Bylsma
20Department of Bioengineering, University of California, Berkeley, Berkeley CA 94720 USA
B.S.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ana M. Lyons
21Department of Integrative Biology, University of California, Berkeley, Berkeley CA 94720 USA
B.S.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Stacy Li
21Department of Integrative Biology, University of California, Berkeley, Berkeley CA 94720 USA
B.S.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Allison Wai-yi Wong
2Medical Scientist Training Program, University of California, San Francisco, CA 94143, USA
Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Eva Mae Gillis-Buck
10Department of Surgery, University of California, San Francisco, CA 94143, USA
M.Phil.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Zachary B. Steinhart
5Department of Microbiology and Immunology, University of California, San Francisco, CA 94143, USA
7Diabetes Center, University of California, San Francisco, San Francisco, CA 94143, USA
Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Youjin Lee
5Department of Microbiology and Immunology, University of California, San Francisco, CA 94143, USA
Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ryan Apathy
5Department of Microbiology and Immunology, University of California, San Francisco, CA 94143, USA
6Innovative Genomics Institute, University of California, Berkeley, CA 94720, USA
7Diabetes Center, University of California, San Francisco, San Francisco, CA 94143, USA
B.S.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mitchell J. Lipke
5Department of Microbiology and Immunology, University of California, San Francisco, CA 94143, USA
7Diabetes Center, University of California, San Francisco, San Francisco, CA 94143, USA
B.S.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jennifer Anne Smith
7Diabetes Center, University of California, San Francisco, San Francisco, CA 94143, USA
11Department of Medicine, University of California, San Francisco, San Francisco, CA 94143, USA
Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tina Zheng
2Medical Scientist Training Program, University of California, San Francisco, CA 94143, USA
3Biomedical Sciences Graduate Program, University of California, San Francisco, CA 94143, USA
12Department of Neurology, University of California, San Francisco, CA 94158, USA
13Helen Diller Family Comprehensive Cancer Center, University of California, San Francisco, San Francisco, CA 94158, USA
B.S.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ian C. Boothby
2Medical Scientist Training Program, University of California, San Francisco, CA 94143, USA
14Department of Dermatology, University of California, San Francisco, San Francisco, CA 94158, USA
B.A.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Erin Isaza
2Medical Scientist Training Program, University of California, San Francisco, CA 94143, USA
15Program in Quantitative Biology, University of California, San Francisco, San Francisco, CA 94158, USA
B.S.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jackie Chan
5Department of Microbiology and Immunology, University of California, San Francisco, CA 94143, USA
B.S.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Dante D. Acenas II
5Department of Microbiology and Immunology, University of California, San Francisco, CA 94143, USA
B.A.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jinwoo Lee
2Medical Scientist Training Program, University of California, San Francisco, CA 94143, USA
16School of Medicine, University of California, San Francisco, San Francisco, CA 94158, USA
Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Trisha A. Macrae
2Medical Scientist Training Program, University of California, San Francisco, CA 94143, USA
16School of Medicine, University of California, San Francisco, San Francisco, CA 94158, USA
Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Than S. Kyaw
2Medical Scientist Training Program, University of California, San Francisco, CA 94143, USA
5Department of Microbiology and Immunology, University of California, San Francisco, CA 94143, USA
B.S.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
David Wu
2Medical Scientist Training Program, University of California, San Francisco, CA 94143, USA
3Biomedical Sciences Graduate Program, University of California, San Francisco, CA 94143, USA
B.S.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Dianna L. Ng
13Helen Diller Family Comprehensive Cancer Center, University of California, San Francisco, San Francisco, CA 94158, USA
17Department of Pathology, University of California, San Francisco, San Francisco, CA, 94158, USA
M.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Wei Gu
1Department of Laboratory Medicine, University of California, San Francisco, San Francisco, CA 94143, USA
M.D., Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Vanessa A. York
18Division of Experimental Medicine, Department of Medicine, University of California San Francisco, San Francisco CA, USA
B.S.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Haig Alexander Eskandarian
18Division of Experimental Medicine, Department of Medicine, University of California San Francisco, San Francisco CA, USA
Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Perri C. Callaway
18Division of Experimental Medicine, Department of Medicine, University of California San Francisco, San Francisco CA, USA
19Infectious Diseases and Immunity Graduate Group, University of California Berkeley, Berkeley, CA, USA
B.A.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lakshmi Warrier
18Division of Experimental Medicine, Department of Medicine, University of California San Francisco, San Francisco CA, USA
B.S.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mary E. Moreno
18Division of Experimental Medicine, Department of Medicine, University of California San Francisco, San Francisco CA, USA
B.S.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Justine Levan
18Division of Experimental Medicine, Department of Medicine, University of California San Francisco, San Francisco CA, USA
Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Leonel Torres
18Division of Experimental Medicine, Department of Medicine, University of California San Francisco, San Francisco CA, USA
B.S.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lila A. Farrington
18Division of Experimental Medicine, Department of Medicine, University of California San Francisco, San Francisco CA, USA
Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Rita Loudermilk
22Weill Institute for Neurosciences, Department of Neurology, University of California, San Francisco, San Francisco, CA
B.S.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kanishka Koshal
22Weill Institute for Neurosciences, Department of Neurology, University of California, San Francisco, San Francisco, CA
M.P.H.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kelsey C. Zorn
23Department of Biochemistry and Biophysics, University of California, San Francisco, San Francisco, CA 94158, USA
M.H.S.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Wilfredo F. Garcia-Beltran
36Department of Pathology, Massachusetts General Hospital/Harvard Medical School, Boston, MA, USA
M.D., Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Diane Yang
36Department of Pathology, Massachusetts General Hospital/Harvard Medical School, Boston, MA, USA
Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Michael G. Astudillo
36Department of Pathology, Massachusetts General Hospital/Harvard Medical School, Boston, MA, USA
M.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Bradley E. Bernstein
36Department of Pathology, Massachusetts General Hospital/Harvard Medical School, Boston, MA, USA
M.D., Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jeffrey A. Gelfand
37Division of Infectious Diseases, Massachusetts General Hospital/Harvard Medical School, Boston, MA, USA
M.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Edward T. Ryan
37Division of Infectious Diseases, Massachusetts General Hospital/Harvard Medical School, Boston, MA, USA
M.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Richelle C. Charles
37Division of Infectious Diseases, Massachusetts General Hospital/Harvard Medical School, Boston, MA, USA
M.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
A. John Iafrate
36Department of Pathology, Massachusetts General Hospital/Harvard Medical School, Boston, MA, USA
M.D., Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jochen K. Lennerz
36Department of Pathology, Massachusetts General Hospital/Harvard Medical School, Boston, MA, USA
M.D., Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Steve Miller
1Department of Laboratory Medicine, University of California, San Francisco, San Francisco, CA 94143, USA
M.D., Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Steve Miller
Charles Y. Chiu
1Department of Laboratory Medicine, University of California, San Francisco, San Francisco, CA 94143, USA
9Department of Medicine, Division of Infectious Diseases, University of California, San Francisco, San Francisco, CA 94143, USA
24UCSF-Abbott Viral Diagnostics and Discovery Center, San Francisco, CA, USA
M.D., Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Susan L. Stramer
25Scientific Affairs, American Red Cross, Gaithersburg, MD
Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Susan L. Stramer
Michael R. Wilson
3Biomedical Sciences Graduate Program, University of California, San Francisco, CA 94143, USA
22Weill Institute for Neurosciences, Department of Neurology, University of California, San Francisco, San Francisco, CA
M.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Aashish Manglik
27Department of Pharmaceutical Chemistry, University of California, San Francisco, San Francisco, CA 94158
M.D., Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Chun Jimmie Ye
28Parker Institute for Cancer Immunotherapy, San Francisco, CA, USA
29Chan Zuckerberg Biohub, San Francisco, CA, USA
30Institute for Human Genetics, University of California, San Francisco, San Francisco, CA, USA
31Division of Rheumatology, Department of Medicine, University of California, San Francisco, San Francisco, CA, USA
32Institute of Computational Health Sciences, University of California, San Francisco, San Francisco, CA, USA
33Department of Epidemiology and Biostatistics, University of California, San Francisco, San Francisco, CA, USA
Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nevan J. Krogan
4J. David Gladstone Institutes, San Francisco, CA 94158, USA
34Department of Cellular and Molecular Pharmacology, University of California, San Francisco, CA 94158, USA
35Quantitative Biosciences Institute, University of California, San Francisco, CA 94158, USA
Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mark S. Anderson
7Diabetes Center, University of California, San Francisco, San Francisco, CA 94143, USA
M.D., Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jason G. Cyster
5Department of Microbiology and Immunology, University of California, San Francisco, CA 94143, USA
8Howard Hughes Medical Institute, University of California, San Francisco
Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Joel D. Ernst
18Division of Experimental Medicine, Department of Medicine, University of California San Francisco, San Francisco CA, USA
M.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alan H. B. Wu
1Department of Laboratory Medicine, University of California, San Francisco, San Francisco, CA 94143, USA
Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kara L. Lynch
1Department of Laboratory Medicine, University of California, San Francisco, San Francisco, CA 94143, USA
Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Caryn Bern
33Department of Epidemiology and Biostatistics, University of California, San Francisco, San Francisco, CA, USA
M.D., M.P.H.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Caryn Bern
  • For correspondence: alexander.marson@ucsf.edu pdhsu@berkeley.edu caryn.bern2@ucsf.edu
Patrick D. Hsu
6Innovative Genomics Institute, University of California, Berkeley, CA 94720, USA
20Department of Bioengineering, University of California, Berkeley, Berkeley CA 94720 USA
Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: alexander.marson@ucsf.edu pdhsu@berkeley.edu caryn.bern2@ucsf.edu
Alexander Marson
4J. David Gladstone Institutes, San Francisco, CA 94158, USA
5Department of Microbiology and Immunology, University of California, San Francisco, CA 94143, USA
6Innovative Genomics Institute, University of California, Berkeley, CA 94720, USA
7Diabetes Center, University of California, San Francisco, San Francisco, CA 94143, USA
11Department of Medicine, University of California, San Francisco, San Francisco, CA 94143, USA
13Helen Diller Family Comprehensive Cancer Center, University of California, San Francisco, San Francisco, CA 94158, USA
28Parker Institute for Cancer Immunotherapy, San Francisco, CA, USA
29Chan Zuckerberg Biohub, San Francisco, CA, USA
30Institute for Human Genetics, University of California, San Francisco, San Francisco, CA, USA
M.D., Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: alexander.marson@ucsf.edu pdhsu@berkeley.edu caryn.bern2@ucsf.edu
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

ABSTRACT

Background Serological tests are crucial tools for assessments of SARS-CoV-2 exposure, infection and potential immunity. Their appropriate use and interpretation require accurate assay performance data.

Method We conducted an evaluation of 10 lateral flow assays (LFAs) and two ELISAs to detect anti-SARS-CoV-2 antibodies. The specimen set comprised 128 plasma or serum samples from 79 symptomatic SARS-CoV-2 RT-PCR-positive individuals; 108 pre-COVID-19 negative controls; and 52 recent samples from individuals who underwent respiratory viral testing but were not diagnosed with Coronavirus Disease 2019 (COVID-19). Samples were blinded and LFA results were interpreted by two independent readers, using a standardized intensity scoring system.

Results Among specimens from SARS-CoV-2 RT-PCR-positive individuals, the percent seropositive increased with time interval, peaking at 81.8-100.0% in samples taken >20 days after symptom onset. Test specificity ranged from 84.3-100.0% in pre-COVID-19 specimens. Specificity was higher when weak LFA bands were considered negative, but this decreased sensitivity. IgM detection was more variable than IgG, and detection was highest when IgM and IgG results were combined. Agreement between ELISAs and LFAs ranged from 75.7-94.8%. No consistent cross-reactivity was observed.

Conclusion Our evaluation showed heterogeneous assay performance. Reader training is key to reliable LFA performance, and can be tailored for survey goals. Informed use of serology will require evaluations covering the full spectrum of SARS-CoV-2 infections, from asymptomatic and mild infection to severe disease, and later convalescence. Well-designed studies to elucidate the mechanisms and serological correlates of protective immunity will be crucial to guide rational clinical and public health policies.

Competing Interest Statement

This work was supported by gifts from Anthem Blue Cross Blue Shield, the Chan Zuckerberg Biohub, and anonymous philanthropy. C.Y.C. is the director of the UCSF-Abbott Viral Diagnostics and Discovery Center, receives research support funding from Abbott Laboratories and is on the Scientific Advisory Board of Mammoth Biosciences, Inc. C. J. Y. is cofounder of DropPrint Genomics and serves as an advisor to them. M.S.A. holds stock in Medtronic and Merck. P.D.H. is a cofounder of Spotlight Therapeutics and serves on the board of directors and scientific advisory board, and is an advisor to Serotiny. P.D.H. holds stock in Spotlight Therapeutics and Editas Medicine. A.M. is a cofounder of Spotlight Therapeutics and Arsenal Biosciences and serves on their boards of directors and scientific advisory boards. A.M. has served as an advisor to Juno Therapeutics, was a member of the scientific advisory board at PACT Pharma, and was an advisor to Trizell. A.M. owns stock in Arsenal Biosciences, Spotlight Therapeutics and PACT Pharma. RY owns stock in Abbvie, Bluebird Bio, Bristol Myers Squibb, Cara Therapeutics, Editas Medicine, Esperion, and Gilead Sciences. Unrelated to this current work, the Marson lab has received sponsored research support from Juno Therapeutics, Epinomics and Sanofi, and a gift from Gilead.

Funding Statement

The work was supported by gifts from Anthem Blue Cross Blue Shield, the Chan Zuckerberg Biohub, and anonymous philanthropy. We thank the following sources for donation of test kits: the manufacturers of Bioperfectus, Decombio, Sure-Bio, UCP Biosciences; David Friedberg; John Hering; Henry Schein (Melville, NY). The Wilson Lab has received support from the Rachleff Family Foundation. The Hsu lab has received support from S. Altman, V. and N. Khosla, D. and S. Deb, the Curci Foundation, and Emergent Ventures. P.D.H. holds a Deb Faculty Fellowship from the UC Berkeley College of Engineering and is the recipient of the Rainwater Foundation Prize for Innovative Early-Career Scientist. The Marson lab has received gifts from J. Aronov, G. Hoskin, K. Jordan, B. Bakar, the Caufield family and funds from the Innovative Genomics Institute (IGI), the Northern California JDRF Center of Excellence and the Parker Institute for Cancer Immunotherapy (PICI). We thank the National Institutes of Health for their support (J.D.W. R38HL143581; A.E.G. F30AI150061; D.N.N. L40 AI140341; S.P.B. NHLBI R38HL143581; T.A.M. 1F30HD093116; D.W NIH 1F31NS106868-01; J.G.C. R01 AI40098; E.T.R., R.C.C. CDC U01CK000490; MSTP students supported by T32GM007618). R.Y. was supported by an AP Giannini Postdoctoral Fellowship. J.A.S. was supported by the Larry L. Hillblom Foundation (2019-D-006-FEL). A.M. holds a Career Award for Medical Scientists from the Burroughs Wellcome Fund, is an investigator at the Chan-Zuckerberg Biohub and is a recipient of The Cancer Research Institute (CRI) Lloyd J. Old STAR grant.

Author Declarations

All relevant ethical guidelines have been followed; any necessary IRB and/or ethics committee approvals have been obtained and details of the IRB/oversight body are included in the manuscript.

Yes

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

All data used in the study are available in an interactive format at https://covidtestingproject.org/x

https://covidtestingproject.org/

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
Posted May 17, 2020.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Test performance evaluation of SARS-CoV-2 serological assays
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Test performance evaluation of SARS-CoV-2 serological assays
Jeffrey D. Whitman, Joseph Hiatt, Cody T. Mowery, Brian R. Shy, Ruby Yu, Tori N. Yamamoto, Ujjwal Rathore, Gregory M. Goldgof, Caroline Whitty, Jonathan M. Woo, Antonia E. Gallman, Tyler E. Miller, Andrew G. Levine, David N. Nguyen, Sagar P. Bapat, Joanna Balcerek, Sophia A. Bylsma, Ana M. Lyons, Stacy Li, Allison Wai-yi Wong, Eva Mae Gillis-Buck, Zachary B. Steinhart, Youjin Lee, Ryan Apathy, Mitchell J. Lipke, Jennifer Anne Smith, Tina Zheng, Ian C. Boothby, Erin Isaza, Jackie Chan, Dante D. Acenas II, Jinwoo Lee, Trisha A. Macrae, Than S. Kyaw, David Wu, Dianna L. Ng, Wei Gu, Vanessa A. York, Haig Alexander Eskandarian, Perri C. Callaway, Lakshmi Warrier, Mary E. Moreno, Justine Levan, Leonel Torres, Lila A. Farrington, Rita Loudermilk, Kanishka Koshal, Kelsey C. Zorn, Wilfredo F. Garcia-Beltran, Diane Yang, Michael G. Astudillo, Bradley E. Bernstein, Jeffrey A. Gelfand, Edward T. Ryan, Richelle C. Charles, A. John Iafrate, Jochen K. Lennerz, Steve Miller, Charles Y. Chiu, Susan L. Stramer, Michael R. Wilson, Aashish Manglik, Chun Jimmie Ye, Nevan J. Krogan, Mark S. Anderson, Jason G. Cyster, Joel D. Ernst, Alan H. B. Wu, Kara L. Lynch, Caryn Bern, Patrick D. Hsu, Alexander Marson
medRxiv 2020.04.25.20074856; doi: https://doi.org/10.1101/2020.04.25.20074856
Reddit logo Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Test performance evaluation of SARS-CoV-2 serological assays
Jeffrey D. Whitman, Joseph Hiatt, Cody T. Mowery, Brian R. Shy, Ruby Yu, Tori N. Yamamoto, Ujjwal Rathore, Gregory M. Goldgof, Caroline Whitty, Jonathan M. Woo, Antonia E. Gallman, Tyler E. Miller, Andrew G. Levine, David N. Nguyen, Sagar P. Bapat, Joanna Balcerek, Sophia A. Bylsma, Ana M. Lyons, Stacy Li, Allison Wai-yi Wong, Eva Mae Gillis-Buck, Zachary B. Steinhart, Youjin Lee, Ryan Apathy, Mitchell J. Lipke, Jennifer Anne Smith, Tina Zheng, Ian C. Boothby, Erin Isaza, Jackie Chan, Dante D. Acenas II, Jinwoo Lee, Trisha A. Macrae, Than S. Kyaw, David Wu, Dianna L. Ng, Wei Gu, Vanessa A. York, Haig Alexander Eskandarian, Perri C. Callaway, Lakshmi Warrier, Mary E. Moreno, Justine Levan, Leonel Torres, Lila A. Farrington, Rita Loudermilk, Kanishka Koshal, Kelsey C. Zorn, Wilfredo F. Garcia-Beltran, Diane Yang, Michael G. Astudillo, Bradley E. Bernstein, Jeffrey A. Gelfand, Edward T. Ryan, Richelle C. Charles, A. John Iafrate, Jochen K. Lennerz, Steve Miller, Charles Y. Chiu, Susan L. Stramer, Michael R. Wilson, Aashish Manglik, Chun Jimmie Ye, Nevan J. Krogan, Mark S. Anderson, Jason G. Cyster, Joel D. Ernst, Alan H. B. Wu, Kara L. Lynch, Caryn Bern, Patrick D. Hsu, Alexander Marson
medRxiv 2020.04.25.20074856; doi: https://doi.org/10.1101/2020.04.25.20074856

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Infectious Diseases (except HIV/AIDS)
Subject Areas
All Articles
  • Addiction Medicine (269)
  • Allergy and Immunology (549)
  • Anesthesia (134)
  • Cardiovascular Medicine (1747)
  • Dentistry and Oral Medicine (238)
  • Dermatology (172)
  • Emergency Medicine (310)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (653)
  • Epidemiology (10779)
  • Forensic Medicine (8)
  • Gastroenterology (583)
  • Genetic and Genomic Medicine (2933)
  • Geriatric Medicine (286)
  • Health Economics (531)
  • Health Informatics (1918)
  • Health Policy (833)
  • Health Systems and Quality Improvement (743)
  • Hematology (290)
  • HIV/AIDS (627)
  • Infectious Diseases (except HIV/AIDS) (12496)
  • Intensive Care and Critical Care Medicine (684)
  • Medical Education (299)
  • Medical Ethics (86)
  • Nephrology (321)
  • Neurology (2780)
  • Nursing (150)
  • Nutrition (431)
  • Obstetrics and Gynecology (553)
  • Occupational and Environmental Health (597)
  • Oncology (1454)
  • Ophthalmology (440)
  • Orthopedics (172)
  • Otolaryngology (255)
  • Pain Medicine (190)
  • Palliative Medicine (56)
  • Pathology (379)
  • Pediatrics (864)
  • Pharmacology and Therapeutics (362)
  • Primary Care Research (333)
  • Psychiatry and Clinical Psychology (2630)
  • Public and Global Health (5338)
  • Radiology and Imaging (1002)
  • Rehabilitation Medicine and Physical Therapy (594)
  • Respiratory Medicine (722)
  • Rheumatology (329)
  • Sexual and Reproductive Health (288)
  • Sports Medicine (278)
  • Surgery (327)
  • Toxicology (47)
  • Transplantation (149)
  • Urology (125)