Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

FebriDx point-of-care test in patients with suspected COVID-19: a pooled diagnostic accuracy study

Samuel G. Urwin, B. Clare Lendrem, Jana Suklan, Kile Green, Sara Graziadio, Peter Buckle, Paul M. Dark, Adam L. Gordon, Daniel S. Lasserson, Brian Nicholson, D. Ashley Price, Charles Reynard, Mark H. Wilcox, Graham Prestwich, Valerie Tate, Tristan W. Clark, Raja V. Reddy, Richard Body, A. Joy Allen
doi: https://doi.org/10.1101/2020.10.15.20213108
Samuel G. Urwin
1NIHR Newcastle In Vitro Diagnostics Co-operative, Newcastle-upon-Tyne Hospitals Foundation Trust, Newcastle-upon-Tyne, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: sam.urwin@newcastle.ac.uk
B. Clare Lendrem
2NIHR Newcastle In Vitro Diagnostics Co-operative, Translational and Clinical Research Institute, Newcastle University, Newcastle-upon-Tyne, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jana Suklan
2NIHR Newcastle In Vitro Diagnostics Co-operative, Translational and Clinical Research Institute, Newcastle University, Newcastle-upon-Tyne, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kile Green
2NIHR Newcastle In Vitro Diagnostics Co-operative, Translational and Clinical Research Institute, Newcastle University, Newcastle-upon-Tyne, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sara Graziadio
1NIHR Newcastle In Vitro Diagnostics Co-operative, Newcastle-upon-Tyne Hospitals Foundation Trust, Newcastle-upon-Tyne, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Peter Buckle
3Department of Surgery and Cancer, Faculty of Medicine, Imperial College London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Paul M. Dark
4Division of Infection, Immunity & Respiratory Medicine, University of Manchester, UK
5Humanitarian Conflict Response Institute, School of Arts, Languages and Cultures, University of Manchester, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Adam L. Gordon
6Division of Medical Sciences and Graduate Entry Medicine, University of Nottingham, UK
7NIHR Applied Research Collaboration East Midlands (ARC-EM), Nottingham, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Daniel S. Lasserson
8NIHR Community Healthcare MedTech and In Vitro Diagnostics Cooperative, Oxford Health NHS Foundation Trust, Oxford, UK
9Division of Health Sciences, University of Warwick, Coventry, UK
10Department of Geratology, Oxford University Hospitals NHS Foundation Trust, John Radcliffe Hospital, Oxford, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Brian Nicholson
11Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
D. Ashley Price
1NIHR Newcastle In Vitro Diagnostics Co-operative, Newcastle-upon-Tyne Hospitals Foundation Trust, Newcastle-upon-Tyne, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Charles Reynard
12NIHR Doctoral Research Fellowship Programme, UK
13Division of Cardiovascular Sciences, Faculty of Biology, Medicine and Health, University of Manchester, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mark H. Wilcox
14Healthcare Associated Infections Research Group, NIHR Leeds In Vitro Diagnostics Co-operative, Leeds Teaching Hospitals NHS Trust and University of Leeds, Leeds, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Graham Prestwich
15Yorkshire and Humber Academic Health Science Network, Wakefield, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Valerie Tate
16Patient Public Involvement (PPI) Member, Precision Antimicrobial Prescribing PPI Group, NIHR Community Healthcare MedTech and In Vitro Diagnostics Cooperative, Nuffield Department of Primary Care Health Sciences, University of Oxford
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tristan W. Clark
17School of Clinical and Experimental Sciences, Faculty of Medicine, University of Southampton, Southampton, UK
18Department of Infection, University Hospital Southampton NHS Foundation Trust, Southampton, UK
19NIHR Southampton Biomedical Research Centre, University Hospital Southampton NHS Foundation Trust, Southampton, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Raja V. Reddy
20Department of Respiratory Medicine, Kettering General Hospital NHS Foundation Trust, Kettering, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Richard Body
13Division of Cardiovascular Sciences, Faculty of Biology, Medicine and Health, University of Manchester, UK
21Emergency Department, Manchester Royal Infirmary, Manchester University NHS Foundation Trust, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
A. Joy Allen
2NIHR Newcastle In Vitro Diagnostics Co-operative, Translational and Clinical Research Institute, Newcastle University, Newcastle-upon-Tyne, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Background Point-of-care (POC) tests for COVID-19 could relieve pressure on isolation resource, support infection prevention and control, and help commence more timely and appropriate treatment. We aimed to undertake a systematic review and pooled diagnostic test accuracy study of available individual patient data (IPD) to evaluate the diagnostic accuracy of a commercial POC test (FebriDx) in patients with suspected COVID-19.

Methods A literature search was performed on the 1st of October 2020 to identify studies reporting diagnostic accuracy statistics of the FebriDx POC test versus real time reverse transcriptase polymerase chain reaction (RT-PCR) testing for SARS-CoV-2. Studies were screened for risk of bias. IPD were sought from studies meeting the inclusion and exclusion criteria. Logistic regression was performed to investigate the study effect on the outcome of the RT-PCR test result in order to determine whether it was appropriate to pool results. Diagnostic accuracy statistics were calculated with 95% confidence intervals (CIs).

Results 15 studies were screened, and we included two published studies with 527 hospitalised patients. 523 patients had valid FebriDx results for Myxovirus resistance protein A (MxA), an antiviral host response protein. The FebriDx test produced a pooled sensitivity of 0.920 (95% CI: 0.875-0.950) and specificity of 0.862 (0.819-0.896) compared with RT-PCR, where there was an estimated true COVID-19 prevalence of 0.405 (0.364-0.448) and overall FebriDx test yield was 99.2%. Patients were tested at a median of 4 days [interquartile range: 2:9] after symptom onset. No differences were found in a sub-group analysis of time tested since the onset of symptoms.

Conclusions Based on a large sample of patients from two studies during the first wave of the SARS-CoV-2 pandemic, the FebriDx POC test had reasonable diagnostic accuracy in a hospital setting with high COVID-19 prevalence, out of influenza season. More research is required to determine how FebriDx would perform in other healthcare settings with higher or lower COVID-19 prevalence, different patient populations, or when other respiratory infections are in circulation.

Trial registration This work was based on a pooled analysis of anonymised data from two previous studies; the CoV-19POC study, described by Clark et al. (9), the “Southampton study” [ISRCTN:14966673, date registered: 18/03/2020]; and a study described by Karim et al. (13) the “Kettering study”.

Lay summary Tests to diagnose COVID-19 are crucial to help control the spread of the disease and to guide treatment. Over the last few months, tests have been developed that can detect the SARS-CoV-2 virus which causes COVID-19. These tests use complex machines in pathology laboratories accepting samples from large geographical areas. Sometimes it takes days for test results to come back. So, to reduce the wait for results, new portable tests are being developed. These point-of-care (POC) tests are designed to work close to where patients require assessment and care such as hospital emergency departments, GP surgeries or care homes. For these new POC tests to be useful, they should ideally be as good as standard laboratory tests so patients get their result quickly and can benefit from the best, safest care.

In this study we looked at published research into a new test, FebriDx, which can detect the presence of any viral infection, including infections due to the SARS-CoV-2 virus, as well as bacterial infections which can have similar symptoms. The FebriDx result was compared with that obtained on the same patient’s throat and nose swab and using the standard COVID-19 viral laboratory test. We were able to analyse data from two studies with a total of 523 adult patients who were receiving emergency hospital care with symptoms of COVID-19 during the early stage of the UK pandemic. Almost half of the patients were diagnosed as positive for SARS-CoV-2 virus using standard laboratory COVID-19 viral tests.

Our analysis demonstrated that the FebriDx POC test agreed 94 out of 100 times with the standard laboratory test results when FebriDx diagnosed the patient as free from COVID-19. However, FebriDx agreed only 82 out of 100 times with the standard laboratory test when FebriDx indicated that the patient had a COVID-19 infection. These differences have important implications for how these tests could be used. As there were far fewer FebriDx false results when the results of the FebriDx test were negative (6 out of 100) than when the results of the FebriDx test were positive (18 out of 100), we can have more confidence in a negative test result using FebriDx at the POC than a positive FebriDx result.

Overall, we have shown that the FebriDx POC test performed quite well during the first wave of the COVID-19 pandemic when compared with laboratory tests, especially when the POC test returned a negative test. For the future, this means that the FebriDx POC test might be helpful in making a rapid clinical decision whether to isolate a patient with COVID-19-like symptoms arriving in a busy emergency department. However, our results indicate it would not completely replace the need to conduct a confirmatory laboratory test in certain cases.

There are limitations to our findings. For example, we do not know if FebriDx will work in a similar way with patients in different settings such as in the community or care homes. Similarly, we do not know whether other viral and bacterial infections which cause similar COVID-19 symptoms, and are more common in the autumn and winter months, could influence the FebriDx test accuracy.

Competing Interest Statement

MHW co-led an (unpublished) pilot study of FebriDx in 2019 for which free kits were provided by the manufacturer (Lumos). Charitable funding has been obtained to carry out an (as yet unstarted) follow on study: Clinical utility of FebriDx in determining whether or not patients presenting to a UK Accident and Emergency Department with symptoms of acute respiratory infection require antibiotic treatment (Jon Moulton Foundation (2020) - 151,000 GBP (Co-Led by MHW)). The other authors declare no relevant conflicts of interest.

Clinical Trial

This work was based on a pooled analysis of anonymised data from two previous studies; the CoV-19POC study, described by Clark et al., the 'Southampton study' [ISRCTN:14966673, date registered: 18/03/2020]; and a study described by Karim et al., the 'Kettering study'. This study was conducted at pace as part of the CONDOR national test evaluation programme, and as a result, no protocol was developed, and the study was not registered.

Funding Statement

This study is part of the CONDOR platform which is funded by the UKRI, Asthma UK and the British Lung Foundation. SGU, BCL, KG, JS, SG, DAP and AJA are supported by the National Institute for Health Research (NIHR) Newcastle In Vitro Diagnostics Co-operative. MHW is supported by the NIHR Leeds In Vitro Diagnostics Co-operative. DSL receives funding from the NIHR Community Healthcare MedTech and In Vitro Diagnostics Co-operative at Oxford Health NHS Foundation Trust. The views expressed are those of the author(s) and not necessarily those of the NIHR or the Department of Health and Social Care.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

This work was based on a pooled analysis of anonymised data from two previous studies; the CoV-19POC study, described by Clark et al. (9), the 'Southampton study' [ISRCTN:14966673, date registered: 18/03/2020]; and a study described by Karim et al. (13), the 'Kettering study'. The Southampton study was approved by the South Central - Hampshire A Research Ethics Committee: REC reference 20/SC/0138, on the 16th March 2020. The protocol is available at: https://eprints.soton.ac.uk/439309/1/CoV_19POC_Protocol_v1.1_eprints.pdf. The Kettering study was approved by the Kettering General Hospital Ethics Committee. Informed consent was obtained from all participants and failure to consent was considered an exclusion criterion in both studies.

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

An anonymised minimum dataset containing enough information to reproduce the diagnostic accuracy statistics is available from the corresponding author on reasonable request. The complete anonymised dataset is not currently available as it is still being used by the Southampton study team to produce further publications.

  • List of abbreviations

    AMU
    Acute Medical Unit
    ARI
    Acute respiratory illness
    b
    Regression coefficient (estimate)
    CI
    Chief Investigator
    CI
    Confidence intervals
    COVID-19
    Coronavirus disease 2019
    CRP
    C-reactive protein
    ED
    Emergency Department
    GICU
    General Intensive Care Unit
    HDU
    High Dependency Unit
    IPD
    Individual patient data
    IQR
    Interquartile range
    LFD
    Lateral flow device
    MxA
    Myxovirus resistance protein A
    NLR
    Negative likelihood ratio
    NPV
    Negative predictive value
    p
    P value
    PHE
    Public Health England
    PLR
    Positive likelihood ration
    POC
    Point-of-care
    PPV
    Positive predictive value
    RT-PCR
    Reverse transcriptase polymerase chain reaction
    RdRp
    RNA-dependent RNA polymerase
    RoB
    Risk of bias
    SOB
    Shortness of breath
    UK
    United Kingdom
  • Copyright 
    The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-ND 4.0 International license.
    Back to top
    PreviousNext
    Posted October 20, 2020.
    Download PDF

    Supplementary Material

    Data/Code
    Email

    Thank you for your interest in spreading the word about medRxiv.

    NOTE: Your email address is requested solely to identify you as the sender of this article.

    Enter multiple addresses on separate lines or separate them with commas.
    FebriDx point-of-care test in patients with suspected COVID-19: a pooled diagnostic accuracy study
    (Your Name) has forwarded a page to you from medRxiv
    (Your Name) thought you would like to see this page from the medRxiv website.
    CAPTCHA
    This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
    Share
    FebriDx point-of-care test in patients with suspected COVID-19: a pooled diagnostic accuracy study
    Samuel G. Urwin, B. Clare Lendrem, Jana Suklan, Kile Green, Sara Graziadio, Peter Buckle, Paul M. Dark, Adam L. Gordon, Daniel S. Lasserson, Brian Nicholson, D. Ashley Price, Charles Reynard, Mark H. Wilcox, Graham Prestwich, Valerie Tate, Tristan W. Clark, Raja V. Reddy, Richard Body, A. Joy Allen
    medRxiv 2020.10.15.20213108; doi: https://doi.org/10.1101/2020.10.15.20213108
    Digg logo Reddit logo Twitter logo Facebook logo Google logo LinkedIn logo Mendeley logo
    Citation Tools
    FebriDx point-of-care test in patients with suspected COVID-19: a pooled diagnostic accuracy study
    Samuel G. Urwin, B. Clare Lendrem, Jana Suklan, Kile Green, Sara Graziadio, Peter Buckle, Paul M. Dark, Adam L. Gordon, Daniel S. Lasserson, Brian Nicholson, D. Ashley Price, Charles Reynard, Mark H. Wilcox, Graham Prestwich, Valerie Tate, Tristan W. Clark, Raja V. Reddy, Richard Body, A. Joy Allen
    medRxiv 2020.10.15.20213108; doi: https://doi.org/10.1101/2020.10.15.20213108

    Citation Manager Formats

    • BibTeX
    • Bookends
    • EasyBib
    • EndNote (tagged)
    • EndNote 8 (xml)
    • Medlars
    • Mendeley
    • Papers
    • RefWorks Tagged
    • Ref Manager
    • RIS
    • Zotero
    • Tweet Widget
    • Facebook Like
    • Google Plus One

    Subject Area

    • Infectious Diseases (except HIV/AIDS)
    Subject Areas
    All Articles
    • Addiction Medicine (162)
    • Allergy and Immunology (416)
    • Anesthesia (91)
    • Cardiovascular Medicine (863)
    • Dentistry and Oral Medicine (159)
    • Dermatology (98)
    • Emergency Medicine (251)
    • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (394)
    • Epidemiology (8571)
    • Forensic Medicine (4)
    • Gastroenterology (388)
    • Genetic and Genomic Medicine (1759)
    • Geriatric Medicine (167)
    • Health Economics (373)
    • Health Informatics (1249)
    • Health Policy (622)
    • Health Systems and Quality Improvement (468)
    • Hematology (196)
    • HIV/AIDS (378)
    • Infectious Diseases (except HIV/AIDS) (10318)
    • Intensive Care and Critical Care Medicine (553)
    • Medical Education (192)
    • Medical Ethics (51)
    • Nephrology (213)
    • Neurology (1682)
    • Nursing (97)
    • Nutrition (252)
    • Obstetrics and Gynecology (328)
    • Occupational and Environmental Health (451)
    • Oncology (930)
    • Ophthalmology (264)
    • Orthopedics (102)
    • Otolaryngology (172)
    • Pain Medicine (114)
    • Palliative Medicine (40)
    • Pathology (253)
    • Pediatrics (538)
    • Pharmacology and Therapeutics (254)
    • Primary Care Research (209)
    • Psychiatry and Clinical Psychology (1775)
    • Public and Global Health (3853)
    • Radiology and Imaging (626)
    • Rehabilitation Medicine and Physical Therapy (320)
    • Respiratory Medicine (521)
    • Rheumatology (208)
    • Sexual and Reproductive Health (168)
    • Sports Medicine (158)
    • Surgery (191)
    • Toxicology (36)
    • Transplantation (101)
    • Urology (76)