PT - JOURNAL ARTICLE AU - Kumar, Andre AU - Weng, Yingjie AU - Graglia, Sally AU - Chung, Sukyung AU - Duanmu, Youyou AU - Lalani, Farhan AU - Gandhi, Kavita AU - Lobo, Viveta AU - Jensen, Trevor AU - Nahn, Jeffrey AU - Kugler, John TI - Interobserver Agreement of Lung Ultrasound Findings of COVID-19 AID - 10.1101/2020.08.16.20176156 DP - 2020 Jan 01 TA - medRxiv PG - 2020.08.16.20176156 4099 - http://medrxiv.org/content/early/2020/08/18/2020.08.16.20176156.short 4100 - http://medrxiv.org/content/early/2020/08/18/2020.08.16.20176156.full AB - Background Lung ultrasound (LUS) may be used in the diagnostic evaluation of patients with COVID-19. An abnormal LUS is associated with increased risk for ICU admission in COVID-19. Previously described LUS manifestations for COVID-19 include B-lines, consolidations, and pleural thickening. The interrater reliability (IRR) of these findings for COVID-19 is unknown.Research Question What is the interrater reliability of lung ultrasound findings in patients with RT-PCR confirmed COVID-19?Study Design and Methods This study was conducted at conducted at two academic medical centers between 03/2020-06/2020. Nine physicians (hospitalists: n=4; emergency medicine: n=5) independently evaluated n=20 LUS scans (n=180 independent observations) collected from RTPCR confirmed COVID-19 patients. These studies were randomly selected from an image database consisting of COVID-19 patients evaluated in the emergency department with portable ultrasound devices. Physicians were blinded to any patient information or previous LUS interpretation. Kappa values (κ) were used to calculate IRR.Results There was substantial IRR on the following items: normal LUS scan (κ=0.79 [95% CI: 0.72-0.87]), presence of B-lines (κ=0.79 [95% CI: 0.72-0.87]), >=3 B-lines observed (κ=0.72 [95% CI: 0.64-0.79]). Moderate IRR was observed for the presence of any consolidation (κ=0.57 [95% CI: 0.50-0.64]), subpleural consolidation (κ=0.49 [95% CI: 0.42-0.56]), and presence of effusion (κ=0.49 [95% CI: 0.41-0.56]). Fair IRR was observed for pleural thickening (κ=0.23 [95% CI: 0.15-0.30]).Interpretation Many LUS manifestations for COVID-19 appear to have moderate to substantial IRR across providers from multiple specialties utilizing differing portable devices. The most reliable LUS findings with COVID-19 may include the presence/count of B-lines or determining if a scan is normal. Clinical protocols for LUS with COVID-19 may require additional observers for the confirmation of less reliable findings such as consolidations.Clinicaltrials.gov Registration: NCT04384055Disclosures Andre Kumar, MD, MEd is a paid consultant for Vave Health, which manufactures one of the ultrasound devices used in this study. His consultant duties include providing feedback on product development. The other authors do not have any items to disclose.Competing Interest StatementDisclosures: Andre Kumar, MD, MEd is a paid consultant for Vave Health, which manufactures one of the ultrasound devices used in this study. His consultant duties include providing feedback on product development. The other authors do not have any items to disclose.Clinical TrialNCT04384055Funding StatementThis study has not received any funding.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:Stanford University IRB University of California, San Francisco IRBAll necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesData is available on request to the corresponding author.