Laboratory verification of new commercial lateral flow assays for Cryptococcal antigen (CrAg) detection against the predicate IMMY CrAg LFA in a reference laboratory in South Africa

Background Reflex Cryptococcal antigen (CrAg) testing in HIV-positive patients is done routinely at 47 laboratories in South Africa on samples with a confirmed CD4 count <100 cells/{micro}l, using the IMMY Lateral Flow Assay (LFA) as the standardized predicate method. Objective This study aimed to verify the diagnostic performance of newer CrAg LFA assays against the predicate method. Methods Remnant CD4 samples collected between February and June 2019, with confirmed predicate LFA CrAg results, were retested on settled plasma with the (i) IMMY CrAg semi-quantitative (SQ) LFA; (ii) Bio-Rad RDT CryptoPS SQ; and (iii) Dynamiker CrAg SQ assays, within 24 hours of predicate testing. Sensitivity/ specificity analyses were conducted comparing predicate versus the newer assays, with McNemars tests p-values reported for comparative results (p values <0.05 significant). Positivity grading was noted for the IMMY SQ and Bio-Rad assays. Results Of the 254 samples tested, 228 had comparative CrAg results across all assays. The predicate method reported 85 CrAg positive (37.2%), compared to between 35.08 and 37.28% for the Bio-Rad, IMMY SQ and Dynamiker assays. The IMMY CrAg SQ grading (+1 to +5) showed 67% of CrAg positive results had a grading >=3, indicative of higher CrAg concentration (infection severity). False-negative results across all assays were <2%, with sensitivity >95% for all. False-positive results were highest for the Dynamiker LFA (14%) with a specificity of 77% (p=0.001). IMMY SQ and Bio-Rad assays specificities exceeded 90% (p=0.6 and 0.12). Internal quality control showed 100% accuracy for all assays. Conclusion Performance verification of newer CrAg LFA assays under typical laboratory conditions varied, with best results by IMMY SQ and Bio-Rad. The high burden of HIV and cryptococcal disease in South Africa requires high specificity and -sensitivity (>90%) to prevent unnecessary treatment/hospitalization. The added value of positivity grading for patient management needs confirmation.

. CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.

(which was not certified by peer review)
The copyright holder for this preprint this version posted March 4, 2022. ; 4 78 This study set out to verify the diagnostic performance of the newer CrAg LFA assays 79 against the predicate method (IMMY LFA)  Sample and diluent are dispensed into the well and test lines (T1 and T2) will form . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review)  Reagents for 300 tests were provided from local service providers for IMMY and 143 Dynamiker (only 280 tests available from Bio-Rad). Before comparative testing 144 commenced, four tests per assay were reserved for training and ten tests for possible 145 duplicate/repeat testing. Daily quality-control tests at two levels (negative and positive) 146 were done per assay/testing day (n=32 tests/assay in total) (Fig 1).
147 Figure 1: Summary of verification samples tested: Patient samples tested across three 148 new CrAg LFA assays, including quality control (QC), duplicate testing and rejections, using 149 the available tests provided by suppliers. (Authors own work). 150 . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.

(which was not certified by peer review)
The copyright holder for this preprint this version posted March 4, 2022.

225
. CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.

(which was not certified by peer review)
The copyright holder for this preprint this version posted March 4, 2022. ; https://doi.org/10.1101/2022.03.02.22271757 doi: medRxiv preprint    Of the newer commercial CrAg assays, IMMY SQ faired best, with sensitivity and 257 specificity exceeding 95%, while Bio-Rad results were also acceptable with sensitivity 258 and specificity greater than 90%. Similar acceptable outcomes have been reported 259 for the IMMY SQ assay by Tenforde et al. and Temfack et al [43,44]. 260 The lower sensitivity of between 78-88% and specificity of more than 90% All findings of our study were shared with the local service provider and subsequently, 292 a refined version of the assay was provided for testing. Unfortunately, the issue of faint 293 false-positive results persisted (data not shown) 294 Our study showed that the performance of the IMMY SQ and Bio-Rad assays were 295 comparable to IMMY LFA results with both sensitivity and specificity greater than 90% 296 These results confirm earlier reported verification results with this CrAg assay [43,44,297 46], where there was a good correlation with LFA titer results, where the grading from 298 1+ to 5+ showed correlation with titers [43,44,46]. This was further confirmed in a 299 study on cerebrospinal fluid (CSF), where increasing IMMY SQ grades were 300 associated with greater LFA titer and quantitative culture results/colony forming units . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The local verification of performance of newer commercial CrAg assays is necessary 339 to confirm accurate result reporting as there is inevitable variability between assays. 340 Additional information provided by some assays like the Bio-Rad and IMMY SQ i.e. 341 the intensity of antigen detected should be further investigated to assess its value to 342 clinicians in deciding on whether a lumbar puncture is needed or a CNS infiltration is 343 suspected. The relevance of this added information may, however, depend on the 344 local treatment guidelines i.e. in South Africa all CrAg positive patients will get a lumber 345 puncture currently [15,52] and cost-effectiveness of graded assays, especially in large 346 national CrAg screening programs.

347
. CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted March 4, 2022. ;https://doi.org/10.1101https://doi.org/10. /2022