Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Evaluation of diagnostic performance of non-invasive HIV self-testing kit using oral fluid in Addis Ababa, Ethiopia: A facility-based cross-sectional study

  • Wudinesh Belete,

    Roles Conceptualization, Data curation, Investigation, Methodology, Writing – review & editing

    Affiliation Ethiopian Public health institute, Addis Ababa, Ethiopia

  • Tekalign Deressa ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Supervision, Validation, Writing – original draft, Writing – review & editing

    tekalign09@gmail.com

    Affiliation Ethiopian Public health institute, Addis Ababa, Ethiopia

  • Altaye Feleke,

    Roles Data curation, Formal analysis, Investigation, Methodology, Supervision, Validation, Writing – review & editing

    Affiliation Ethiopian Public health institute, Addis Ababa, Ethiopia

  • Takele Menna,

    Roles Data curation, Investigation, Methodology, Supervision, Validation, Writing – review & editing

    Affiliation Ethiopian Public health institute, Addis Ababa, Ethiopia

  • Tezera Moshago,

    Roles Data curation, Formal analysis, Investigation, Methodology, Supervision, Validation, Writing – review & editing

    Affiliation Ethiopian Public health institute, Addis Ababa, Ethiopia

  • Saro Abdella,

    Roles Data curation, Formal analysis, Investigation, Methodology, Supervision, Validation, Writing – review & editing

    Affiliation Ethiopian Public health institute, Addis Ababa, Ethiopia

  • Abebe Hebtesilassie,

    Roles Data curation, Formal analysis, Investigation, Methodology, Supervision, Validation, Writing – review & editing

    Affiliation Ethiopian Public health institute, Addis Ababa, Ethiopia

  • Yimam Getaneh,

    Roles Conceptualization, Data curation, Investigation, Methodology, Resources, Supervision, Validation, Writing – review & editing

    Affiliation Ethiopian Public health institute, Addis Ababa, Ethiopia

  • Minilik Demissie,

    Roles Data curation, Formal analysis, Investigation, Methodology, Writing – review & editing

    Affiliation Ethiopian Public health institute, Addis Ababa, Ethiopia

  • Yonas Zula,

    Roles Conceptualization, Investigation, Resources, Supervision, Validation, Writing – review & editing

    Affiliation Population service International/E, Addis Ababa, Ethiopia

  • Israel Lemma,

    Roles Data curation, Investigation, Methodology, Resources, Supervision, Validation, Writing – review & editing

    Affiliation Population service International/E, Addis Ababa, Ethiopia

  • Girmachew Mamo,

    Roles Conceptualization, Investigation, Methodology, Resources, Writing – review & editing

    Affiliation Population service International/E, Addis Ababa, Ethiopia

  • Endale Workalemahu,

    Roles Conceptualization, Data curation, Investigation, Methodology, Resources, Supervision, Writing – review & editing

    Affiliation Population service International/E, Addis Ababa, Ethiopia

  • Tsigereda Kifle,

    Roles Conceptualization, Data curation, Investigation, Methodology, Resources, Supervision, Writing – review & editing

    Affiliation Ethiopian Public health institute, Addis Ababa, Ethiopia

  • Ebba Abate

    Roles Conceptualization, Data curation, Investigation, Methodology, Resources, Supervision, Writing – review & editing

    Affiliation Ethiopian Public health institute, Addis Ababa, Ethiopia

Abstract

Background

Human immunodeficiency virus (HIV) testing is critical for early linkage to treatment and care services. However, there is a substantial gap in HIV testing, particularly in resource limited settings due to low accessibility of HIV testing sites, inconvenient testing hours, and concerns about loss of confidentiality. Thus, adopting new strategies such as HIV self-testing (HIVST) could overcome these barriers and increases HIV testing uptake.

Objective

The aim of this study was to evaluate the diagnostic performance of non-invasive HIVST kit using oral fluid for HIV diagnosis. This study also aimed to assess the ability of clients in interpretation of OraQuick HIVST results.

Method

Between December 2017 and February 2018, a total of 400 study participants were enrolled into the study to assess a diagnostic accuracy of Oral fluid-based HIVST kit (OraQuick) in 15 public health facilities in Addis Ababa, Ethiopia. Participants were provided with instructions and visual aids on how to perform HIVST and interpret results. They also underwent a blood-based rapid HIV antibody test as per the current national algorithm. The results of HIVST were interpreted independently by the participants and respective health care workers (HCWs). The sensitivity, specificity, positive predictive value (PPV), Negative predictive value (NPV) and inter-rater agreement of the test were computed.

Results

Out of 200 participants who tested positive on the national algorithm testing, oral fluid-based self-testing was positive in 199 (99.5%), false negative in 1 (0.5%). Of 200 participants who tested negative on the national algorithm testing, self-testing was negative in 200 (100%). There were no false positive and invalid tests. The sensitivity and specificity of the OraQuick HIVST were 99.5% (95%CI: 97.26–99.99) and 100% (95%CI: 98.18–100.0), respectively. The overall agreement between the two tests was high (κ value = 0.995). The PPV and NPV of OraQuick test were 100% and 99.5% (95%CI: 96.59–99.93) respectively.

Conclusion

This study showed a high diagnostic performance of OraQuick HIV self-test and suggests that OraQuick HIVST kit has a potential to be used for HIV testing in Ethiopia along with the national algorithm.

Background

Despite the significant progress towards curbing the epidemic, HIV continues to be a public health threat. Since its recognition, HIV has claimed over 34 million lives worldwide and about 36.7 million people were living with HIV by the end of 2017. The burden of HIV is particularly high in Sub- Saharan Africa where about 76% of the world HIV/AIDS infections and deaths occur [1].

The current global strategy for high impact HIV prevention emphasizes the importance of enhanced HIV-testing services (HTS) targeting high-risk persons as a key measure for program evaluation [2, 3]. HIV testing is critical for early linkage to treatment and care services, partner prevention services, and focused behavioral interventions [2, 4]. However, coverage of HIV testing remains low, and a significant number of people with HIV are still unaware of their status [57]. In resource limited settings, factors like low accessibility of HIV testing sites, inconvenience of testing hours, concerns about loss of confidentiality, and lack of confidence in the competence of health personnel have been associated with the low HIV testing uptake [8, 9]. One approach to overcome such barriers to HIV testing is an introduction of HIVST strategy [10, 11]. HIVST allows individuals to learn their HIV status earlier before they become sick, bring services closer to where they live, and create demand for HIV testing [12]. This strategy is particularly important for those people facing barriers to accessing existing services [1315].

Currently, Ethiopia is planning to introduce HIVST as a complementary approach to the existing facility based HTS, with the aim of reaching previously untested, hard-to-reach and test-averse populations. Prior research revealed that HIVST was widely accepted among users in various settings and increased the frequency of HIV testing, particularly in key population [1417]. For example, in a community-based study in Malawi, 92% of participants opted for supervised self-testing over standard HTC [17]. Similarly, another study conducted in Kenya found that HIVST had increased HIV testing among male partners when compared with standard testing [16].

Previous studies conducted to validate the performance of the OraQuick Rapid HIV-1/2 test found a comparable accuracy of HIVST with the conventional blood-based HIV rapid tests [1820]. However, to date, there is no empirical evidence on the performance of HIVST in Ethiopia to support the implementation of this strategy. The World Health Organization (WHO) recommends evaluating the diagnostic performance of each kit to determine its accuracy and suitability in the context of a given country setting before use [21]. To this end, we assessed the sensitivity, specificity, PPV and NPV of oral fluid-based OraQuick kit (OraSure Technologies Inc, PA, USA) for HIV diagnosis at selected health facilities in Addis Ababa, Ethiopia. Further, we assessed the ability of clients in interpretation of OraQuick HIVST results.

Material and methods

Assay kit

OraQuick HIV-1/2 kit is one of the innovative self-test kits recommended by the WHO. It is a visually read, qualitative immunochromatographic test for the detection of antibodies to HIV-1/2. It is an easy to use kit that has a potential to be used for surveillance purposes, in antenatal care clinics, and in hard-to-reach areas [22]. Moreover, this technology can also reduce the risk of accidental exposure to HIV through contaminated blood and reduce the need for disposal of biohazardous waste.

Study design and setting

This facility based cross-sectional study was conducted at 15 public health facilities in Addis Ababa. Data were collected between December 2017 and February 2018. Health facilities for the OraQuick HIVST kit diagnostic performance evaluation were chosen purposively in advance based on their high HIV positive yields and logistic considerations.

Study population and participants recruitments

This study targeted community members who visited the health facilities for voluntary counseling and testing (VCT) or provider-initiated HIV counseling and testing (PICT), and prevention of mother-to-child transmission of HIV (PMTCT) clinics during the study period. Study participants who fulfilled the following eligibility criteria were selected: age over 18 years, and clients who know their HIV positive serostatus if they did not initiate ART. However, clients were excluded from participation if they had bleeding gum, and/or critically ill.

A sample size for this study was determined based on a guideline for evaluation of HIV testing technologies in Africa [21]. According to this guideline, a minimum of 200 HIV-positive and 200 HIV-negative specimens are required to provide 95% confidence intervals (CI) of less than ± 2% for the estimated sensitivity (99%) and specificity (98%). Therefore, this study was conducted among 400 consecutive study participants from fifteen high HIV positive yield public health facilities in Addis Ababa. Ethical clearance for this study was obtained from the Scientific and Ethical Research Office (SERO) of the Ethiopian Public Health Institute (IRB Ref. No: EPHI-IRB-056-2017). All study participants gave a written informed consent prior to data collection. The interviews with study participants were conducted with strict privacy and confidentiality.

Data collection tool

Structured questionnaire was used to collect information on socio-demographic and clinical risk factors. Variables were chosen for inclusion based on their clinical relevance with the outcome variable being HIV serostatus and independent variables included age, sex, marital status, residence, occupation, history of alcohol consumption, risk behaviors to HIV and other sexually transmitted infections.

Study procedure

As per the national guideline for HIV testing, pre-test counseling was provided to each study participant who consented to be enrolled to this study. Following the counseling, participants’ sociodemographic and other relevant information were collected by a trained health care provider through one-to-one interview using structured questionnaire. Then, the counsellors explained the OraQuick HIVST procedure to each participant and demonstrated how to conduct the test and interpret the results as per the manufacturer’s instructions. Further, the participants were provided with visual model illustrating test performance and results interpretations (as positive, negative and an invalid). Following the demonstration, each participant performed HIVST using oral swab under supervision of health professionals. Further, participants received a blood-based rapid diagnostic test (RDT) per the national algorithm for HIV testing (Wantai, Uni-Gold and Vikia) “Fig 1”. The HIVST results were interpreted by participants first in a private setting and by health professionals independently at the recommended time-points (20–40 minutes). OraQuick test results were recorded as reactive (R) or non-reactive (N) or Invalid (I) as interpreted either by the client or respective health professional. The result by RDTs per the national algorithm was considered as a final and disclosed to the participants. As part of the routine procedure, all clients who were found to be HIV positive per the national algorithm were linked to HIV care and treatment services.

Data quality control

Prior to data collection, training on the study procedure was provided to data collectors (two from each health facility) at Ethiopian public health institute. Further, close follow-up and supportive supervision were given throughout the study period. Dried blood spot (DBS) samples were also collected for external quality assessment (EQA) of the OraQuick HIVST kit performance. During the supervision, the supervision team reviewed documentations, adherence to the protocol, and discarded incomplete questionnaires & data with incorrect DBS samples from the study.

Data analysis

Data was entered, cleaned and analyzed using Epi Info.7 (CDC, Atlanta, GA 30329–4027 USA). Descriptive statistics including percentages, median, and ranges were applied as appropriate. Estimates of sensitivity, specificity, PPV, and NPV with 95% CI for each index test and read condition was computed by comparing results of the OraQuick kits against the reference diagnostic algorithm. Further, analysis of the agreement between OraQuick kit and the reference was conducted by computing a Kappa statistic [23]. P-values <0.05 were considered statistically significant.

Results

From December 2017 to February 2018, a total of 400 participants were enrolled to the study to evaluate the diagnostic performance of OraQuick HIVST kit. Demographic characteristics of the participants are presented in Table 1. About 60.8% (243/400) of the study participants were female, and the median age was 29 years (IQR: 17.7–40.3). Overall, 54.8% of participants had attended secondary school and above, and 12.3% had no formal education.

thumbnail
Table 1. Demographic characteristics of the study participants.

https://doi.org/10.1371/journal.pone.0210866.t001

Sensitivity and specificity of OraQuick HIVST kit

All of the study participants underwent both oral fluid-based OraQuick self-testing and conventional blood-based HIV antibody rapid tests as per the national algorithm “Fig 1”. Out of 200 participants who tested positive on the national algorithm testing, oral fluid-based self-testing was positive in 199 (99.5%), false negative in 1 (0.5%). Of 200 participants who tested negative on the national algorithm testing, self-testing was negative in 200 (100%) and positive in 0 (0.0%). There were no invalid tests, but two tests were rejected due to errors (spilling test buffer) in performing the test and were not include into the analysis. The sensitivity and specificity of the OraQuick test were 99.5% (95%CI: 97.26–99.99) and 100.0% (95%CI: 98.18–100.00), respectively when compared to the national algorithm. The overall agreement between the two tests was high (κ value = 0.995). The PPV and NPV of OraQuick test were 100% and 99.5% (95%CI: 96.59–99.93) respectively (Table 2).

thumbnail
Table 2. Sensitivity and specificity of OraQuick HIVST kit.

https://doi.org/10.1371/journal.pone.0210866.t002

This study also explored the ability of the study participants to interpret the OraQuick HIVST results. All of the study participants correctly interpreted negative results in this study. However, one participant misinterpreted a positive result as a negative (Table 3).

thumbnail
Table 3. Patterns of OraQuick self-test interpretation by participants and health care workers (HCWs).

https://doi.org/10.1371/journal.pone.0210866.t003

Discussion

The finding of this study demonstrates high sensitivity and specificity of oral fluid-based OraQuick HIV-1/2 antibody test. It also showed a high rate of agreement between OraQuick test and the national HIV testing algorithm (κ = 0.995). The error rate identified in this study was negligible (0.25%); only a single disagreement was noted between OraQuick HIVST and the national algorithm testing out of 400 HIV tests.

The high sensitivity and specificity of OraQuick HIVST in our study setting was in agreement with the findings of other studies reported from sub-Saharan Africa, and different parts of the world [1820, 24]. For example, the study conducted in Zambia using OraQuick kit showed a sensitivity of 98.7% (95%CI, 97.5–99.4) and specificity of 99.8% (95%CI, 99.6–99.9) [24]. A similar study conducted in Singapore reported a sensitivity of 97.4% (95% CI: 95.1–99.7) and specificity of 99.9%, (95% CI: 99.6–100) [25]. Therefore, the findings of this study confirm and further expand the excellent diagnostic performance of OraQuick HIVST kit.

In this study, we found one false negative case by OraQuick test. Evidence from post-test counseling showed that this client had multiple histories of treatment for sexually transmitted infections. Thus, the observed false negative test could be due to some interference of the preexisting condition(s) with the OraQuick test. In fact, this finding was in line with the limitation reported by the manufacturer stating that OraQuick often gives inaccurate results in ART patients, pregnant women, and those with some infections like viral hepatitis [26]. When compared with other studies, the observed error rate (0.25%) in this study was lower than 0.4% reported from Malawi [17] and 3.2% from Singapore [25].

Beyond evaluating the diagnostic accuracy of OraQuick HIVST kit, this study also sought to assess the participants’ ability to interpret test results as compared to healthcare workers. Our results showed that 399/400 participants accurately interpreted the test results. Only one client, who knew his HIV positive status, misinterpreted positive result as a negative. Moreover, during the supervision of OraQuick evaluation, we noticed a high level of users’ supports for the HIVST approach. Nevertheless, issues related to the feasibility and acceptability of OraQuick kit remains the subject of further investigation. Overall, these findings suggest that OraQuick HIVST kit has a potential to be used in parallel with the conventional HTS in Ethiopia owing to its higher diagnostic accuracy; and simplicity in conducting the test and interpreting test results by non-clinical users. This HIV testing approach might avoid the barrier to the conventional blood-based HTS and increase HIV testing uptake.

Limitations

This validation study was conducted in an urban setting, in Addis Ababa. This may limit the generalizability of the results to the wider rural population, especially in terms of conducting HIVST and result interpretation due to variation in education status between the two settings. Further, this study was conducted under the supervision of HCWs which might help the beneficiaries to get additional information in conducting HIVST and result interpretation. This could introduce a possibility for overestimation of the sensitivity and specificity of the self-testing kit as well as the clients’ accuracy rates in results interpretation. In line with this, a previous study conducted in a private setting found a lower accuracy of OraQuick test and high rates of misinterpretation [27]. In this study, we used the national HIV testing algorithm as a standard. Therefore, the sensitivity and specificity of OraQuick HIV test noted in this study were dependent on the accuracy of the standard used. Furthermore, we also included a significant number (5%) of known HIV-positive cases, and it is likely that prior knowledge of their status might have affected the way they interpreted the OraQuicktest result and could contribute to an overestimation of interpretation accuracy.

Conclusion and recommendation

This study found a high diagnostic performance of OraQuick HIVST kit in our setting. Moreover, the study participants showed no notable problem in conducting the OraQuick HIVST and interpretation of the results. Therefore, although more data on feasibility, acceptability, and extents of linkage to service following HIVST is needed, our finding shows that OraQuick HIVST kit has a potential to be used as a complementary approach for HIV testing in Ethiopia.

Supporting information

S1 File. Questionnaire for OraQuick performance evaluation.

https://doi.org/10.1371/journal.pone.0210866.s001

(PDF)

Acknowledgments

The authors are very grateful to the Ethiopian Public Health Institute (EPHI), Federal Ministry of Health, and PSI-Ethiopia for providing technical and logistic support for this study. Our thanks also go to all the study participants, participant public health facilities in Addis Ababa and the respective health professional for their unreserved cooperation during this performance evaluation.

References

  1. 1. WHO. HIV/AIDS Factsheet. Available from: http://www.who.int/mediacentre/factsheets/ fs360/en/. Accessed March, 2018.
  2. 2. UNAIDS 90-90-90:An ambitious treatment target to help end the AIDS epidemic. Available at: http://www.unaids.org/en/resources/documents/2017/90-90-90. Accessed December 2017.
  3. 3. World Health Organization. Consolidated Guidelines on HIV Testing Services. Available at: http://www.who.int/hiv/pub/guidelines/hiv-testing-services/en/. Accessed December 2017
  4. 4. Branson BM, Viall A, Marum E. Expanding HIV testing: back to the future. J Acquir Immune Defic Syndr. 2013;63(Suppl 2):S117–21.
  5. 5. Global AIDS Update. Geneva: Joint United Nations Programme on HIV/AIDS; 2016. Available from: http://www.unaids.org/sites/default/files/media_asset/global-AIDS-update-2016_en.pdf. accessed 12 October 2017.
  6. 6. World health organization: Guidelines on HIV self-testing and partner notification. Available from: www.who.int/hiv/pub/vct/hiv-self-testing-guidelines/en/. Accessed October 10, 2017.
  7. 7. Ethiopia-Country/Regional Operational Plan (COP/ROP) 2016: Strategic Direction Summary.
  8. 8. Morin SF, Khumalo-Sakutukwa G, Charlebois ED, Routh J, Fritz K, Lane T et al. Removing barriers to knowing HIV status same-day mobile HIV testing in Zimbabwe. JAIDS, 2006; 41:218–224. pmid:16394855
  9. 9. Meiberg AE, Bos AER, Onya HE, Schaalma HP. Fear of stigmatization as barrier to voluntary HIV Counselling and Testing in South Africa. East African J Public Health, 2008; 5 (2): 49–54.
  10. 10. Consolidated guidelines on the use of antiretroviral therapy: a public health approach. Geneva: World Health Organization; 2016 (http://www.who.int/hiv/pub/arv/arv-2016/en/, accessed 12 October 2017).
  11. 11. Green K, Thu H. In the hands of the community: accelerating key population-led HIV lay and self-testing in Viet Nam. Presented at: 21st International AIDS Conference; 18–22 July; Durban, South Africa; 2016.
  12. 12. Global AIDS Update. Geneva: Joint United Nations Programme on HIV/AIDS; 2016 (http://www.unaids.org/sites/default/files/media_asset/global-AIDS-update-2016_en.pdf. accessed 12 October 2017).
  13. 13. Hensen B, Taoka S, Lewis J, Weiss H, Hargreaves J. Systematic review of strategies to increase men’s HIV testing in sub-Saharan Africa. AIDS. 2014; 28:2133–45. pmid:25062091
  14. 14. Jamil M, Prestage G, Fairley C, Grulich A, Smith K, Chen M, et al. Access to HIV self-testing doubles the frequency of HIV testing among gay and bisexual men at higher risk of infection: a randomised controlled trial. Presented at: 21st International AIDS Conference;18–22 July; Durban, South Africa;2016.
  15. 15. Katz D, Golden M, Hughes J, Farquhar C, Stekler J. HIV self-testing increases HIV testing frequency among high-risk men who have sex with men: a randomized controlled trial. Presented at: 8th International AIDS Society Conference; 19–22 July 2015; Vancouver, Canada; 2015.
  16. 16. Gichangi A, Wambua J, Gohole A, Mutwiwa S, Njogu R, Bazant E, et al. Provision of oral HIV self-test kits triples uptake of HIV testing among male partners of antenatal care clients: results of a randomized trial in Kenya. Presented at:21st International AIDS Conference;18–22 July;Durban, South Africa;2016.
  17. 17. Choko AT, Desmond N, Webb EL, et al. The uptake and accuracy of oral kits for HIV self-testing in high HIV prevalence setting: a cross-sectional feasibility study in Blantyre, Malawi. PLoS Medicine 2011; 8(10).
  18. 18. Pant Pai N, Joshi R, Dogra S, et al. Evaluation of diagnostic accuracy, feasibility and client preference for rapid oral fluid-based diagnosis of HIV infection in rural India. PLoS ONE 2007;2:e367. pmid:17426815
  19. 19. Hamers RL, de Beer IH, Kaura H, van Vugt M, Caparos L, Rinke de Wit TF. Diagnostic accuracy of 2 oral fluid-based tests for HIV surveillance in Namibia. J. Acquir Immune Defic Syndr 2008;48:116–118. pmid:18438181
  20. 20. Sophie J., Pascoe S, Langhaug LF, Mudzori J, Burke E, Hayes R, Cowan FM. Field Evaluation of Diagnostic Accuracy of an Oral Fluid Rapid Test for HIV, Tested at Point-of-Service Sites in Rural Zimbabwe. AIDS PATIENT CARE and STDs, 2009; 23:7.
  21. 21. CDC/WHO/APHL: Guidelines for appropriate evaluations of HIV testing technologies in Africa. Available from: https://afro.who.int/…/rpa%20HIV%20Test%20Evaluation%20Guidelines%20(1).pdf
  22. 22. Pant Pai N. Oral fluid-based rapid HIV testing: Issues, challenges and research directions. Expert Rev Mol Diagn. Jul 2007; 7: 325–328. pmid:17620039
  23. 23. Stemler SE. A Comparison of Consensus, Consistency, and Measurement Approaches to Estimating Interrater Reliability. Practical Research, Assessment and Evaluation. 2004 Available at http://pareonline.net/getvn.asp?v=9&n=4. Accessed July 20, 2012.
  24. 24. Zachary D, Mwenge L, Muyoyeta M, Shanaube K, Schaap A, Bond V, Kosloff B, de Haas P, Ayles H. Field comparison of OraQuick ADVANCE Rapid HIV-1/2 antibody test and two blood-based rapid HIV antibody tests in Zambia. BMC infect dis. 2012; 12(1):183.
  25. 25. Ng OT, Chow AL, Lee VJ, Chen MIC, Win MK, et al. Accuracy and User-Acceptability of HIV Self-Testing Using an Oral Fluid-Based HIV Rapid Test. PLoS ONE, 2012; 7(9): e45168. pmid:23028822
  26. 26. WHO Prequalification of In Vitro Diagnostics: OraQuick HIV Self-Test, public report. WHO reference number: PQDx 0159-055-01.
  27. 27. Walensky RP, Paltiel AD. Rapid HIV testing at home: does it solve a problem or create one? Annals of Internal Medicine, 2006; 145: 459–462. pmid:16983134