Implementation, feasibility, and acceptability of 99DOTS-based supervision of treatment for drug-susceptible TB in Uganda

99DOTS is a low-cost digital adherence technology that allows people with tuberculosis (TB) to self-report treatment adherence. There are limited data on its implementation, feasibility, and acceptability from sub-Saharan Africa. We conducted a longitudinal analysis and cross-sectional surveys nested within a stepped-wedge randomized trial at 18 health facilities in Uganda between December 2018 and January 2020. The longitudinal analysis assessed implementation of key components of a 99DOTS-based intervention, including self-reporting of TB medication adherence via toll-free phone calls, automated text message reminders and support actions by health workers monitoring adherence data. Cross-sectional surveys administered to a subset of people with TB and health workers assessed 99DOTS feasibility and acceptability. Composite scores for capability, opportunity, and motivation to use 99DOTS were estimated as mean Likert scale responses. Among 462 people with pulmonary TB enrolled on 99DOTS, median adherence was 58.4% (inter-quartile range [IQR] 38.7-75.6) as confirmed by self-reporting dosing via phone calls and 99.4% (IQR 96.4-100) when also including doses confirmed by health workers. Phone call-confirmed adherence declined over the treatment period and was lower among people with HIV (median 50.6% vs. 63.7%, p<0.001). People with TB received SMS dosing reminders on 90.5% of treatment days. Health worker support actions were documented for 261/409 (63.8%) people with TB who missed >3 consecutive doses. Surveys were completed by 83 people with TB and 22 health workers. Composite scores for capability, opportunity, and motivation were high; among people with TB, composite scores did not differ by gender or HIV status. Barriers to using 99DOTS included technical issues (phone access, charging, and network connection) and concerns regarding disclosure. 99DOTS was feasible to implement and highly acceptable to people with TB and their health workers. National TB Programs should offer 99DOTS as an option for TB treatment supervision.

84 dashboard accessible via a smartphone or desktop computer.(2) 99DOTS has been scaled-up across India despite 85 limited data about its effectiveness in supporting treatment adherence and completion. Studies have also raised 86 implementation concerns (3-5) and there has been considerable debate as to whether DATs improve the 87 experience of TB treatment for both people with TB and health workers. (6)   88 89 Previously, we reported the first randomized trial of 99DOTS-based TB treatment supervision. The trial found 90 that treatment completion did not improve overall but did improve among the 52% of people with TB enrolled 91 on 99DOTS during the intervention period. Here, we report on the implementation of key components of the 92 99DOTS-based intervention, as well as its feasibility and acceptability to people with TB and health workers. 96 During the study period, 463 people with pulmonary TB were enrolled on 99DOTS within the first month of TB 97 treatment across 18 participating health facilities. One person with TB could not be matched to the TB register 98 and was excluded. Of the remaining 462 participants, 296 (64%) were male, median age was 36 (IQR 28-48), 276 99 (60%) had bacteriologically confirmed TB, 422 (91%) had not been previously treated for TB, and 191 (41%) 100 were living with HIV. 101 102 Fidelity 103 Calling TFNs to report dosing. The median proportion of expected doses self-reported as taken by phone calls to 104 99DOTS was 58.4% (IQR 38.7-75.6) and fell from 71.4% (IQR 42.9-88.9, n=456) during the first month of 105 treatment to 46.4% (IQR 21.4-75.0 n=412) during the 6 th month of treatment (chi-squared test for trend: p<0.001, 106 Figure 1). When doses confirmed by health workers were included, the median proportion of expected doses 107 reported as taken was high overall (99.4%, IQR 96.4-100) and during each month of treatment (range: 96.4-100%) 108 (Figure 1). Engagement with 99DOTS (i.e., proportion of expected doses reported as taken by people with TB 109 calling TFNs) was similar among men and women (median 57.1% vs. 61.9%, p=0.37) and by age quartile (S1 . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.

(which was not certified by peer review)
The copyright holder for this preprint this version posted October 11, 2022. ; https://doi.org/10.1101/2022.10.10.22280911 doi: medRxiv preprint 110 Table). However, people living with HIV reported fewer doses by calling TFNs than people living without HIV 111 (median 50.6% vs. 63.7%, p<0.001); people living with HIV also had a greater decline in engagement over the 112 course of treatment (p<0.001) (S1 Table, Table). Among survey participants, 33% had completed 138 education past the equivalent of secondary school in the United States; 90% were employed; and the median 139 household size was 5 persons (Table 1A). Access to a phone was difficult for some, with 14% sharing a phone, . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) Occupation . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.

(which was not certified by peer review)
The copyright holder for this preprint this version posted October 11, 2022. 150 People with TB reported several methods for remembering to take their medication: SMS reminder from 99DOTS 151 (n=45, 54%), setting an alarm (n=25, 30%), family or friends reminding them (n=23, 28%), taking it in the 152 morning or reminding themselves (n=14, 17%), and hearing a radio program or call to prayer (n=6, 7%). The 153 majority (n=47, 57%) said that calling 99DOTS took less than one minute whereas 13 (15.7%) reported calls 154 lasting longer than three minutes. About half of respondents reported that their health worker had shown them the 155 99DOTS adherence dashboard during refill visits (n=41, 49%). 156 157 Health workers from 16 of the 18 participating health facilities were surveyed (N=24). Two were excluded from 158 this analysis because they reported not having access to 99DOTS data via smartphone. The 22 health workers 159 surveyed included 15 nurses, four clinical officers, one counselor, one community health worker, and one data 160 officer (Table 1B). All surveyed health workers had previous experience using a smartphone and nearly all (95%) . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.

(which was not certified by peer review)
The copyright holder for this preprint this version posted October 11, 2022. ; https://doi.org/10.1101/2022.10.10.22280911 doi: medRxiv preprint 161 reported receiving 99DOTS adherence data daily. All surveyed health workers reported using 99DOTS to assess 162 adherence to TB medicines, but also confirmed dosing via pill counts, phone calls, and/or home visits. 163 164 Capability, opportunity, and motivation to use 99DOTS were assessed separately for people with TB and health 165 workers using Likert scale-based survey questions (S3 Table, S4 Table). 166 167 For people with TB, the mean composite score across questions related to capability was 4.39 (95% CI 4.31-168 4.47). All people with TB (n=83) agreed they knew how to use 99DOTS; however, three felt they did not get 169 adequate training, and one other person with TB responded they did not always know which pill to take next 170 (Figure 2). About 10% (n=9) did not know where to find their health workers' contact information. Most people 171 with TB agreed that the SMS reminders were helpful (n=78, 94%). However, it was common for people with TB 172 to sometimes forget to call 99DOTS after taking their TB medicines (n=31, 37%).
. CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.

(which was not certified by peer review)
The copyright holder for this preprint this version posted October 11, 2022. . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.

(which was not certified by peer review)
The copyright holder for this preprint this version posted October 11, 2022. ; https://doi.org/10.1101/2022.10.10.22280911 doi: medRxiv preprint 179 find out they have TB. Almost all participants reported that it was easy to access a phone to make calls and did 180 not think calling 99DOTS took too much time (n=77, 93%). However, many struggled with phone charging 181 (n=39, 47%) and poor network connections (n=40, 48%). All participants reported that 99DOTS helped make 182 them feel more connected to their health worker and would recommend using 99DOTS to others. Most reported 183 that they made fewer trips to the health facility because of 99DOTS (n=73, 88%). 184 185 The mean composite score across questions related to motivation was 4.55 (95%CI 4.48-4.63). All people with 186 TB were optimistic that 99DOTS would help them complete TB treatment and get healthy. They agreed the 187 images and redesigned 99DOTS packaging were helpful reinforcements, and 60 (72%) reported that their health 188 worker contacted them when they forgot to take TB medicines or call 99DOTS. Two people with TB indicated 189 that they did not intend to call 99DOTS after taking TB medicines every day, one of whom indicated concern 190 about the privacy of their health information. This concern was shared by 18 (22%) people with TB. However, 191 almost all people with TB, including the one not intending to call, agreed they looked forward to the motivational 192 audio messages played when they did call 99DOTS (n=81, 98%). 193 194 There were no significant differences in capability, opportunity, or motivation scores by gender or HIV status. 195 There was also no significant relationship between age and capability or motivation score, but opportunity scores 196 were significantly higher among older people with TB (correlation coefficient 0.29, p-value=0.008) (S1 Table, 197 S2 Figure). 198 199 For health workers, the mean composite score across questions related to capability was 4.82 (95% CI 4.69-4.94). 200 Health workers had high scores across all capability-related questions, with only two negative responses across 201 all 22 health workers and 8 questions (Figure 3). With respect to opportunity, health worker responses were even 202 more positive than responses of people with TB with a mean composite score across questions of 4.57 (95%CI 203 4.44-4.71). Only two health workers responded negatively regarding coworker opinions of 99DOTS, and one did 204 not agree that 99DOTS reduced workload. Health workers also had strong agreement across all but one question . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.

(which was not certified by peer review)
The copyright holder for this preprint this version posted October 11, 2022. ; https://doi.org/10.1101/2022.10.10.22280911 doi: medRxiv preprint 205 related to motivation with a mean composite score across questions of 4.81 (95%CI 4.68-4.92). Two health 206 workers did not agree that 99DOTS accurately reflected whether people with TB took their medicines ( Figure  207 3) .8 (4.7, 5.0) . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.

(which was not certified by peer review)
The copyright holder for this preprint this version posted October 11, 2022. ; https://doi.org/10.1101/2022.10.10.22280911 doi: medRxiv preprint 212 In this study nested within a highly pragmatic randomized trial conducted in Uganda, we found that 99DOTS was 213 feasible to implement and highly acceptable to people with TB and their health workers. Over 98% of expected 214 treatment doses were reported as taken, including over half (57.7%) by people with TB calling TFNs. Automated 215 SMS dosing and refill reminders were delivered with high levels of success and were generally considered helpful. 216 Both people with TB and health workers considered 99DOTS to be convenient and to increase the connection 217 between them. Some people with TB reported stigma and privacy concerns, as well as technical issues with using 218 99DOTS (phone charging and poor network connection). However, our data largely represent a more favorable 219 view of 99DOTS than in previous studies. 220 221 Engagement over time has been a key concern with 99DOTS, which requires people with TB to actively report 222 medication dosing rather than passively recording dosing as occurs with electronic pill boxes. The 57.7% of 223 overall doses confirmed by phone calls in our study is similar to that reported in two studies from India and a 224 meta-analysis which included this study and 10 other DAT implementation projects. (7, 8) In addition, the 225 decreased engagement over the course of treatment is similar to that reported in India by Cross et al.(2) However, 226 through a combination of self-report and calls to people with TB, health workers confirmed that >98% of expected 227 doses were taken. Thomas et al also confirmed high levels of adherence (88%) among people with TB using 228 99DOTS in India using random urine isoniazid screening.(7) Although research is needed to identify opportunities 229 to further increase engagement with 99DOTS, the real-time and quantitative dosing history provided by the 230 platform has strong potential to enhance TB care relative to routine care. 231 232 Our study provides some of the first systematic data on perceptions of digital adherence technologies in general, 233 and 99DOTS in particular, from sub-Saharan Africa. We found health workers and people with TB had high 234 capability, opportunity and motivation to use 99DOTS, with composite scores between 4 and 5 for all COM-B 235 categories indicating a response between agree or strongly agree across individual questions in each category. A 236 qualitative analysis from India reported high rates of acceptability among healthcare workers and fair acceptability 237 among people with TB. The lower acceptability among people with TB was largely driven by technology concerns . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.

(which was not certified by peer review)
The copyright holder for this preprint this version posted October 11, 2022. ; https://doi.org/10.1101/2022.10.10.22280911 doi: medRxiv preprint 238 (mobile phone access, poor network signal) and stigma.(5) A minority of people with TB expressed similar 239 concerns in our study, and the overall high scores across COM-B categories among people with TB may in part 240 be due to our extensive customization of the 99DOTS platform using human centered design methods.(9, 10) We 241 did not find evidence that 99DOTS weakens the relationship between people with TB and health workers; all 242 people with TB agreed that 99DOTS helps them feel more connected to their health workers, with 82% strongly 243 agreeing. 244 245 Key strengths of our study include that it was nested within a highly pragmatic trial making interpretation of its 246 findings more broadly applicable to people with TB in Uganda and sub-Saharan Africa. Additionally, this study 247 applied implementation science frameworks to facilitate a comprehensive and theory-based assessment of the 248 implementation of 99DOTS. However, this study should be interpreted considering some key limitations. First, 249 people with TB enrolled on 99DOTS may not represent the population of people with TB more broadly in Uganda. 250 Only 52% of eligible people with TB were enrolled on 99DOTS during the parent DOT to DAT trial and there 251 was no difference in treatment outcomes in the intention-to-treat analysis. The largest single reason for non-252 enrollment was lack of phone access, which is likely related to broader socioeconomic and gender differences in 253 technology use. Finally, our survey sample was small, especially among health workers, thus limiting our ability 254 to highlight small differences in capability, opportunity, and motivation. 255 256 In conclusion, we found that 99DOTS was feasible to implement, and more acceptable to both people with TB 257 and providers than has been previously reported in the literature. These findings highlight the importance of 258 adapting and contextualizing DATs prior to implementation, with specific attention to modifications that reduce 259 stigma and enhance education/motivation as well as connection between people with TB and their health workers. 260 Most barriers to using 99DOTS were within the opportunity domain and reflect challenges with phone charging 261 and network connection. Further research is needed on how engagement with 99DOTS among people with TB 262 can be enhanced and sustained throughout the treatment period, and whether the charging and network connection . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.

(which was not certified by peer review)
The copyright holder for this preprint this version posted October 11, 2022. ; https://doi.org/10.1101/2022.10.10.22280911 doi: medRxiv preprint 263 issues reported by a substantial proportion of people with TB can be addressed. But overall, our findings support 264 that 99DOTS-based treatment supervision should be offered as an alternative to DOT. 265 266 MATERIALS AND METHODS 267 Study setting and design 268 This study was embedded within a stepped-wedge randomized trial that assessed the effectiveness of 99DOTS-269 based treatment supervision in comparison to routine care. (11, 12) The trial was conducted at 18 health facilities 270 across 15 districts of Uganda between December 2018 and January 2020.(12) Briefly, during the intervention 271 period at each health facility, health workers offered people with TB 99DOTS-based treatment supervision. The 272 99DOTS platform was contextually adapted using human centered design methods.(9) 99DOTS envelopes were 273 re-designed to have a booklet appearance that concealed pills to reduce stigma and to include health worker 274 contact information, pictorial pill-taking instructions, and educational/motivational messaging. The ring tone 275 people with TB heard when making calls to report dosing was replaced with pre-recorded audio messages from 276 local health workers expressing gratitude, encouraging medication adherence, and/or providing education around 277 TB treatment. Other key components of the 99DOTS-based intervention included: 1) dosing reminders daily and 278 appointment reminders prior to refill visits via short message service (SMS), 2) health worker support actions 279 (phone calls, home visits, or additional health center visits for people with TB with sub-optimal adherence). 280 281 We conducted a longitudinal analysis to assess implementation of the key components of the 99DOTS-based 282 intervention and cross-sectional surveys to assess feasibility and acceptability to people with TB and health 283 workers. The study was approved by Institutional Review Boards at the University of California San Francisco 284 and Makerere University School of Public Health. A waiver of informed consent was granted to extract 285 demographic and clinical data from TB treatment registers and the 99DOTS server. Survey participants provided 286 verbal consent. 287 288 Study population .
CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.

(which was not certified by peer review)
The copyright holder for this preprint this version posted October 11, 2022. ; https://doi.org/10.1101/2022.10.10.22280911 doi: medRxiv preprint 289 The longitudinal assessment of TB medication adherence included all adults treated for drug-susceptible 290 pulmonary TB and enrolled on 99DOTS in their first month of treatment during the intervention period. We 291 excluded people with TB who transferred to other facilities to complete TB treatment. 292 293 In each health facility, surveys (S3 Table, S4 Table) were administered in months 11-13 of the trial to one or two 294 health workers involved in TB treatment supervision and to a random sample of 10 people with TB (5 men and 5 295 women) who were enrolled on 99DOTS and had not already completed TB treatment. 296 297 Data collection 298 Demographic and clinical data for people with TB. Demographic and clinical data were obtained from the Uganda 299 National Tuberculosis and Leprosy Programme (NTLP) treatment registers at participating health facilities. Each 300 month, health facility staff uploaded treatment register photos to a secure, password protected server. Research 301 staff then extracted individual-level clinical and demographic data into a secure REDCap database.(13) 302 303 TB medication adherence data. Enrollment on 99DOTS was confirmed using the Everwell Hub, the patient 304 management platform available to programs using 99DOTS. The Everwell Hub includes treatment start and end 305 dates, 99DOTS enrollment date, and total adherence (proportion of expected doses reported as taken). In addition, 306 Everwell Health Solutions provided a detailed dosing report for each person with TB that included all days on 307 treatment while using 99DOTS, daily dosing status (taken or missed) and method of dosing assessment (person 308 with TB calling TFNs or health workers adding doses manually). 309 310 SMS reminders and support actions. Everwell Health Solutions also provided a detailed SMS log for each enrolled 311 person with TB that included all SMS dosing reminders sent to people with TB and their delivery status (success, 312 invalid phone number or unsupported number type). A separate report listed support actions for each person with 313 TB logged by health workers using the 99DOTS app. 314 .
CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted October 11, 2022. ; https://doi.org/10.1101/2022.10.10.22280911 doi: medRxiv preprint

409
. CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted October 11, 2022. ; https://doi.org/10.1101/2022.10.10.22280911 doi: medRxiv preprint