Abstract
Purpose We sought to understand patients’ care-seeking behaviours during the pandemic, their use and views of different virtual care modalities, and whether these differed by sociodemographic factors.
Methods We conducted a multi-site cross-sectional patient experience survey at thirteen academic primary care teaching practices between May and June of 2020. An anonymized link to an electronic survey was sent to a subset of patients with a valid email address on file; sampling was based on birth month. For each question, the proportion of respondents who selected each response was calculated, followed by a comparison by sociodemographic characteristics using chi-squared tests.
Results In total, 7482 participants responded to the survey. Most received care from their primary care clinic during the pandemic (67.7%, 5068/7482), the majority via phone (82.5%, 4195/5086). Among those who received care, 30.53% (1509/4943) stated that they delayed seeking care because of the pandemic. Most participants reported a high degree of comfort with phone (92.4%, 3824/4139), video (95.2%, 238/250) and email or messaging (91.3%, 794/870). However, those reporting difficulty making ends meet, poor or fair health, and arriving in Canada in the last 10 years reported lower levels of comfort with virtual care and fewer wanted their practice to continue offering virtual options after the pandemic.
Conclusions Our study suggest that newcomers, people living with a lower income, and those reporting poor or fair health have a stronger preference and comfort for in-person primary care. Further research should explore potential barriers to virtual care and how these could be addressed.
Introduction
The COVID-19 pandemic has dramatically shifted the way health care is delivered and experienced by patients. Primary care practices in Canada, the US and elsewhere, rapidly switched to a virtual first approach in the first wave of the pandemic to limit transmission of the SARS-CoV2 virus and conserve Personal Protective Equipment1. A study from Ontario found that shortly after the pandemic was declared, in-office visits reduced by 79% and virtual care increased 56-fold, comprising 71% of primary care physician visits2. While this approach supported immediate public health goals, its impact on access, receipt of patient centered evidence-based care, and longer -term health outcomes is unclear3. As health systems consider what the “new normal” should look like, an examination of these impacts will be crucial.
This shift to a virtual-first approach in primary care has raised several concerns. Clinicians have noted anecdotally that patients with worrisome symptoms are delaying care4. Some note that the switch to virtual care may make care more accessible5–8, while others have highlighted barriers certain populations face in accessing virtual care9–12. Prior studies suggest patient characteristics including older age and lower income may limit one’s ability to benefit from digital health and virtual care services13–14. In addition, patients may not have access to required technologies such as a phone or internet access15–16. Despite this, very little literature to date is available on patient experience during the COVID-19 pandemic and how these differ by sociodemographic characteristics. Most existing studies on patient experience during COVID-19 are from acute care, and do not stratify experience based on patient demographics17–21.
We conducted a patient survey at multiple academic primary care clinics in Ontario, Canada to better understand patient experience during COVID-19. We were interested in patients’ care-seeking behaviours, their use and views of different virtual care modalities, and whether these differed by sociodemographic factors.
Methods
Study design and setting
We conducted a multi-site cross-sectional survey to understand patient experience during the COVID-19 pandemic at thirteen core teaching practices affiliated with the University of Toronto Department of Family and Community Medicine situated in the Greater Toronto Area, Canada’s largest metropolitan area. Participating practices were located in Toronto and surrounding areas including Mississauga, Markham, and Barrie. Practices range in size from roughly 11 physicians serving 14,000 patients to 80 physicians serving 50,000 patients; some have multiple locations. Physicians in all teaching practices are part of Family Health Organizations and formally enroll patients, have shared responsibility for after-hours care, and are paid primarily by age-sex adjusted capitation; twelve of the thirteen sites were part of Family Health Teams that included non-physician health professionals such as nurses, nurse practitioners, social workers and dieticians.
The survey was developed to directly inform quality improvement (QI) efforts at participating sites during COVID-19. The initiative was formally reviewed by institutional authorities at Unity Health Toronto and deemed to neither require Research Ethics Board approval nor written informed consent from participants.
Study Population and Recruitment
A link to an open electronic patient experience survey is emailed every quarter to a subset of patients with a valid email address on file; sampling each quarter is based on birth month with all eligible patients receiving a survey in a given year. The current analysis focuses on patients who were sent the survey between May and June of 2020 because they had a birthday during the months of March, April or May of 2020. Each site distributed an anonymized link to patients in the manner by which they usually communicate electronically to patients (i.e. by email or using a secure messaging service). In some cases, the email address on file may belong to a family member or caregiver to allow them the option of filling out the survey on behalf of the patient.
Recruitment was done in English, with one site also doing recruitment and survey completion in French. No incentives were provided to participants.
Survey Design
The survey was developed collaboratively by the family physicians who had a QI leadership role at participating sites. Where possible, questions were informed by existing surveys including the Commonwealth Fund International Health Policy Survey22–23 and the Ontario Primary Care Experience Survey, which was developed as part of a larger Primary Care Performance Measurement strategy to measure the performance across 9 domains24–25. The survey went through several iterations based on feedback from practice QI teams, a survey methodologist, a biostatistician, patient education and engagement specialists, and patient and family advisors. A paragraph at the start of the survey outlined the purpose of the survey, the reason they were being asked to participate, and highlighted that the survey was voluntary and anonymous. The final survey was prepared in Qualtrics software, a digital platform to capture experience data, and included 43 potential questions over 5 thematic domains including: 1) seeking and delaying care, 2) use and comfort with virtual care, 3) urgent care access, 4) patient centeredness and 5) patient demographic and contextual factors. Participants could end the survey at any point and were able to review previously answered questions before submission. (See appendix for full survey)
Data Collection and Storage
Data collected via the electronic survey were stored on Qualtrics. All data was downloaded onto a secure research server at the University of Toronto. A script was run to remove any potentially identifying information including 1) IP addresses, 2) Email address, 3) longitude/latitude coordinates and 4) any free text fields (which may contain unstructured protected health information).
Statistical Analysis
We performed an initial descriptive statistics analysis on the responses of all participants across all sites who answered at least one question in the survey. For each question, we calculated the proportion of respondents who selected each response. We then compared patient responses by sociodemographic characteristics including age, gender, education, self-reported financial issues, immigration status, primary language, self-reported health, and usual primary care provider (PCP). P values were calculated using chi-squared tests and all data analysis was conducted using R version 4.0.
Results
The survey link was emailed to 32,307 patients at 13 practices (see Appendix). We presented sociodemographic data (Table 1) on the 7482 participants who answered one or more questions in the survey (23.3% response rate). Sixty-five percent of respondents were female (4379/6713) and 78.3% (5159/6588) reported having a college, university or graduate degree. Nine percent of respondents (590/6556) reported trouble making ends meet at the end of the month, while 29.0% (1928/6656) were not born in Canada (with 16.9% of these having arrived in the last 10 years). Eight percent (553/6851) reported filling out the survey on behalf of a family member. Fifty-five surveys were completed in French.
Care-seeking during COVID-19
Of all respondents, 67.7% (5068/7482) reported they received care in some way from their primary care clinic since the start of the pandemic. Financial status and self-reported health were significantly associated with care seeking behaviours during the pandemic (p<0.001); a higher proportion of patients who noted trouble making ends meet (yes: 74.8%, 441/590, no: 65.3%, 3396/5201, prefer not to answer: 68.0%, 520/765) and those with lower self-rated health (fair or poor: 76.9%, 752/978, excellent: 59.8%, 599/1002) reported receiving care during the study period. Of the 32.3% (2414/7482) of patients who did not receive care during the study period, the most commonly cited reasons were that patients had no health need (72.4%) and patients were worried about safety (9.5%).
Of the 5068 patients who reported receiving care at their primary care practice during the pandemic, 30.5% (1509/4943) stated that they delayed seeking care because of the pandemic.
Gender, age, education level, financial status and self-reported health status were significantly associated with differences in seeking care (p<0.05 for all); for example, a higher proportion of those with trouble making ends meet and those with lower self-rated health reported delays in seeking care (see Table 2).
Use and perceptions of virtual care
Eighty-two (4195/5086) percent of participants reported receiving care by phone, 30.5% (1553/5086) in-person, 17.4% (886/5086) via email or secure messaging, and 5.1% (260/5086) via video. Age, immigration status and self-rated health were significantly associated with differences in receiving in person care (p<0.05 for all); the proportion who reported receiving in- person care was lower among those over the age of 65, those not born in Canada and those with lower self-rated health (Table 3). Women, young adults, those who rate their health as fair or poor and those who reported trouble making ends meet reported higher rates of phone use (see Table 3). Age and education level were significantly associated with differences in using email and secure messaging (p<0.001 for all); those over the age of 65 (16.9%, 269/1592) and those with a high school degree or less (13.5%, 130/962) reported less use of email and secure messaging relative to other groups.
Overall, most respondents indicated they were extremely or somewhat comfortable with the privacy and security of virtual modalities including phone (92.4%, 3824/4139), video (95.2%, 238/250) and email or secure messaging (91.3%, 794/870). Financial status, immigration status and self-reported health status were significantly associated with differences in comfort with virtual care use (p<0.05 for all); those having trouble making ends meet, those not born in Canada and those rating their health as fair or poor reported lower levels of comfort with phone calls and email or secure messaging relative to other groups (see Table 4).
Percentage of patients who reported they were comfortable with the privacy and security of using phone, video and email or secure messaging to receive care during the pandemic, by sociodemographic characteristic
Future preferences for virtual care
Seventy-five percent (3798/5068), 52.2% (2644/5068), and 42.9% (2172/5068) of respondents said they wanted their practice to continue offering phone, email/secure messaging, and video after the pandemic, respectively. Age, education status, financial status, immigration status and self-reported health status were significantly associated with differences in wanting ongoing use of each of the three virtual care modalities (p<0.05 for all); those over age 65, those whose education was high school or less, those reporting yes or “I don’t know” when asked about difficulty making ends meet, those born outside Canada, and those in fair or poor health reported the lowest desire for the three virtual care modalities to continue after the pandemic compared to other groups (see Table 5).
Discussion
Our analysis of more than 7400 patient experience surveys across 13 primary care clinics during the first months of the COVID-19 pandemic found important differences in care-seeking and comfort with virtual care based on patient income, self-reported health, and other demographic characteristics. Most participants received care from their primary care clinic in some way during the study period; however, almost a third who sought care reported they delayed it due to concerns about the pandemic. Patients who had trouble making ends meet and those who reported their health as fair or poor were more likely to seek care during the pandemic, yet were also more likely to report they delayed seeking care. Patient generally reported a high degree of comfort with phone, video and email or secure messaging. But, those reporting difficulty making ends meet, poor or fair health, and arriving in Canada in the last 10 years reported lower levels of comfort and less likely to want their practice to continue offering these virtual options.
Our results, similar to other emerging literature, suggests a complex relationship between the social determinants of health and patient comfort and preference regarding accessing care through virtual tools. A US based study prior to the pandemic found that while younger patients and those with physical disabilities were more likely to use video visits to access care, those who reported lower incomes and lived in rural populations were less likely to use this modality26. A recent US-based primary care study found that after care shifted to a virtual-first approach during the pandemic, a significantly smaller proportion of visits overall were with people who were low income, non-white, or non-English speakers27. However, a Canadian based study found that similar to our participants, those with the highest care needs (older, multiple co-morbidities), were more likely to access primary care during the early months of the pandemic compared to other groups2.
As many predict virtual care will continue to be a part of care delivery post-pandemic, this study highlights the importance of integrating patient experience data into future care delivery planning. Similar to other recently published data 2, 28, 29, our experience data indicates phone was by far the most utilized modality of virtual care and overall, participants were comfortable using virtual modalities to receive care. Patients who report financial troubles and poor health, had a higher percentage reporting accessing care (virtually and in person) during the pandemic compared to other groups; however, they reported greater concerns with the privacy and security of virtual care and less desire for virtual care to be an ongoing part of their primary care experience. This suggests that while public health measures may have pushed populations with the highest care needs to use virtual care, these modalities did not provide all patients with an equitable, patient-centered care experience. Further research should explore reasons behind the relative discomfort and low interest in virtual care and how barriers could be addressed. While access to technology may be part of this problem, other factors such as health and digital literacy, and support from peers and health care providers may also be significant30. Without further patient experience and demographic data to understand the ongoing use of virtual care, we risk leaving behind those who need care most.
Strengths and Limitations
Our study had several key strengths and limitations. Our study included a large sample of respondents from multiple clinics across both urban and suburban communities. Patients were randomly sampled using birth month. Survey questions were relevant to COVID-19 and informed by primary care leaders and patients. However, our findings are open to selection bias because of the response rate, mode of delivery, and the survey being offered primarily in English; however, demographics of our sample confirm that we reached a diverse group of patients. We found substantial differences in utilization and perspectives of virtual care by sociodemographic characteristics, but these may be an underestimate of true differences. Our survey reports on experience during the early phase of the pandemic and patients’ comfort and preferences may have evolved since. Finally, although our sample was taken from 13 primary care practices, these were all academic practices in the Greater Toronto Area where physicians were paid by capitation which may limit the generalizability of the findings.
Conclusions
We found that most patients were comfortable using virtual modalities and wanted virtual care options to continue. However, there were important differences by sociodemographic characteristics, for example, with those having difficulty making ends meet, reporting poor or fair health, and being born outside of Canada being less likely to report comfort with virtual modalities and less likely to want virtual care options to continue post-pandemic. Moving forward, clinicians and system decision makers need to carefully consider how we integrate virtual care into practices to ensure equity in access to primary care.
Data Availability
Following peer-reviewed publication, de-identified data can be made available on request for proposed projects advancing the public good. Please contact dfcm.quality@utoronto.ca.
Funding statement
Dr. Kiran is the Fidani Chair of Improvement and Innovation in Family Medicine at the University of Toronto and is supported as a Clinician Scientist by the Department of Family and Community Medicine (DFCM) at the University of Toronto and at St. Michael’s Hospital. Funds from the Fidani Chair supported Dr. Agarwal as the Patient Experience Measurement Lead for the DFCM.
Conflicts of interest
The authors declare no conflicts of interest.
Prior presentations
None
Author contributions
PA and TK conceived of and designed the study together. RW and CM conducted the analysis. All authors helped interpret the data. PA drafted the manuscript with the support of TK and all authors critically reviewed it. All authors read and approved the final manuscript
Acknowledgements
We wish to thank Ali Damji, Debbie Elman, Frances Cousins, Jennifer Stulberg, Joanne Laine- Gossin, Karuna Gupta, Linda Weber, Melissa Witty, Navsheer Gill Toor, Noor Ramji, Sakina Walji, Sam Tirkos, Susanna Fung, Susie Kim, Thuy Nga Pham, Tiffany Florindo for their support in developing and implementing the survey at their respective teaching practices, Trish O’Brien and Kirsten Eldridge for their support with survey implementation across all sites, Danielle Martin for her feedback on our draft manuscript, and the patient partners who helped us refine the survey questions.
Appendix A: Site Demographics
Footnotes
payal.agarwal{at}wchospital.ca, ri.wang{at}unityhealth.to, ri.wang{at}unityhealth.to,, christopher.meaney{at}utoronto.ca, sakina.walji{at}sinaihealth.ca,, ali.damji{at}mail.utoronto.ca,, NToor{at}southlakeregional.org, gina.yip{at}gmail.com,, Debbie.Elman{at}sunnybrook.ca, tiffany.florindo{at}medportal.ca, susannaf{at}gmail.com, wittym65{at}gmail.com,, thuynga.pham{at}utoronto.ca, noor.ramji{at}unityhealth.to, tara.kiran{at}utoronto.ca
References
