Next Article in Journal / Special Issue
HPV Vaccination Attitudes and Behaviors among General Practitioners in Italy
Previous Article in Journal
Immune Responses Induced by mRNA Vaccination in Mice, Monkeys and Humans
Previous Article in Special Issue
A Review of Adherence and Predictors of Adherence to the CONSORT Statement in the Reporting of Tuberculosis Vaccine Trials
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Change of Willingness to Accept COVID-19 Vaccine and Reasons of Vaccine Hesitancy of Working People at Different Waves of Local Epidemic in Hong Kong, China: Repeated Cross-Sectional Surveys

Centre for Health Systems and Policy Research, JC School of Public Health and Primary Care, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong, China
*
Author to whom correspondence should be addressed.
Vaccines 2021, 9(1), 62; https://doi.org/10.3390/vaccines9010062
Submission received: 2 December 2020 / Revised: 12 January 2021 / Accepted: 14 January 2021 / Published: 18 January 2021

Abstract

:
Vaccine hesitancy is among the major threats to the effectiveness of vaccination programmes. This study aimed to report the trend in response to willingness to accept the COVID-19 vaccine between two waves of the local epidemic and examine differences among occupations. Two cross-sectional surveys were conducted online during the first wave (February) and third wave (August to September) of the local epidemic in 2020. Acceptance of the COVID-19 vaccine was measured along with personal protection behaviours and occupations. A total of 2047 participants provided valid responses. The willingness to accept the COVID-19 vaccine among the participants was lower in the third wave (34.8%) than the first wave (44.2%). There were more concerns over vaccine safety in the third wave. Clerical/service/sales workers were less likely to accept the vaccine (adjusted odds ratio: 0.62, 95% confidence interval: 0.43–0.91). A high-level compliance of facemask wearing was found, and more people maintained social distancing and used alcohol hand rub in the third wave. Decreasing willingness to accept the COVID-19 vaccine may be associated with increasing concerns about vaccine safety and growing compliance of personal protection behaviours. The rush of vaccine development with higher risks of safety issues may jeopardize the public’s trust and lower uptake rates. Education and favourable policy should be provided to the general working population for the vaccination, especially for those who are not professional and are frequently exposed to crowds.

1. Introduction

As the daily number of confirmed coronavirus disease 2019 (COVID-19) cases increased worldwide throughout the year of 2020, global disease burden posed by the pandemic is heavy [1,2], while there is no specific medical treatment of COVID-19 to date [3]. Therefore, the development and implementation of COVID-19 vaccines becomes crucial to the prevention and elimination of the disease [4]. By the end of October 2020, there were at least 44 vaccine candidates being tested in clinical trial and nine of them in phase 3 trials globally [5,6]. In addition to the efficacy of the vaccines, their uptake rate is also important to the effectiveness of preventing the spread of COVID-19 in future [7,8], as it needs to achieve certain levels to create herd immunity among the population [9].
However, it has been reported that vaccine refusal and hesitancy have been increasing in recent years [10]. This vaccine hesitancy, which could lead to refusal or delay of the vaccination, may eventually cause a reduction in coverage rate of the vaccine and affect its effectiveness [11,12,13]. Vaccine hesitancy was also listed among the top ten global health threats by the World Health Organization (WHO) [10]. Thus, there is a need to ascertain the level of willingness to accept the COVID-19 vaccine when the potential one becomes available.
A few studies have been conducted worldwide to identify the factors associated with COVID-19 vaccine acceptance among the general population. Recent studies in US, Canada and Australia found that age, sex, education level and ethnicity were associated with the intention to uptake the COVID-19 vaccine [14,15,16]. A study in mainland China [17] and a study in Malaysia [18] identified that perceived risks of infection and previous uptake of influenza vaccination could also affect COVID-19 vaccine acceptance. In addition to the general population, studies on vaccination acceptance of health care workers are most common in current literature, as they are considered to have the highest risks of infection [19,20]. However, there are limited studies on the vaccine acceptance among other occupations which also have a high chance of infection under the pandemic, such as retail or restaurant workers with direct exposure to customers [21]. Transmission of the disease in workplaces other than healthcare settings was substantial [22,23]. Therefore, it is also necessary to understand vaccination acceptance among different occupation groups.
In this regard, this study aimed to explore the willingness to accept the COVID-19 vaccine and identify reasons for refusal and hesitancy and their trends between two waves of local epidemic at different time points, which is helpful to estimate future uptake rate when the vaccine is available and to design promotional strategies before the launch of vaccination programmes. This study will also examine the association of this willingness with occupation types.

2. Materials and Methods

This study comprised two cross-sectional online surveys among the working population in Hong Kong (HK), China. This first survey was conducted from 17 to 27 February 2020 when the “first wave” of the local COVID-19 epidemic occurred and before declaration of the pandemic by WHO on 14 March 2020 [24]; the second survey was conducted from 24 August to 7 September 2020 when the “third wave” of the local epidemic was coming to an end [25,26]. Ethics approval of this study was obtained from the Survey and Behavioural Research Ethics Committee of The Chinese University of Hong Kong.

2.1. Study Sample and Data Collection

This study targeted the working population in HK, which includes nine occupation groups as categorized by the government, namely, (1) professionals, (2) managers and administrators, (3) associate professionals, (4) clerical support workers, (5) service and sales workers, (6) craft and related workers, (7) plant and machine operators and assemblers, (8) elementary occupations and (9) others [27]. Those aged 18 or above who were either employed or self-employed, working on a full-time or part-time basis and understood Chinese were eligible for the study. Those who were retired, housewives or students were excluded.
In the first survey, the online questionnaire was made available to the target population through email and multiple social networks, as this is considered to be a safer way for both participants and research team members to avoid face-to-face contact and reduce risk of infection. The second survey was delegated to an online survey company for data collection to improve the sample representativeness. Questionnaires of both surveys were self-administered and in Chinese. An information sheet including the details of the study was available at the beginning of both surveys. Electronic consent was obtained from the participants before each survey. Data collected from the surveys were retrieved from an online database and protected by passwords.

2.2. Measurements

The questionnaire for both surveys was developed with reference to a related study in personal protection practice to prevent infectious diseases [28] and WHO guidelines for COVID-19 prevention in the workplace [29]. It contained three major aspects: (1) socio-demographic characteristics, including age, sex, occupation, education level, and marital status; (2) frequency of personal protection behaviours in the past seven days, including “use of alcohol-based handrub when outside”, “wearing a surgical facemask when outside” and social distancing (combining “avoiding leaving home” and “avoiding contact with neighbours/relatives/friends”), along with a three-point scale to indicate that behaviours were “never”, “sometimes” or “usually/always” performed in the past seven days; and (3) previous influenza vaccination behaviours and willingness to accept a potential COVID-19 vaccine, as well as reasons for refusal or hesitancy. The willingness to accept the COVID-19 vaccine was determined by the following: “if a COVID-19 vaccine is available now, whether or not will you choose to accept it”. The responses consisted of three categories, namely, “Yes (accept)”, “No (refuse)” and “Undecided”. To identify the reasons for vaccine refusal and hesitancy, the respondents were asked the following question: “What is/are the reasons that you are not willing to have vaccination or have not decided yet?”, and they could choose responses from one or more options including “do not trust the effectiveness of the vaccine”, “do not think it is necessary”, “no time for vaccination”, “vaccine is susceptible to be infected with COVID-19”, “serious adverse side effects are common in vaccine”, “unforeseen side effect of vaccine has not been fully discovered” and “vaccine safety is controversial”. The latter three options were considered as “worries about safety of vaccine” in the analysis.
To reduce the complexity of finding interpretations, the occupation types were re-grouped through the analysis. Thus, clerical support workers and service/sales workers were combined and named as “clerical/service/sales workers”; craft and related workers, plant and machine operators and assemblers, elementary occupations and others were combined as “blue-collar workers”. As for frequencies of personal protection behaviours, there were too few participants who never performed such behaviours, so “never” and “sometimes” were re-grouped as “never/sometimes” in the analysis.

2.3. Statistical Analysis

Descriptive analysis was performed for the socio-demographic characteristics of the two surveys. The frequency of personal protection behaviours and willingness to accept the COVID-19 vaccine among participants were summarized using cross-tabulation. Chi-square tests were performed to identify their differences. Those with missing values in personal protection behaviours and vaccine willingness were excluded from the analysis. In order to make the behaviours and vaccine willingness in these two surveys comparable, the sample of the first survey was standardized using a direct method based on the age, sex and occupational distribution of the sample in the second survey [30]. Following this, multiple multinomial logistic regression was applied to examine the association between occupation and willingness to accept the COVID-19 vaccine in the two different rounds of survey, with adjustment for age, sex, marriage, chronic conditions and previous influenza vaccination behaviours. Multiple logistic regressions were also performed to determine the difference in personal protection behaviours between these two rounds of survey and among different occupation groups with adjustment for the aforementioned covariates. Reasons for refusal and hesitancy of the COVID-19 vaccination were also summarized by occupation types of participants and the survey rounds. Data analysis was processed using Stata 15.0.

3. Results

3.1. Socio-Demographical Characteristics of the Sample

In the first survey, 1196 participants gave responses to the online questionnaire. Among them, 148 participants reported to be retired or unemployed, or did not provide their occupation in the survey, and one participant did not indicate the willingness to accept the COVID-19 vaccine. Therefore, there were 1047 valid respondents to the first survey. For the second survey, a total of 1000 participants responded (30% response rate) and provided valid responses to the research questions. In the first survey (Table 1), 67.9% were female, and 20.7% of them were aged 18–29, 28.1% aged 30–39, 33.0% aged 40–49 and 18.3% aged 50 and above. The majority of them (75.1%) had received an education at university or achieved a higher academic degree. Over half of them (53.1%) were married or cohabited. Most participants (59.5%) were professionals or managers and administrators, while only 1.2% of them were blue-collar workers. There were 14.4% of them who had chronic conditions and 18.4% who had received the influenza vaccine in 2019. In the second survey, 46.1% were female, and 16.1% aged 18–29, 22.5% aged 30–39, 24.7% aged 40–49 and 36.7% aged 50 and above. Among them, 70.0% had finished preparatory school or a higher degree, and 57.2% were married or cohabited. Over half of them (51.6%) were clerical support, service and sales workers or blue-collar workers. In this survey, 10.8% of them had chronic conditions, and 17.7% had received the influenza vaccine in 2019.

3.2. Willingness to Accept the COVID-19 Vaccine

Standardized rate of the vaccine acceptance in the first survey was calculated based on distribution of the second survey to make the two surveys comparable. Working people were found to be more willing to accept the vaccine (44.2% vs. 34.8%) and less likely to be hesitant (38.6% vs. 43.7%) in the first survey than those in the second one (p < 0.001) (Table 2 and Figure 1).
From the univariate analysis (Table 1), the willingness of the participants to accept the COVID-19 vaccine was found to be associated with age (p < 0.001), sex (p < 0.001) and previous influenza vaccine uptake (p < 0.001) in the first survey, while marriage (p < 0.001), occupation (p = 0.044), chronic condition (p = 0.026) and previous influenza vaccine uptake (p < 0.001) were identified in the second survey. These factors, except education, were used as covariates in multiple regressions examining a change in willingness of participants to accept the vaccine between the two surveys, as inclusion of education would result in multicollinearity. In the multiple multinomial logistic regression (Table 3), compared to those with hesitancy, working people were less likely to accept the COVID-19 vaccine in the second survey than those in the first one (adjusted odds ratio (AOR): 0.68, 95% confidence interval (CI): 0.56–0.84), while no significant difference was found for people who refused the vaccine (AOR: 1.12, 95% CI: 0.88–1.44).
In addition to the difference between the time points of the two surveys, clerical, service or sales workers were less likely to accept the vaccine (AOR: 0.62, 95%CI: 0.43–0.91), while blue-collar workers were less likely to refuse it (AOR: 0.52, 95% CI: 0.32–0.86). Those who received the influenza vaccine in the past year were more likely to accept the vaccine (AOR: 2.25, 95% CI: 1.74–2.93) and less likely to refuse it (AOR: 0.42, 95% CI: 0.27–0.66). Moreover, those with advanced age were less likely to accept the vaccine and more likely to refuse it. Female participants were also less likely to accept it.

3.3. Participant Reasons for COVID-19 Vaccine Refusal or Hesitancy

The participants who were not willing to accept the vaccine (i.e., vaccine refusal) or were unsure (i.e., vaccine hesitancy) were asked about their reasons for refusal or hesitancy (Table 4 and Figure 2). In the first survey, 63.2% of the participants had doubts in the effectiveness of the vaccine, 24.5% of them believed the vaccine was unnecessary, 4.8% indicated lack of time and 4.6% worried about the safety or side effects of the vaccination. Significant differences among occupations were found in the belief that vaccination is unnecessary (p = 0.031) and worries about safety (p = 0.012). Clerical/service/sales and blue-collar workers tended to have a lower level of these two concerns. In the second survey, there were more participants who worried about the safety issue of the vaccine (78.4%), while less of them worried about the effectiveness (30.4%). There were still 22.2% who believed the vaccine was unnecessary and 5.7% who reported a lack of time to uptake the vaccine. Among occupations, more clerical, service and sales workers (27.2%) and blue-collar workers (26.3%) tended to believe the vaccine was unnecessary than others (p = 0.036), and more blue-collar workers reported that lack of time was one of their reasons for vaccine refusal or hesitancy (12.0%, p = 0.007).

3.4. Personal Protection Behaviours to Prevent Infection

In addition to the COVID-19 vaccine, associations of personal protection behaviours such as frequency of wearing a facemask when outside, maintaining social distancing and use of alcohol hand rub during the two survey time points as well as other factors were examined. Compared with the first survey, fewer people in the second survey maintained their frequency of wearing facemask (91.6% vs. 95.7%, p < 0.001), but more of them expressed maintaining social distancing (68.1% vs. 58.7%, p = 0.001) and applying alcohol hand rub (67.3% vs. 55.6%, p < 0.001) more often (Table 2 and Figure 3).
In the multiple regressions (Table 3), it was found that participants were less likely to usually or always wear a facemask outdoors in the second survey than the first one (AOR: 0.47, 95% CI: 0.32–0.69), while more likely to maintain social distancing (AOR: 1.54, 95% CI: 1.27–1.86) and use alcohol hand rub (AOR: 1.67, 95% CI: 1.39–2.02). Blue-collar workers were less likely to maintain social distancing (AOR: 0.54, 95% CI: 0.37–0.77) but more likely to use hand rub when outside (AOR: 1.47, 95% CI: 1.03–2.10). Managers and administrators were also more likely to use the alcohol hand rub (AOR: 2.08, 95% CI: 1.41–3.07). Despite this, working people with advanced age were less likely apply alcohol hand rub for prevention of COVID-19.

4. Discussion

To our knowledge, this is among the first studies to investigate the trend of acceptance of the COVID-19 vaccine during the pandemic. The two surveys in this study were conducted at the first wave of local epidemic before declaration of the COVID-19 pandemic and at the third local wave after the pandemic declaration, separately [26]. During the 11 days of the first survey, a total of 35 confirmed cases were identified in HK with daily increments of fewer than 10, while there were 207 confirmed cases during the 15 day second survey with daily increments ranging from 7 to 24 [25]. Although the local situation was more severe during the second survey, a reduction in willingness to accept the COVID-19 vaccine and a higher level of vaccine hesitancy among the working population in HK were found. The acceptance rate of the vaccine in the second survey was 34.5%, which was fairly low to achieve herd immunity with at least 60% coverage of a vaccine with 100% efficacy for life-long protection [31]. The findings remind us that more efforts are needed to promote the COVID-19 vaccination.
According to the reasons for vaccine refusal and hesitancy reported by the participants, more people had doubts or concerns over the effectiveness and safety of the potential vaccine than believing it unnecessary or having no time to uptake it. This result was similar to the finding reported in a previous study in HK during the 2009 H1N1 pandemic that worries about side effects were more common than other reasons for rejection of the vaccine among health care workers [32]. The study in China found that although over 90% of the respondents stated that they would accept the COVID-19 vaccine when available, almost 50% of these people wanted to delay the vaccination until it was confirmed safe [17]. It is also similar to a survey in Canada which reported that major concerns of people who reported they were unlikely to accept the COVID-19 vaccine were risks, safety and side effects of vaccination [15]. Another study in Malaysia reported that over 95% of the respondents had concerns about the efficacy, effectiveness and safety of the COVID-19 vaccine [18]. In addition to a higher level of concern over safety and side effects of the vaccine than other reasons, this concern was found to be higher in the second survey than the first one, suggesting that the safety of the vaccine could be among the major reasons why fewer people were willing to accept it, while more people reported hesitancy. This change may not only be attributed to reasonable concerns based on inconclusive clinical trial results on safety of the vaccines, which can be alleviated with scientific evidence when the trials are finished, but could also result from diminished vaccine confidence enhanced by online misinformation over time [10,33,34,35,36], which may eventually cause refusal of the vaccines even if they are proven to be effective and safe.
Meanwhile, the frequencies of personal protection behaviours changed between the survey time points. Slightly fewer people were found to frequently wear masks outdoors in the second survey, but the overall rate of mask-wearing remained at a high level (over 90% of people). There were more working people who had a higher compliance with social distancing and use of alcohol hand rub when outside in the second survey, which showed a growing awareness and positive attitude towards these individual-level precautions [37,38]. Taking both increasing compliance to social distancing and hand rub usage and decreasing vaccine acceptance rate into consideration, the findings implied that the participants perceived their good personal protection behaviours as substitutes for vaccination to prevent COVID-19. The general public might believe these precautions would be sufficient to prevent COVID-19 without receiving the vaccine based on their personal experience of recent months during the pandemic. A similar finding was reported in a study among health care workers in Canada, which found that those who did not received the influenza vaccination tended to believe that preventive measures other than vaccination, including hand-washing and exercising, were more effective than vaccination [39]. Thus, the decreasing trend of vaccination acceptance rate might partially result from an increasing positive perception on these individual infection control precautions.
Considering all this, information dissemination efforts on safety of the vaccination, which are as important as efficacy and effectiveness of the vaccine, should be enhanced by health authorities and organizations, particularly through online social media where the issue of misinformation is severe [35,36,40]. The primary care sector should also be engaged in health education to increase vaccination coverage [41]. For the information dissemination, there should not only be information about the safety of the vaccination but also messages conveying that vaccination is a part of the individual infection control precautions that would complement social distancing and handwashing in disease prevention, and could be helpful to both individuals and communities to resume normal life. On the other hand, despite the urgent situation of the pandemic, the development of the COVID-19 vaccine should be rushed without proper and thorough examination, as this could cause adverse events more easily and would subsequently jeopardize the public’s trust in scientific communities, manufacturers, health authorities and the vaccine itself, and lead to a reduction in uptake rate of the vaccine eventually [10].
Differences in vaccination acceptance were found among different occupations, which may be attributed to differences in knowledge of and attitude to prevention precautions among occupations [42]. The clerical, sales and service workers had a lower willingness to accept the COVID-19 vaccine than the others, which is similar to findings from the US that influenza vaccination coverage was lower in sales and service workers than most occupations [43]. They were also more likely to believe that the vaccination is unnecessary, which might result from a lower health literacy or the belief that the threats of the pandemic were exaggerated [16]. However, these workers, including receptionists, attendants and salespersons, had a greater frequency of contact with other people due to the nature of their work and, therefore, were exposed to greater risks of COVID-19 infection [21,23]. They also have longer working hours but receive lower salaries than professionals and managers/administrators, so they were more likely to have lower socio-economic status [27]. In light of this, interventions and policies to improve and facilitate the vaccination of people with these occupations should be considered. These workers who have frequent exposure to crowds should be included as one of the priority groups in addition to residents of care homes, the elderly aged 65 or above, patients with chronic conditions and health care workers who are usually considered to be the priority groups of the seasonal influenza vaccination [44]. Health education in the workplace, convenience of vaccination and financial subsidies for the vaccination can be offered to these people to increase their uptake rate, and the involvement of their employers in these efforts is necessary.
Limitations in this study should be highlighted. First, this study comprises two cross-sectional surveys which may have heterogeneity between characteristics of the two survey samples. To minimize its influence on the results, standardization of the study sample was performed to make the two samples comparable, and multivariate analysis was used to adjust the influence of socio-demographical factors. Second, selection bias could exist due to the online data collection method. Nevertheless, the sample characteristics of the second survey matched the working population profile in HK, and the results from the first survey were standardized based on the sample of the second survey. Third, the study findings on change of acceptance rate of the vaccine could be influenced by local number of daily confirmed cases, capacity of healthcare services and relevant policies in different areas. Precautions should be taken to generalize the findings into other countries and regions. Moreover, the salaries of the participants were not collected in the surveys, which could be important in showing differences in vaccination acceptance among people with different socioeconomic status. However, the occupation types of the participants were collected in the studies and considered as a proxy for the socioeconomic factors associated with vaccination acceptance in the study. Trust in the government was also found as an important factor that is associated with acceptance of the COVID-19 vaccination in a study [45], which was not included as a covariate in this study. The influence of individual political views and trust in certain health authorities on uptake of the vaccination could be explored in future studies.

5. Conclusions

This study found a decreasing trend of the willingness to accept the COVID-19 vaccine between two local waves of the epidemic, which could be associated with growing confidence and compliance of personal protection behaviours. This implies that personal protection behaviours might be considered as substitutes of vaccination in prevention of the disease by working people. It seems that they tended to believe committing to these precautions should be sufficient for the COVID-19 prevention. This decreasing trend might also be an outcome of a high level of concern over vaccine safety. Future promotion of the vaccination should address these concerns, and a properly and thoroughly tested vaccine would be helpful to gain the confidence of the public. In addition, acceptance of the COVID-19 vaccine was lower among clerical/service/sales workers than the other occupations, although some of them are exposed to higher risks of infection due to the nature of their work. Policies that assist and improve the vaccine uptake of these workers should be considered. We believe it is important and more effective to start promotion, initiate policy-making and set up priority guidelines for the vaccination before the vaccines are approved, and this study could be used to inform these efforts. Further quantitative and qualitative studies could be conducted to follow up individuals for their vaccination acceptance and their reasons at different time points.

Author Contributions

Conceptualization, K.W. and E.L.-Y.W.; methodology, K.W., E.L.-Y.W., K.-F.H. and A.W.-L.C.; formal analysis, K.W. and P.S.-Y.Y.; investigation, E.L.-Y.W. and A.W.-L.C.; data curation, P.S.-Y.Y.; writing—original draft preparation, K.W.; writing—review and editing, K.W., E.L.-Y.W., K.-F.H., A.W.-L.C., P.S.-Y.Y., D.D., S.Y.-S.W. and E.-K.Y.; supervision, S.Y.-S.W. and E.-K.Y.; project administration, E.L.-Y.W. and A.W.-L.C. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Survey and Behavioural Research Ethics Committee of The Chinese University of Hong Kong (reference No. SBRE-19-396, approved on 13 February 2020).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data used in this study cannot be made publicly available for ethical reasons. Public availability of data would compromise confidentiality and privacy of participants.

Acknowledgments

The authors would like to thank Jack CH Lau and Amy YK Wong for their support in creating the online survey platform and monitoring the quality of data collection. Special thanks should be given to all participants taking part in the studies. Last but not least, thank you to Paul Chan, the department of Microbiology for the advice provided and Martin Wong, the Jockey Club of School of Public Health and Primary Care, Faculty of Medicine, The Chinese University of Hong Kong for the interpretation of the study findings.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. John Hopkins University. Coronavirus Resource Center. 2020. Available online: https://coronavirus.jhu.edu/map.html (accessed on 12 November 2020).
  2. Alwan, N.A. Surveillance is underestimating the burden of the COVID-19 pandemic. Lancet 2020, 396, e24. [Google Scholar] [CrossRef]
  3. Pan, H.; Peto, R.; Karim, Q.A.; Alejandria, M.; Restrepo, A.M.H.; García, C.H.; Kieny, M.P.; Malekzadeh, R.; Murthy, S.; Preziosi, M.-P. Repurposed antiviral drugs for COVID-19; interim WHO SOLIDARITY trial results. medRxiv 2020. [Google Scholar] [CrossRef]
  4. Gao, Q.; Bao, L.; Mao, H.; Wang, L.; Xu, K.; Yang, M.; Li, Y.; Zhu, L.; Wang, N.; Lv, Z.; et al. Development of an inactivated vaccine candidate for SARS-CoV-2. Science 2020, 369, 77–81. [Google Scholar] [CrossRef] [PubMed]
  5. Poland, G.A.; Ovsyannikova, I.G.; Kennedy, R.B. SARS-CoV-2 immunity: Review and applications to phase 3 vaccine candidates. Lancet 2020, 396, 1595–1606. [Google Scholar] [CrossRef]
  6. Hodgson, S.H.; Mansatta, K.; Mallett, G.; Harris, V.; Emary, K.R.W.; Pollard, A.J. What defines an efficacious COVID-19 vaccine? A review of the challenges assessing the clinical efficacy of vaccines against SARS-CoV-2. Lancet Infect. Dis. 2020, in press. [Google Scholar] [CrossRef]
  7. Utazi, C.E.; Thorley, J.; Alegana, V.A.; Ferrari, M.J.; Takahashi, S.; Metcalf, C.J.E.; Lessler, J.; Cutts, F.T.; Tatem, A.J. Mapping vaccination coverage to explore the effects of delivery mechanisms and inform vaccination strategies. Nat. Commun. 2019, 10, 1633. [Google Scholar] [CrossRef] [PubMed]
  8. Lahariya, C. Vaccine epidemiology: A review. J. Fam. Med. Prim. Care 2016, 5, 7. [Google Scholar] [CrossRef] [PubMed]
  9. Kim, T.H.; Johnstone, J.; Loeb, M. Vaccine herd effect. Scand. J. Infect. Dis. 2011, 43, 683–689. [Google Scholar] [CrossRef] [Green Version]
  10. Trogen, B.; Oshinsky, D.; Caplan, A. Adverse Consequences of Rushing a SARS-CoV-2 Vaccine: Implications for Public Trust. JAMA 2020, 323, 2460–2461. [Google Scholar] [CrossRef]
  11. Jarrett, C.; Wilson, R.; O’Leary, M.; Eckersberger, E.; Larson, H.J.; the SAGE Working Group on Vaccine Hesitancy. Strategies for addressing vaccine hesitancy—A systematic review. Vaccine 2015, 33, 4180–4190. [Google Scholar] [CrossRef] [Green Version]
  12. Sadaf, A.; Richards, J.L.; Glanz, J.; Salmon, D.A.; Omer, S.B. A systematic review of interventions for reducing parental vaccine refusal and vaccine hesitancy. Vaccine 2013, 31, 4293–4304. [Google Scholar] [CrossRef] [PubMed]
  13. Larson, H.J.; Jarrett, C.; Eckersberger, E.; Smith, D.M.; Paterson, P. Understanding vaccine hesitancy around vaccines and vaccination from a global perspective: A systematic review of published literature, 2007–2012. Vaccine 2014, 32, 2150–2159. [Google Scholar] [CrossRef] [PubMed]
  14. Malik, A.A.; McFadden, S.M.; Elharake, J.; Omer, S.B. Determinants of COVID-19 vaccine acceptance in the US. EClinicalMedicine 2020, 26, 100495. [Google Scholar] [CrossRef] [PubMed]
  15. Frank, K.; Arim, R. Canadians’ Willingness to Get a COVID-19 Vaccine: Group Differences and Reasons for Vaccine Hesitancy 2020. Available online: https://www150.statcan.gc.ca/n1/pub/45-28-0001/2020001/article/00073-eng.htm (accessed on 12 November 2020).
  16. Dodd, R.H.; Cvejic, E.; Bonner, C.; Pickles, K.; McCaffery, K.J.; Ayre, J.; Batcup, C.; Copp, T.; Cornell, S.; Dakin, T.; et al. Willingness to vaccinate against COVID-19 in Australia. Lancet Infect. Dis. 2020. [Google Scholar] [CrossRef]
  17. Wang, J.; Jing, R.; Lai, X.; Zhang, H.; Lyu, Y.; Knoll, M.D.; Fang, H. Acceptance of COVID-19 Vaccination during the COVID-19 Pandemic in China. Vaccines 2020, 8, 482. [Google Scholar] [CrossRef]
  18. Wong, L.P.; Alias, H.; Wong, P.F.; Lee, H.Y.; AbuBakar, S. The use of the health belief model to assess predictors of intent to receive the COVID-19 vaccine and willingness to pay. Hum. Vaccin. Immunother. 2020, 16, 2204–2214. [Google Scholar] [CrossRef]
  19. Wang, K.; Wong, E.L.Y.; Ho, K.F.; Cheung, A.W.L.; Chan, E.Y.Y.; Yeoh, E.K.; Wong, S.Y.S. Intention of nurses to accept coronavirus disease 2019 vaccination and change of intention to accept seasonal influenza vaccination during the coronavirus disease 2019 pandemic: A cross-sectional survey. Vaccine 2020, 38, 7049–7056. [Google Scholar] [CrossRef]
  20. Nguyen, L.H.; Drew, D.A.; Graham, M.S.; Joshi, A.D.; Guo, C.-G.; Ma, W.; Mehta, R.S.; Warner, E.T.; Sikavi, D.R.; Lo, C.-H.; et al. Risk of COVID-19 among front-line health-care workers and the general community: A prospective cohort study. Lancet Public Health 2020, 5, e475–e483. [Google Scholar] [CrossRef]
  21. Lan, F.-Y.; Suharlim, C.; Kales, S.N.; Yang, J. Association between SARS-CoV-2 infection, exposure risk and mental health among a cohort of essential retail workers in the USA. Occup. Environ. Med. 2020. [Google Scholar] [CrossRef]
  22. Marinaccio, A.; Boccuni, F.; Rondinone, B.M.; Brusco, A.; D’Amario, S.; Iavicoli, S. Occupational factors in the COVID-19 pandemic in Italy: Compensation claims applications support establishing an occupational surveillance system. Occup. Environ. Med. 2020, 77, 818–821. [Google Scholar] [CrossRef]
  23. Lan, F.Y.; Wei, C.F.; Hsu, Y.T.; Christiani, D.C.; Kales, S.N. Work-related COVID-19 transmission in six Asian countries/areas: A follow-up study. PLoS ONE 2020, 15, e0233588. [Google Scholar] [CrossRef] [PubMed]
  24. World Health Organization. WHO Director-General’s Opening Remarks at the Media Briefing on COVID-19. 2020. Available online: https://www.who.int/dg/speeches/detail/who-director-general-s-opening-remarks-at-the-media-briefing-on-covid-19---11-march-2020 (accessed on 1 November 2020).
  25. Centre for Health Protection. COVID-19 Thematic Website Hong Kong. 2020. Available online: https://www.coronavirus.gov.hk/eng/index.html (accessed on 12 November 2020).
  26. Hong Kong SAR Government. Press Releases—Government Extends Social Distancing Measures Hong Kong. 2020. Available online: https://www.info.gov.hk/gia/general/202008/17/P2020081700445.htm (accessed on 12 November 2020).
  27. Census and Statistics Department. 2019 Report on Annual Earnings and Hours Survey Hong Kong. 2020. Available online: https://www.statistics.gov.hk/pub/B10500142019AN19B0100.pdf (accessed on 12 November 2020).
  28. Raab, M.; Pfadenhauer, L.M.; Millimouno, T.J.; Hoelscher, M.; Froeschl, G. Knowledge, attitudes and practices towards viral haemorrhagic fevers amongst healthcare workers in urban and rural public healthcare facilities in the N’zerekore prefecture, Guinea: A cross-sectional study. BMC Public Health 2020, 20, 296. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. World Health Organization. Getting Your Workplace Ready for COVID-19. 2020. Available online: https://www.who.int/docs/default-source/coronaviruse/getting-workplace-ready-for-covid-19.pdf (accessed on 1 November 2020).
  30. Naing, N.N. Easy way to learn standardization: Direct and indirect methods. Malays. J. Med. Sci. 2000, 7, 10. [Google Scholar] [PubMed]
  31. Anderson, R.M.; Vegvari, C.; Truscott, J.; Collyer, B.S. Challenges in creating herd immunity to SARS-CoV-2 infection by mass vaccination. Lancet 2020, 396, 1614–1616. [Google Scholar] [CrossRef]
  32. Chor, J.S.; Ngai, K.L.; Goggins, W.B.; Wong, M.C.; Wong, S.Y.; Lee, N.; Leung, T.F.; Rainer, T.H.; Griffiths, S.; Chan, P.K. Willingness of Hong Kong healthcare workers to accept pre-pandemic influenza vaccination at different WHO alert levels: Two questionnaire surveys. BMJ 2009, 339, b3391. [Google Scholar] [CrossRef] [Green Version]
  33. Hotez, P. America and Europe’s new normal: The return of vaccine-preventable diseases. Pediatr. Res. 2019, 85, 912–914. [Google Scholar] [CrossRef]
  34. Jolley, D.; Douglas, K.M. The effects of anti-vaccine conspiracy theories on vaccination intentions. PLoS ONE 2014, 9, e89177. [Google Scholar] [CrossRef]
  35. Burki, T. The online anti-vaccine movement in the age of COVID-19. Lancet Digit. Health 2020, 2, e504–e505. [Google Scholar] [CrossRef]
  36. Johnson, N.F.; Velasquez, N.; Restrepo, N.J.; Leahy, R.; Gabriel, N.; El Oud, S.; Zheng, M.; Manrique, P.; Wuchty, S.; Lupu, Y. The online competition between pro- and anti-vaccination views. Nature 2020, 582, 230–233. [Google Scholar] [CrossRef]
  37. Zhang, M.; Zhou, M.; Tang, F.; Wang, Y.; Nie, H.; Zhang, L.; You, G. Knowledge, attitude, and practice regarding COVID-19 among healthcare workers in Henan, China. J. Hosp. Infect. 2020, 105, 183–187. [Google Scholar] [CrossRef]
  38. Alrubaiee, G.G.; Al-Qalah, T.A.H.; Al-Aawar, M.S.A. Knowledge, attitudes, anxiety, and preventive behaviours towards COVID-19 among health care providers in Yemen: An online cross-sectional survey. BMC Public Health 2020, 20, 1541. [Google Scholar] [CrossRef] [PubMed]
  39. Manuel, D.; Henry, B.; Hockin, J.; Naus, M. Health behavior associated with influenza vaccination among healthcare workers in long-term-care facilities. Infect. Control Hosp. Epidemiol. 2002, 23, 609–614. [Google Scholar] [CrossRef] [PubMed]
  40. Whibley, A. Global surge in measles and major international survey reinforce the need for greater awareness and uptake of all vaccinations. Acta Paediatr. 2020, 109, 1706–1708. [Google Scholar] [CrossRef] [PubMed]
  41. Loskutova, N.Y.; Smail, C.; Callen, E.; Staton, E.W.; Nazir, N.; Webster, B.; Pace, W.D. Effects of multicomponent primary care-based intervention on immunization rates and missed opportunities to vaccinate adults. BMC Fam. Pract. 2020, 21, 1–10. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  42. Gudi, S.K.; Chhabra, M.; Undela, K.; Venkataraman, R.; Mateti, U.V.; Tiwari, K.K.; Nyamagoud, S. Knowledge and beliefs towards universal safety precautions during the coronavirus disease (COVID-19) pandemic among the Indian public: A web-based cross-sectional survey. Drugs Ther. Perspect. 2020, 36, 413–420. [Google Scholar] [CrossRef] [PubMed]
  43. O’Halloran, A.C.; Lu, P.-J.; Williams, W.W.; Schumacher, P.; Sussell, A.; Birdsey, J.; Boal, W.L.; Sweeney, M.H.; Luckhaupt, S.E.; Black, C.L. Influenza vaccination among workers—21 US states, 2013. Am. J. Infect. Control 2017, 45, 410–416. [Google Scholar] [CrossRef] [Green Version]
  44. Centre for Health Protection. Recommendations on Seasonal Influenza Vaccination for the 2020–2021 Season in Hong Kong. 2020. Available online: https://www.chp.gov.hk/files/pdf/recommendations_on_siv_for_2020-21.pdf (accessed on 12 November 2020).
  45. Lazarus, J.V.; Ratzan, S.C.; Palayew, A.; Gostin, L.O.; Larson, H.J.; Rabin, K.; Kimball, S.; El-Mohandes, A. A global survey of potential acceptance of a COVID-19 vaccine. Nat. Med. 2020, 1–4. [Google Scholar] [CrossRef]
Figure 1. Difference in standardized rate of willingness to accept COVID-19 between two surveys.
Figure 1. Difference in standardized rate of willingness to accept COVID-19 between two surveys.
Vaccines 09 00062 g001
Figure 2. Reasons for COVID-19 vaccine refusal or hesitancy in two surveys.
Figure 2. Reasons for COVID-19 vaccine refusal or hesitancy in two surveys.
Vaccines 09 00062 g002
Figure 3. Difference in standardized frequency (usually/always) of personal protection behaviours between two surveys.
Figure 3. Difference in standardized frequency (usually/always) of personal protection behaviours between two surveys.
Vaccines 09 00062 g003
Table 1. Socio-demographical characteristics of participants by willingness to accept COVID-19 vaccine in two surveys.
Table 1. Socio-demographical characteristics of participants by willingness to accept COVID-19 vaccine in two surveys.
CharacteristicsFirst Survey: Willingness to Accept COVID-19 VaccineSecond Survey: Willingness to Accept COVID-19 Vaccine
AcceptRefuseUndecidedp Value 1TotalAcceptRefuseUndecidedp Value 1Total
N%N%N%N%N%N%N%N%
Age
18–2911026.0209.68720.9<0.001 *21720.75315.22712.68118.50.06316116.1
30–3912529.65526.411427.4 29428.18223.65324.79020.6 22522.5
40–4912529.68239.413833.2 34533.08023.06630.710123.1 24724.7
50–594911.64421.26916.6 16215.57922.74822.311626.5 24324.3
60+143.373.481.9 292.85415.5219.84911.2 12412.4
Sex
Male16839.76531.310324.8<0.001 *33632.120558.910850.222651.70.06353953.9
Female25560.314368.831375.2 71167.914341.110749.821148.3 46146.1
Education
Below high school20.531.451.20.170101.0144.083.7235.30.279454.5
High school358.32713.0419.9 1039.88725.06831.610022.9 25525.5
Preparatory5112.13014.46716.1 14814.18123.35123.711426.1 24624.6
University or above33579.214871.230372.8 78675.116647.78840.920045.8 45445.4
Marriage
Unmarried20147.59445.219647.10.85449146.911733.610147.021048.1<0.001 *42842.8
Married/cohabit22252.511454.822052.9 55653.123166.411453.022752.0 57257.2
Occupation
Professionals17340.99947.616840.40.29844042.05014.4177.9368.20.044 *10310.3
Manager/administrator7517.73818.37016.8 18317.54813.82411.25412.4 12612.6
Associate professional11527.24019.210024.0 25524.48023.05827.011726.8 25525.5
Clerical/service/sales worker5513.03014.47217.3 15715.08825.37233.514132.3 30130.1
Blue-collar worker51.210.561.4 121.28223.64420.58920.4 21521.5
Chronic disease
No36385.817986.135485.10.93489685.629885.619490.240091.50.026 *89289.2
Yes6014.22913.96214.9 15114.45014.4219.8378.5 10810.8
Influenza vaccine uptake last year
No30973.119091.435585.3<0.001 *85481.625372.719992.637184.9<0.001 *82382.3
Yes11427.0188.76114.7 19318.49527.3167.46615.1 17717.7
Total423100.0208100.0416100.0 1047100.0348100.0215100.0437100.0 1000100
* p < 0.05. 1 p values are from the Chi-square test or Fisher’s exact tests.
Table 2. Difference in willingness to accept COVID-19 vaccine and frequency of personal protection behaviours between two surveys.
Table 2. Difference in willingness to accept COVID-19 vaccine and frequency of personal protection behaviours between two surveys.
Acceptance of Vaccination/BehavioursFirst SurveySecond Surveyp Value 2
NUnstandardized %Standardized % 1NStandardized % 1
Willingness to accept COVID-19 vaccine
Accept42340.444.234834.8<0.001
Refuse20819.917.321521.5
Undecided41639.738.643743.7
Wearing mask when outside
Never/sometimes484.64.3848.4<0.001
Usually/always99995.495.791691.6
Social distancing
Never/sometimes34332.841.331931.90.001
Usually/always70467.258.768168.1
Using alcohol hand rub
Never/sometimes45743.744.532732.7<0.001
Usually/always59056.455.667367.3
Total1047100.0100.01000100.0
1 Standardized rate in the first survey was calculated based on age, sex and occupational distribution of sample in the second survey. Standardized rate in the second survey was the same as the unstandardized rates because the same sample was used as the reference population. 2 p values are from the Chi-square test.
Table 3. Changes of willingness to accept COVID-19 vaccine and frequency of personal protection behaviours between two surveys.
Table 3. Changes of willingness to accept COVID-19 vaccine and frequency of personal protection behaviours between two surveys.
CharacteristicsCOVID-19 Vaccine Acceptance (Undecided as Reference) 1Usually/Always Wear Mask When Outside1Usually/Always Maintain Social Distance 1Usually/Always Use Alcohol Hand Rub When Outside 1
Accept Refuse
AOR 295%CI 2AOR95% CIAOR95% CIAOR95% CIAOR95% CI
Age
18–29(reference) (reference) (reference) (reference) (reference)
30–390.67 *(0.48, 0.93)1.76 *(1.10, 2.82)0.81(0.44, 1.49)1.08(0.79, 1.47)0.91(0.67, 1.25)
40–490.56 *(0.39, 0.80)3.04 *(1.88, 4.91)1.28(0.64, 2.55)0.87(0.62, 1.21)0.58 *(0.42, 0.81)
50–590.37 *(0.26, 0.53)2.20 *(1.36, 3.56)1.26(0.63, 2.51)0.78(0.56, 1.08)0.41 *(0.29, 0.57)
60+0.70(0.46, 1.08)2.74 *(1.55, 4.82)0.66(0.32, 1.36)0.95(0.64, 1.41)0.58 *(0.39, 0.85)
Sex
Male(reference) (reference) (reference) (reference) (reference)
Female0.71 *(0.57, 0.89)1.04(0.80, 1.35)1.40(0.94, 2.09)1.37 *(1.11, 1.67)1.60 *(1.31, 1.97)
Marriage
Unmarried(reference) (reference) (reference) (reference) (reference)
Married/cohabit1.69 *(1.33, 2.14)0.75 *(0.58, 0.98)0.80(0.52, 1.22)1.49 *(1.21, 1.85)1.63 *(1.32, 2.02)
Chronic disease
No(reference) (reference) (reference) (reference) (reference)
Yes1.07(0.80, 1.44)1.17(0.82, 1.67)0.56*(0.35, 0.89)0.88(0.67, 1.14)0.93(0.72, 1.21)
Influenza vaccine uptake last year
No(reference) (reference) - - -
Yes2.25 *(1.74, 2.93)0.42 *(0.27, 0.66)- - -
Occupation
Professionals(reference) (reference) (reference) (reference) (reference)
Manager/administrator0.81(0.53, 1.25)0.70(0.42, 1.16)0.79(0.35, 1.81)1.01(0.68, 1.51)2.08 *(1.41, 3.07)
Associate professional0.77(0.53, 1.12)0.82(0.52, 1.29)0.67(0.33, 1.37)0.95(0.67, 1.34)1.27(0.91, 1.77)
Clerical/service/sales worker0.62 *(0.43, 0.91)0.68(0.44, 1.06)0.70(0.34, 1.44)0.93(0.66, 1.32)1.36(0.97, 1.89)
Blue-collar worker0.76(0.52, 1.13)0.52 *(0.32, 0.86)0.69(0.33, 1.45)0.54 *(0.37, 0.77)1.47 *(1.03, 2.10)
Wave of local epidemic
First wave (first survey)(reference) (reference) (reference) (reference) (reference)
Third wave (second survey)0.68 *(0.56, 0.84)1.12(0.88, 1.44)0.47 *(0.32, 0.69)1.54 *(1.27, 1.86)1.67 *(1.39, 2.02)
* p < 0.05. 1 In these regressions, the sample of the first survey was adjusted based on age, sex and occupational distribution of the sample in the second survey. 2 AOR: adjusted odds ratio; CI: confidence interval.
Table 4. Reasons for COVID-19 vaccine refusal or hesitancy among different occupations in two surveys.
Table 4. Reasons for COVID-19 vaccine refusal or hesitancy among different occupations in two surveys.
OccupationsDoubt of EffectivenessVaccine Is UnnecessaryNo Time to UptakeWorried About SafetyTotal
NoYesNoYesNoYesNoYes
First survey (standardized N (%)) 1
Professional 25 (40.3)37 (59.7)43 (69.1)19 (30.9)56 (91.6)5 (8.4)59 (96.1)2 (3.9)62 (100)
Manager/administrator35 (46.4)41 (53.6)50 (65.8)26 (34.2)76 (99.2)1 (0.8)69 (90.1)8 (9.9)76 (100)
Associate professional44 (34.3)85 (65.7)95 (73.7)34 (26.3)123 (95.3)6 (4.7)120 (93.1)9 (6.9)129 (100)
Clerical/service/sale worker79 (38.8)125 (61.2)147 (71.7)58 (28.4)189 (92.6)15 (7.4)198 (96.7)7 (3.3)205 (100)
Blue-collar worker22 (25)66 (75.1)88 (100)0 (0)88 (100)0 (0)88 (100)0 (0)88 (100)
p value 20.0580.031 *,30.300 30.012 *,3
Total206 (36.8)354 (63.2)423 (75.5)137 (24.5)533 (95.2)27 (4.8)534 (95.4)26 (4.6)560 (100)
Second survey (N (%))
Professional38 (71.7)15 (28.3)43 (81.1)10 (18.9)50 (94.3)3 (5.7)11 (20.8)42 (79.3)53 (100.0)
Manager/administrator50 (64.1)28 (35.9)68 (87.2)10 (12.8)73 (93.6)5 (6.4)15 (19.2)63 (80.8)78 (100.0)
Associate professional118 (67.4)57 (32.6)143 (81.7)32 (18.3)169 (96.6)6 (3.4)29 (16.6)146 (83.4)175 (100.0)
Clerical/service/sale worker150 (70.4)63 (29.6)155 (72.8)58 (27.2)206 (96.7)7 (3.3)53 (24.9)160 (75.1)213 (100.0)
Blue-collar worker98 (73.7)35 (26.3)98 (73.7)35 (26.3)117 (88)16 (12)33 (24.8)100 (75.2)133 (100.0)
p value 20.6040.036 *0.007 *0.282
Total454 (69.6)198 (30.4)507 (77.8)145 (22.2)615 (94.3)37 (5.7)141 (21.6)511 (78.4)652 (100)
* p < 0.05. 1 Count and proportions of the first survey were adjusted based on age, sex and occupational distribution of the sample in the second survey. Some numbers did not add up to a total number due to rounding of decimals. 2 p values are from the Chi-square test or Fisher’s exact tests. 3 Due to zero count in cells, these p values were calculated by combining clerical/service/sale workers and blue-collar workers into one group.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Wang, K.; Wong, E.L.-Y.; Ho, K.-F.; Cheung, A.W.-L.; Yau, P.S.-Y.; Dong, D.; Wong, S.Y.-S.; Yeoh, E.-K. Change of Willingness to Accept COVID-19 Vaccine and Reasons of Vaccine Hesitancy of Working People at Different Waves of Local Epidemic in Hong Kong, China: Repeated Cross-Sectional Surveys. Vaccines 2021, 9, 62. https://doi.org/10.3390/vaccines9010062

AMA Style

Wang K, Wong EL-Y, Ho K-F, Cheung AW-L, Yau PS-Y, Dong D, Wong SY-S, Yeoh E-K. Change of Willingness to Accept COVID-19 Vaccine and Reasons of Vaccine Hesitancy of Working People at Different Waves of Local Epidemic in Hong Kong, China: Repeated Cross-Sectional Surveys. Vaccines. 2021; 9(1):62. https://doi.org/10.3390/vaccines9010062

Chicago/Turabian Style

Wang, Kailu, Eliza Lai-Yi Wong, Kin-Fai Ho, Annie Wai-Ling Cheung, Peter Sen-Yung Yau, Dong Dong, Samuel Yeung-Shan Wong, and Eng-Kiong Yeoh. 2021. "Change of Willingness to Accept COVID-19 Vaccine and Reasons of Vaccine Hesitancy of Working People at Different Waves of Local Epidemic in Hong Kong, China: Repeated Cross-Sectional Surveys" Vaccines 9, no. 1: 62. https://doi.org/10.3390/vaccines9010062

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop