Abstract
Background Disasters and other community-wide events can introduce significant interruptions and trauma to impacted communities. Children and young people can be disproportionately affected with additional educational disruptions. With the increasing threat of climate change, establishing a timely and adaptable framework to evaluate the impact of disasters on academic achievement is needed. However, analytical challenges are posed by the availability issue of individual-level data.
Methods A new method, Bayesian hierarchical meta-regression, was developed to evaluate the impact of the 2014 Hazelwood mine fire (a six-week fire event in Australia) using only aggregated school-level data from the standardised National Assessment Program-Literacy and Numeracy (NAPLAN) test. NAPLAN results and school characteristics (2008-2018) from 69 primary/secondary schools with different levels of mine fire-related smoke exposure were used to estimate the impact of the event. Using an interrupted time-series design, the model estimated immediate effects and post-interruption trend differences with full Bayesian statistical inference.
Results Major academic interruptions across NAPLAN domains were evident in high exposure schools in the year post-mine fire (highest in Writing: 11.09 [95%CI: 3.16-18.93], lowest in Reading: 8.34 [95%CI: 1.07-15.51]). The interruption was comparable to a three to four-month delay in educational attainment and had not fully recovered after several years.
Conclusions Considerable academic delays were found as a result of a mine fire, highlighting the need to provide educational and community-based supports in response to future events. Importantly, this work provides a statistical method using readily available aggregated data to assess the educational impacts in response to other disasters.
Key Messages
Although disasters impose substantial impacts on children and young people through many factors including trauma, illness, prolonged school interruption and reduced social support, population-level impact evaluation study is rare.
This study provides an innovative method to evaluate the impact of disasters on students’ academic performance using only readily accessible aggregated school-level data.
Results suggest that a community-wide traumatic event, where immediate risk to life and property was minimal, can still have considerable and long-term educational impacts.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
This work was funded by the Victorian Department of Health and Human Services. The paper presents the views of the authors and does not represent the views of the Department.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
All procedure of the study was approved by the Monash University Human Research Ethics (project number: 5834) and the Victorian Department of Education and Training.
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Data Availability
The data underlying this article were provided by Australian, Curriculum, Assessment and Reporting Authority (ACARA). Data will be shared on request to the corresponding author with the permission of ACARA. However, a synthetically generated data set based on the source data for the tutorial part of the paper is available at https://github.com/CarolineXGao/NAPLAN_impact.