PT  - JOURNAL ARTICLE
AU  - Sofia de la Fuente Garcia
AU  - Fasih Haider
AU  - Saturnino Luz
TI  - COVID-19: Affect recognition through voice analysis during the winter lockdown in Scotland
AID  - 10.1101/2021.05.05.21256668
DP  - 2021 Jan 01
TA  - medRxiv
PG  - 2021.05.05.21256668
4099  - http://medrxiv.org/content/early/2021/05/09/2021.05.05.21256668.short
4100  - http://medrxiv.org/content/early/2021/05/09/2021.05.05.21256668.full
AB  - The COVID-19 pandemic has led to unprecedented restrictions in people’s lifestyle which have affected their psychological wellbeing. In this context, this paper investigates the use of social signal processing techniques for remote assessment of emotions. It presents a machine learning method for affect recognition applied to recordings taken during the COVID-19 winter lockdown in Scotland (UK). This method is exclusively based on acoustic features extracted from voice recordings collected through home and mobile devices (i.e. phones, tablets), thus providing insight into the feasibility of monitoring people’s psychological wellbeing remotely, automatically and at scale. The proposed model is able to predict affect with a concordance correlation coefficient of 0.4230 (using Random Forest) and 0.3354 (using Decision Trees) for arousal and valence respectively.Clinical relevance In 2018/2019, 12% and 14% of Scottish adults reported depression and anxiety symptoms. Remote emotion recognition through home devices would support the detection of these difficulties, which are often underdiagnosed and, if untreated, may lead to temporal or chronic disability.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThis research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:Ethical approval for this research was obtained on June 15, 2020 by East Midlands UK - Leicester South Research Ethics Committee (REC reference: 20/EM/0146)All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesPsychological data and enhanced acoustic data may be available upon request (institutional ethical approval for the proposed research will be required).