ABSTRACT
Objective Aifred is an artificial intelligence (AI)-powered clinical decision support system (CDSS) for the treatment of major depression. Here, we explore use of a simulation centre environment in evaluating the usability of Aifred, particularly its impact on the physician-patient interaction.
Methods Twenty psychiatry and family medicine attending staff and residents were recruited to complete a 2.5-hour study at a clinical interaction simulation centre with standardized patients. Each physician had the option of using the CDSS to inform their treatment choice in three 10-minute clinical scenarios with standardized patients portraying mild, moderate, and severe episodes of major depression. Feasibility and acceptability data were collected through self-report questionnaires, scenario observations, interviews, and standardized patient feedback.
Results All twenty participants completed the study. Initial results indicate that the tool was acceptable to clinicians and feasible for use during clinical encounters. Clinicians indicated a willingness to use the tool in real clinical practice, a significant degree of trust in the AI’s predictions to assist with treatment selection, and reported that the tool helped increase patient understanding of and trust in treatment. The simulation environment allowed for the evaluation of the tool’s impact on the physician-patient interaction.
Conclusions The simulation centre allowed for direct observations of clinician use and impact of the tool on the clinician-patient interaction prior to clinical studies. It may therefore offer a useful and important environment in the early testing of new technological tools. The present results will inform further tool development and clinician training materials.
Competing Interest Statement
David Benrimoh, Myriam Tanguay-Sela, Kelly Perlman, Sonia Israel, Joseph Mehltretter, Caitrin Armstrong, Robert Fratila, Colleen Rollins and Marc Miresco are shareholders, employees, or directors of Aifred Health. Christina Popescu, Eryn Lundrigan, Emily Snook, Marina Wakid, Jérôme Williams, Ghassen Soufi, Tamara Perez and Katherine Rosenfeld were research assistants paid by Aifred Health. Sagar Parikh, Jordan Karp and Katherine Heller are members of Aifred Health’s scientific advisory board and either have or may in the near future receive shares in the company. Howard Margolese has received honoraria, sponsorship or grants for participation in speaker bureaus, consultation, advisory board meetings and clinical research from Acadia, Amgen, HLS Therapeutics, Janssen-Ortho, Mylan, Otsuka-Lundbeck, Perdue, Pfizer, Shire and SyneuRx International. All other authors report no relevant conflicts.
Funding Statement
Use of the simulation centre and the work of the SPs was provided as part of the prize for a clinical innovation competition run by McGill University and the Steinberg Centre for Simulation and Interactive Learning, with the generous support of the Hakim family. Research assistants, software, and participant compensation was provided by Aifred Health. The Canadian Federal Government’s Youth Employment Program also provided a grant to support this work.
Author Declarations
All relevant ethical guidelines have been followed; any necessary IRB and/or ethics committee approvals have been obtained and details of the IRB/oversight body are included in the manuscript.
Yes
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
Compliance with ethical standards and ethical considerations: This study was approved by the Research Ethics Board of the Douglas Mental Health University Institute. All participants, including standardized patients, provided written informed consent to participate. The study was conducted in accordance with the Tri-Council Statement on research ethics.
Disclosure: David Benrimoh, Myriam Tanguay-Sela, Kelly Perlman, Sonia Israel, Joseph Mehltretter, Caitrin Armstrong, Robert Fratila, Colleen Rollins and Marc Miresco are shareholders, employees, or directors of Aifred Health. Christina Popescu, Eryn Lundrigan, Emily Snook, Marina Wakid, Jérôme Williams, Ghassen Soufi, Tamara Perez and Katherine Rosenfeld were research assistants paid by Aifred Health. Sagar Parikh, Jordan Karp and Katherine Heller are members of Aifred Health’s scientific advisory board and either have or may in the near future receive shares in the company. Howard Margolese has received honoraria, sponsorship or grants for participation in speaker bureaus, consultation, advisory board meetings and clinical research from Acadia, Amgen, HLS Therapeutics, Janssen-Ortho, Mylan, Otsuka-Lundbeck, Perdue, Pfizer, Shire and SyneuRx International. All other authors report no relevant conflicts.
Funding sources: Use of the simulation centre and the work of the SPs was provided as part of the prize for a clinical innovation competition run by McGill University and the Steinberg Centre for Simulation and Interactive Learning, with the generous support of the Hakim family. Research assistants, software, and participant compensation was provided by Aifred Health. The Canadian Federal Government’s Youth Employment Program also provided a grant to support this work.
Data Availability
The data is not currently publicly available.