TY - JOUR T1 - Financial interests and evidence in public comments on the FDA framework for modifications to artificial intelligence/machine learning-based medical devices JF - medRxiv DO - 10.1101/2019.12.11.19013953 SP - 2019.12.11.19013953 AU - James A. Smith AU - Roxanna E. Abhari AU - Zain U. Hussain AU - Carl Henegan AU - Gary S. Collins AU - Andrew J. Carr Y1 - 2019/01/01 UR - http://medrxiv.org/content/early/2019/12/14/2019.12.11.19013953.abstract N2 - The US Food and Drug Administration (FDA) has proposed a regulatory framework for modifications to artificial intelligence/machine learning-based software as a medical device (SaMD). We analysed the 125 non-duplicate and non-spam public comments on the proposed framework and found that industry and other parties with a potential financial interest contributed a minimum of 63% of comments and that the absence of a conflict of interest could be confirmed in only 8%. Despite the FDA’s stated commitment to using scientific evidence in the rule-making process, the vast majority of submitted comments (86%) did not cite any scientific literature, just 4% cited a systematic review or meta-analysis, and no comments indicated whether a systematic process was used to identify relevant literature. We recommend that the FDA requires disclosure of conflicts of interest in comments in the future. As the framework continues to be modified, engagement from non-conflicted parties and better use of scientific evidence may help to ensure the development of a regulatory system that best promotes patient interests.Competing Interest StatementDr. Smith reports personal fees from Biolacuna Ltd, personal fees from IP Asset Ventures Ltd, outside the submitted work; and he is part of the Carr Group at the University of Oxford, which is developing medical devices. He receives funding from the National Institute for Health Research (NIHR) Oxford Biomedical Research Centre (BRC). Dr. Abhari has nothing to disclose. Mr. Hussain has nothing to disclose. Dr. Heneghan reports he has received expenses and fees for his media work, expenses from the WHO and holds grant funding from the NIHR Oxford BRC and the NIHR School of Primary Care Research Evidence Synthesis Working Group [Project 390]. He has received financial remuneration from an asbestos case. He receives expenses for teaching EBM and is also paid for his GP work in NHS out of hours. He is Director of the CEBM at the University of Oxford, Editor in Chief of BMJ Evidence-Based Medicine and an NIHR Senior Investigator. Dr. Collins reports grants from Cancer Research Programme Grant (C49297/A27294), grants from NIHR Oxford BRC, grants from Medical Research Council (MR/S036741/1), outside the submitted work. Dr. Carr reports grants from NIHR Biomedical Research Centre, grants from NIHR BioPatch i4i, grants from Wellcome Trust BioYarn, grants from Novartis, outside the submitted work; In addition, Dr. Carr has a patent for Oxford Yarn issued, and a patent for Oxford Patch issued.Funding StatementThe authors did not receive payment or services from a third party for any aspect of the submitted work.Author DeclarationsAll relevant ethical guidelines have been followed; any necessary IRB and/or ethics committee approvals have been obtained and details of the IRB/oversight body are included in the manuscript.YesAll necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThe data, code, and data collection protocol are available on open science framework. https://osf.io/g423d/ ER -