<?xml version='1.0' encoding='UTF-8'?><xml><records><record><source-app name="HighWire" version="7.x">Drupal-HighWire</source-app><ref-type name="Journal Article">17</ref-type><contributors><authors><author><style face="normal" font="default" size="100%">Burstein, Roy</style></author><author><style face="normal" font="default" size="100%">Sowe, Alieu</style></author><author><style face="normal" font="default" size="100%">Danovaro-Holliday, M. Carolina</style></author><author><style face="normal" font="default" size="100%">Koh, Mitsuki</style></author><author><style face="normal" font="default" size="100%">Proctor, Joshua L.</style></author></authors><secondary-authors></secondary-authors></contributors><titles><title><style face="normal" font="default" size="100%">Automating Handwritten Vaccination Record Transcription with Generative Multimodal AI Models: A Proof of Concept Study from The Gambia</style></title><secondary-title><style face="normal" font="default" size="100%">medRxiv</style></secondary-title></titles><dates><year><style  face="normal" font="default" size="100%">2025</style></year><pub-dates><date><style  face="normal" font="default" size="100%">2025-01-01 00:00:00</style></date></pub-dates></dates><elocation-id><style  face="normal" font="default" size="100%">2025.07.08.25329577</style></elocation-id><doi><style  face="normal" font="default" size="100%">10.1101/2025.07.08.25329577</style></doi><volume><style face="normal" font="default" size="100%"></style></volume><issue><style face="normal" font="default" size="100%"></style></issue><abstract><style  face="normal" font="default" size="100%">Background Handwritten home-based vaccination records (HBRs) are a vital source of immunization data, yet manual transcription in household surveys is time-consuming, error-prone, and resource-intensive. Recent advances in multimodal generative AI models offer a potential pathway to partially automate this task under certain conditions, improving efficiency while maintaining data quality.Methods We evaluated the performance of generative multimodal AI models, specifically OpenAI’s GPT-4o, in transcribing handwritten vaccination cards from a 2022 survey targeting children aged 12 - 35 months in The Gambia. Using a curated dataset of 335 cards (6,700 vaccination entries), we developed a gold-standard benchmark from three human transcribers (all of them in The Gambia) and assessed AI model performance across transcription accuracy, vaccination coverage estimates, timeliness, and missed opportunities for simultaneous vaccination (MOSV). We also tested a confidence-based segmentation approach to identify high-confidence transcriptions suitable for automation versus low-confidence entries requiring human review.Results The fine-tuned GPT-4o model achieved 79% accuracy for exact date transcription and reached human-level performance (94% accuracy) on 69% of entries classified by the AI as high-confidence. Coverage and timeliness estimates from high-confidence transcriptions were 98.0% and 91.6% accurate, respectively, compared to 98.8% and 95.6% from human transcribers. Date errors by AI and humans differ systematically, with AI showing fewer year-shift errors.Conclusion Multimodal AI models show strong potential for automating HBR transcription in immunization coverage surveys, at least in a setting like The Gambia. When paired with confidence-based filtering, these models achieve human-level performance on coverage and timeliness estimates—the key metrics used in programmatic decision-making—across a large subset of records. This enables substantial gains in efficiency while preserving data quality. Further research should evaluate generalizability across diverse card formats, languages, and contexts to support integration into real-world immunization programs and health monitoring activities.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThis study did not receive any funding.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:This study utilised data from an operational study conducted in The Gambia. That study was approved by the Scientific Coordinating Committee of the Medical Research Council Unit The Gambia at the London School of Hygiene and Tropical Medicine and The Gambia Government/MRCG Joint Ethics Committee (Project ID/Ethics ref: 27860). The present study was cleared by the University of The Gambia Research Ethics Committee (UTGREC) (Ethics ref:UTG-REC/09/2024/0047).I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.Yes</style></abstract></record></records></xml>