Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

The Project for Objective Measures Using Computational Psychiatry Technology (PROMPT): Rationale, Design, and Methodology

View ORCID ProfileTaishiro Kishimoto, Akihiro Takamiya, Kuo-ching Liang, Kei Funaki, Takanori Fujita, Momoko Kitazawa, Michitaka Yoshimura, Yuki Tazawa, Toshiro Horigome, Yoko Eguchi, Toshiaki Kikuchi, Masayuki Tomita, Shogyoku Bun, Junichi Murakami, Brian Sumali, Tifani Warnita, Aiko Kishi, Mizuki Yotsui, Hiroyoshi Toyoshiba, Yasue Mitsukura, Koichi Shinoda, Yasubumi Sakakibara, Masaru Mimura on behalf of the PROMPT collaborators
doi: https://doi.org/10.1101/19013011
Taishiro Kishimoto
1Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Taishiro Kishimoto
  • For correspondence: taishiro-k@mti.biglobe.ne.jp
Akihiro Takamiya
1Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kuo-ching Liang
1Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kei Funaki
1Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Takanori Fujita
2Department of Health Policy and Management, Keio University, Tokyo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Momoko Kitazawa
1Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Michitaka Yoshimura
1Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Yuki Tazawa
1Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Toshiro Horigome
1Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Yoko Eguchi
1Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Toshiaki Kikuchi
1Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Masayuki Tomita
3Oizumi Hospital, Tokyo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Shogyoku Bun
4Sato Hospital, Yamagata, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Junichi Murakami
5Biwako Hospital, Shiga, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Brian Sumali
6Department of System Design Engineering, Keio University, Kanagawa, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tifani Warnita
7Department of Computer Science, School of Computing, Tokyo Institute of Technology, Tokyo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Aiko Kishi
6Department of System Design Engineering, Keio University, Kanagawa, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mizuki Yotsui
8Department of Biosciences and Informatics, Keio University, Kanagawa, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Hiroyoshi Toyoshiba
9Center for Systems Medicine, Keio University, Tokyo Japan
10FRONTEO, Inc., Tokyo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Yasue Mitsukura
6Department of System Design Engineering, Keio University, Kanagawa, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Koichi Shinoda
7Department of Computer Science, School of Computing, Tokyo Institute of Technology, Tokyo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Yasubumi Sakakibara
8Department of Biosciences and Informatics, Keio University, Kanagawa, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Masaru Mimura
1Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Background Depressive and neurocognitive disorders are debilitating conditions that account for the leading causes of years lived with disability worldwide. Overcoming these disorders is an extremely important public health problem today. However, there are no biomarkers that are objective or easy-to-obtain in daily clinical practice, which leads to difficulties in assessing treatment response and developing new drugs. Due to advances in technology, it has become possible to quantify important features that clinicians perceive as reflective of disorder severity. Such features include facial expressions, phonic/speech information, body motion, daily activity, and sleep. The overall goal of this proposed study, the Project for Objective Measures Using Computational Psychiatry Technology (PROMPT), is to develop objective, noninvasive, and easy-to-use biomarkers for assessing the severity of depressive and neurocognitive disorders.

Methods This is a multi-center prospective study. DSM-5 criteria for major depressive disorder, bipolar disorder, and major and minor neurocognitive disorders are inclusion criteria for the depressive and neurocognitive disorder samples. Healthy samples are confirmed to have no history of psychiatric disorders by Mini-International Neuropsychiatric Interview, and have no current cognitive decline based on the Mini Mental State Examination. Participants go through approximately 10-minute interviews with a psychiatrist/psychologist, where participants talk about non-specific topics such as everyday living, symptoms of disease, hobbies, etc. Interviews are recorded using RGB and infrared cameras, and an array microphone. As an option, participants are asked to wear wrist-band type devices during the observational period. The interviews take place ≤10 times within up to five years of follow-up. Various software is used to process the raw video, voice, infrared, and wearable device data. A machine learning approach is used to predict the presence of symptoms, severity, and the improvement/deterioration of symptoms.

Discussion The PROMPT goal is to develop objective digital biomarkers for assessing the severity of depressive and neurocognitive disorders in the hopes of guiding decision-making in clinical settings as well as reducing the risk of clinical trial failure. Challenges may include the large variability of samples, which makes it difficult to extract the features that commonly reflect disorder severity.

Trial Registration UMIN000021396, University Hospital Medical Information Network (UMIN)

Competing Interest Statement

All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf and declare: no support from any organization for the submitted work; T. Kishimoto reports personal fees from Otsuka, Pfizer, and Dainippon Sumitomo, Banyu, Eli Lilly, Dainippon Sumitomo, Janssen, Novartis, Otsuka, and Pfizer; KF reports personal fees from Novartis and Mochida, non-financial support from Otsuka; HT is an employee of FRONTEO; TH reports personal fees from Yoishitomi; T. Kikuchi has reports personal fees from Astellas, Dainippon Sumitomo, Eli Lilly, Janssen, MSD, Otsuka, Yoshitomi Yakuhin, Pfizer, and Takeda; JM reports personal fees from Eli Lilly, Janssen, Otsuka, MSD, Shionogi, and Pfizer; MM reports personal fees from Daiichi Sankyo, Dainippon-Sumitomo Pharma, Eisai, Eli Lilly, Fuji Film RI Pharma, Janssen Pharmaceutical, Mochida Pharmaceutical, MSD, Nippon Chemipher, Novartis Pharma, Ono Yakuhin, Otsuka Pharmaceutical, Pfizer, Takeda Yakuhin, Tsumura, and Yoshitomi Yakuhin, and he received grants from Daiichi Sankyo, Eisai, Pfizer, Shionogi, Takeda, Tanabe Mitsubishi, and Tsumura. Other authors have no conflict of interest; no other relationships or activities that could appear to have influenced the submitted work.

Clinical Trial

UMIN000021396

Clinical Protocols

https://upload.umin.ac.jp/cgi-open-bin/ctr/ctr_view.cgi?recptno=R000024677

https://upload.umin.ac.jp/cgi-open-bin/ctr/ctr_view.cgi?recptno=R000027146

Funding Statement

This research is supported by the Japan Agency for Medical Research and Development (AMED) under Grant Number JP18he1102004. The Grant was awarded on Oct. 29, 2015 and ends on Mar. 31, 2019. The funding source did not participate in the design of this study and will not have any hand in the study’s execution, analyses, or submission of results. Japan Agency for Medical Research and Development (AMED) 20F Yomiuri Shimbun Bldg. 1-7-1 Otemachi, Chiyoda-ku, Tokyo 100-0004 Japan Tel: +81-3-6870-2200, Fax: +81-3-6870-2241, Email: jimu-ask@amed.go.jp

Author Declarations

All relevant ethical guidelines have been followed; any necessary IRB and/or ethics committee approvals have been obtained and details of the IRB/oversight body are included in the manuscript.

Yes

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

Not applicable.

  • Abbreviations

    UMIN
    University Hospital Medical Information Network
    UI
    uncertainty interval
    YLDs
    years lived with disability
    HAM-D
    Hamilton Depression Rating Scale
    MADRS
    Montgomery-Asberg Depression Rating Scale
    PET
    positron emission tomography
    MRI
    magnetic resonance imaging
    MCI
    mild cognitive impairment
    MMSE
    Mini-Mental State Examination
    MoCA
    Montreal Cognitive Assessment
    PROMPT
    Project for Objective Measures Using Computational Psychiatry Technology
    AMED
    Japan Agency for Medical Research and Development
    DSM-5
    Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition
    SCID
    Structural Clinical Interview for DSM-5
    M.I.N.I.
    Mini-International Neuropsychiatric Interview
    RGB
    red, green, blue
    UV
    ultraviolet
    ISO
    International Organization for Standardization
    FedRAMP
    Federal Risk and Authorization Management Program
    IEC
    International Electrotechnical Commission
    BDI-II
    Beck Depression Inventory, Second Edition
    F0
    fundamental frequency
    F1, F2, F3
    first, second, and third formant frequencies
    CPP
    cepstral peak prominence
    MFCC
    mel-frequency cepstrum coefficients
    SVR
    Support Vector Regression
    SVM
    Support Vector Machine
    RF
    Random Forest
    Adaboost
    Adaptive Boosting
    Adabag
    Adaptive Bagging
    CNN
    Convolutional Neural Networks
    GCN
    Gated Convolutional Neural Networks
    BNN
    Bayesian Neural Networks
    LSTM
    Long Short-Term Memory Networks
    MARS
    Motor Agitation and Retardation Scale
    MDD
    Major depressive disorder
    BD
    Bipolar disorder
    YMRS
    Young Mania Rating Scale
    PSQI
    Pittsburgh Sleep Quality Index
    CDR
    Clinical Dementia Rating
    LM
    Wechsler Memory Scale-Revised Logical Memory
    CDT
    Clock Drawing Test
    NPI
    Neuropsychiatric Inventory
    GDS
    Geriatric Depression Scale
  • Copyright 
    The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
    Back to top
    PreviousNext
    Posted November 29, 2019.
    Download PDF

    Supplementary Material

    Data/Code
    Email

    Thank you for your interest in spreading the word about medRxiv.

    NOTE: Your email address is requested solely to identify you as the sender of this article.

    Enter multiple addresses on separate lines or separate them with commas.
    The Project for Objective Measures Using Computational Psychiatry Technology (PROMPT): Rationale, Design, and Methodology
    (Your Name) has forwarded a page to you from medRxiv
    (Your Name) thought you would like to see this page from the medRxiv website.
    CAPTCHA
    This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
    Share
    The Project for Objective Measures Using Computational Psychiatry Technology (PROMPT): Rationale, Design, and Methodology
    Taishiro Kishimoto, Akihiro Takamiya, Kuo-ching Liang, Kei Funaki, Takanori Fujita, Momoko Kitazawa, Michitaka Yoshimura, Yuki Tazawa, Toshiro Horigome, Yoko Eguchi, Toshiaki Kikuchi, Masayuki Tomita, Shogyoku Bun, Junichi Murakami, Brian Sumali, Tifani Warnita, Aiko Kishi, Mizuki Yotsui, Hiroyoshi Toyoshiba, Yasue Mitsukura, Koichi Shinoda, Yasubumi Sakakibara, Masaru Mimura
    medRxiv 19013011; doi: https://doi.org/10.1101/19013011
    Digg logo Reddit logo Twitter logo Facebook logo Google logo LinkedIn logo Mendeley logo
    Citation Tools
    The Project for Objective Measures Using Computational Psychiatry Technology (PROMPT): Rationale, Design, and Methodology
    Taishiro Kishimoto, Akihiro Takamiya, Kuo-ching Liang, Kei Funaki, Takanori Fujita, Momoko Kitazawa, Michitaka Yoshimura, Yuki Tazawa, Toshiro Horigome, Yoko Eguchi, Toshiaki Kikuchi, Masayuki Tomita, Shogyoku Bun, Junichi Murakami, Brian Sumali, Tifani Warnita, Aiko Kishi, Mizuki Yotsui, Hiroyoshi Toyoshiba, Yasue Mitsukura, Koichi Shinoda, Yasubumi Sakakibara, Masaru Mimura
    medRxiv 19013011; doi: https://doi.org/10.1101/19013011

    Citation Manager Formats

    • BibTeX
    • Bookends
    • EasyBib
    • EndNote (tagged)
    • EndNote 8 (xml)
    • Medlars
    • Mendeley
    • Papers
    • RefWorks Tagged
    • Ref Manager
    • RIS
    • Zotero
    • Tweet Widget
    • Facebook Like
    • Google Plus One

    Subject Area

    • Psychiatry and Clinical Psychology
    Subject Areas
    All Articles
    • Addiction Medicine (216)
    • Allergy and Immunology (495)
    • Anesthesia (106)
    • Cardiovascular Medicine (1096)
    • Dentistry and Oral Medicine (196)
    • Dermatology (141)
    • Emergency Medicine (274)
    • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (502)
    • Epidemiology (9773)
    • Forensic Medicine (5)
    • Gastroenterology (481)
    • Genetic and Genomic Medicine (2313)
    • Geriatric Medicine (223)
    • Health Economics (462)
    • Health Informatics (1561)
    • Health Policy (736)
    • Health Systems and Quality Improvement (603)
    • Hematology (238)
    • HIV/AIDS (504)
    • Infectious Diseases (except HIV/AIDS) (11650)
    • Intensive Care and Critical Care Medicine (617)
    • Medical Education (238)
    • Medical Ethics (67)
    • Nephrology (257)
    • Neurology (2144)
    • Nursing (134)
    • Nutrition (337)
    • Obstetrics and Gynecology (427)
    • Occupational and Environmental Health (518)
    • Oncology (1180)
    • Ophthalmology (364)
    • Orthopedics (128)
    • Otolaryngology (220)
    • Pain Medicine (146)
    • Palliative Medicine (50)
    • Pathology (311)
    • Pediatrics (695)
    • Pharmacology and Therapeutics (300)
    • Primary Care Research (267)
    • Psychiatry and Clinical Psychology (2182)
    • Public and Global Health (4661)
    • Radiology and Imaging (778)
    • Rehabilitation Medicine and Physical Therapy (457)
    • Respiratory Medicine (624)
    • Rheumatology (274)
    • Sexual and Reproductive Health (226)
    • Sports Medicine (210)
    • Surgery (252)
    • Toxicology (43)
    • Transplantation (120)
    • Urology (94)