Kang, Sun, Kim, Jung, Kim, Lee, Park, Tu, Lee, Choi, and Cho: Design and Methods of a Prospective Smartphone App-Based Study for Digital Phenotyping of Mood and Anxiety Symptoms Mixed With Centralized and Decentralized Research Form: The Search Your Mind (S.Y.M., 心) Project

Abstract

In this study, the Search Your Mind (S.Y.M., 心) project aimed to collect prospective digital phenotypic data centered on mood and anxiety symptoms across psychiatric disorders through a smartphone application (app) platform while using both centralized and decentralized research designs: the centralized research design is a hybrid of a general prospective observational study and a digital platform-based study, and it includes face-to-face research such as informed written consent, clinical evaluation, and blood sampling. It also includes digital phenotypic assessment through an application-based platform using wearable devices. Meanwhile, the decentralized research design is a non-face-to-face study in which anonymous participants agree to electronic informed consent forms on the app. It also exclusively uses an application-based platform to acquire individualized digital phenotypic data. We expect to collect clinical, biological, and digital phenotypic data centered on mood and anxiety symptoms, and we propose a possible model of centralized and decentralized research design.

INTRODUCTION

The vast majority of people experience mood and anxiety problems, including a broad spectrum of affective states such as depression, anxiety, fear, anger, excitement, and elation. Among such affective problems, anxiety and manic-depressive issues are expressed as independent compartmentalized psychiatric disorders [1]. According to the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5), pathological anxiety and manic-depressive problems can be classified as anxiety disorders, depressive disorders, or bipolar and related disorders [2].
The lifetime prevalence of anxiety disorder and mood disorder are about 10% and 15%, respectively [3-5]. Among anxiety symptoms, panic attacks are unique symptoms characterized by a sudden onset of intense fear and anxiety that peaks within minutes, as well as repeated physical symptoms such as palpitations, dizziness, nausea, or sweating. While the prevalence has been gradually increasing in recent years, the prevalence and lifetime prevalence of panic disorder are 2%–5% and 7%–8%, respectively [6]. In addition, it has been reported that rates of mood symptoms such as anxiety (6.3%–50.9%) and depression (14.6%–48.3%) have significantly increased since the outbreak of coronavirus disease (COVID-19) [7].
The DSM-5 presents a categorical diagnostic system that comprehensively considers the several cardinal symptoms for each psychiatric disorder, including symptoms related to mood, anxiety, cognition, perception, sleep, and energy. The DSM diagnostic system has been criticized as having various limitations, including its heterogeneity of symptoms within the same diagnosis, common coexisting psychiatric diagnoses within individuals, and clinicians’ individual subjectivity can easily influence each diagnosis process [8,9]. Plus, multidimensional and integrated evaluations for diagnosis in the clinical field of psychiatry are often not properly performed, because it is difficult to separately measure numerous factors in psychiatry. Although the DSM system has separate diagnoses for mood and anxiety disorders, it is still a challenge for clinicians to differentiate such disorders in clinical settings, since mood and anxiety disorders share similar clinical symptoms across various psychiatric disorders. Therefore, a transdiagnostic approach focusing on the clinical symptoms of mood and anxiety can better reflect the actual clinical setting, rather than an approach based on the diagnosis of each mood and anxiety-related disease.
Mood and anxiety symptoms are affected by various and complex factors ranging from genetic predisposition to lifestyle, psychological distress, trauma, and environmental factors [10-12]. Therefore, the use of a multidimensional evaluation and approach considering the various causes of mood and anxiety will bring us closer to the core of the actual psychiatric symptoms. Quantification through measurement is an essential aspect of understanding a multifactorial disease. Due to this difficulty with symptom measurement, most of the psychiatric evaluations are fragmentary, localized, and discontinuous [13]. It is therefore necessary to develop a methodology that can quantitatively and continuously evaluate the psychiatric state as comprehensively as possible.
If we can collect quantitative data related to daily mood, anxiety, activity, sleep, and circadian rhythm, all of which can reflect an individual’s psychiatric state, this will make it possible to broadly understand and multidimensionally evaluate each patient. This would represent a step forward in resolving the instability and ambiguity of the diagnostic system in psychiatry [14,15]. All kinds of measurable data obtained in real-time while an individual uses a digital device in daily life can be referred to as that person’s digital phenotype [16]. As the spread and use of personal digital devices such as smartphones and wearable devices become universal, it will be increasingly easier to measure real-world data through various sensors and applications installed in such devices [17]. An individual’s digital phenotype reflects their health-related state and can be further analyzed to cluster and predict the onset, aggravation, and relapse of psychiatric diseases in advance [18,19].
Performing clinical research using a digital platform made it possible to conduct non-face-to-face research, which opened up the possibility of establishing and carrying out a decentralized research design [20,21]. Decentralized research design refers to new shift of clinical trials that incorporate virtual tools, such as smartphone applications, wearable devices, and sensory-based technology to not only recruit research subjects, but also acquiring trial outcomes without involving in-person contacts, which ease participants’ burden in visiting a clinic or research center in a particular time like COVID-19 pandemic [22]. Decentralized research designs are suitable for investigating medical applications of new concepts such as digital therapeutics.
The Search Your Mind (S.Y.M., 心) project is designed to acquire prospective digital phenotypic data, especially on mood and anxiety symptoms such as panic symptoms, of two main subject groups: participants who visit the clinic (centralized) and online subjects who do not visit the clinic (decentralized). To maximize the advantages of the digital platform, a system that collects all possible clinical information was implemented as a smartphone app, which allowed for a centralized and decentralized research design to be planned and carried out together.

DESIGN AND METHODS

Centralized and decentralized study design

An overview of the overall study design is presented in Figure 1. The centralized research design is a combination of a general prospective observational study and a non-face-toface study using a digital platform. This design involves faceto-face research such as informed written consent, clinical evaluation by an investigator, and blood sampling. It also includes a digital phenotype evaluation study using an application-based online platform with wearable devices given to enrolled patients. Meanwhile, the decentralized research design is a completely non-face-to-face study, the population of which consists of anonymous participants who downloaded the app and agreed to electronic informed consent forms after understanding the description of the study on the app. It also collects personalized digital phenotypic data using only an application-based online platform. The overall study was approved by the Chungnam National University Sejong Hospital Institutional Review Board (CNUSH 2020-12-016-007). Clinical Research Information Service (CRIS) approval was also obtained for conducting the study (KCT0006523). In addition, due to the characteristics of the decentralized research design, the current study is open to the possibility of multi-center research in other hospital settings, under the circumstances that an identical research process and following approval of CRIS and IRB are available.

Populations

This study is conducted by dividing the overall sample into two groups: a centralized research group (CRG) and a decentralized research group (DRG). To obtain data focusing on mood and anxiety symptoms, CRG is made up of those who were diagnosed with DSM-5 mood disorders (depressive disorder or bipolar and related disorder), anxiety disorders, trauma- and stressor-related disorders, or obsessive-compulsive and related disorders, excluding those diagnosed with intellectual disability, organic brain disease, neurocognitive disorder, or schizophrenia. Meanwhile, DRG targets those who subjectively think that smartphone app-based management for mood and anxiety is necessary. Both groups targeted adults aged 19 to 70, excluding those who do not have a smartphone. The research is carried out after providing explanations to and obtaining consent forms from for the study subjects who meet the selection criteria of this study.

Smartphone application platform with wearable devices

The smartphone application is available on both Apple’s iOS and Android OS app stores under the name “inPHRsym (Softnet Co., Ltd., Seoul, Republic of Korea).” The configuration of the app is divided into a “main menu” and an “additional menu.” First, the “main menu” includes Home, Report, Diary, and Psychological scale: Home summarizes experiences of panic and emotion (mood, energy, anxiety, and irritation) over the past week. Report details the cumulative results of emotional instability, panic, lifestyle, and psychological scale. In Diary, panic (starting time, duration, symptom intensity, accompanying symptoms), emotion (mood, energy level ranging -3 to 3; anxiety, irritation level ranging 0 to 3), and lifestyle (alcohol use, caffeine, exercise, smoking, eating, menstruation) can be self-scored. Lastly, in Psychological scale, the user can complete scheduled tests recording their psychological state. The application-based psychological scales—which are inspected on monthly, quarterly, semi-annual, and yearly bases—will be covered in detail in the sub-section titled “Non-face-to-face assessment for both CRG and DRG.” Meanwhile, the “additional menu” includes Lifelog, Symptom encyclopedia, and Calendar. Lifelog has a sync function with wearable devices (Fitbit or Xiaomi smart band) so users can collect and check their heart rate, activity level, and sleep information using the app. Symptom encyclopedia provides information on psychiatric symptoms, according to the diagnostic criteria defined in the DSM-5. In Calendar, participants can record and check their daily emotional states using emoticons reflection states such as delight, happiness, thrill, depression, sadness, regret, irritation, anger, and ease. Individuals can also write personal diaries about their day. The S.Y.M. app sends a pop-up notification alarm at 9 pm that suggests that the user write a Diary about the day, and an additional pop-up at 10 am during weekends to complete the scheduled psychological scales (Table 1). The participants will either use the S.Y.M app until the end of the study or drop out of the study. A detailed app user manual can be found in the app (Supplementary Material 1 in the online-only Data Supplement).

Assessment

Face-to-face assessment for centralized research group

As shown in Figure 1, for CRG, we have conducted a baseline and follow-up psychiatric assessment, blood sampling, and digital phenotype assessment using a smartphone app paired with a wearable device. First, a follow-up assessment is performed every 6 months after the baseline assessment. In the follow-up assessment, a psychiatric evaluation is conducted using Mini International Neuropsychiatric Interview [23] along with a review of the patient’s psychiatric history (coexistence of psychiatric disorder, suicide attempt history), drug treatment history (prescription drug, medication compliance, lithium administration history, and treatment response using ALDA questionnaires) [24,25], family history (mental illness or death from suicide), and clinical symptom assessment using Korean version of Montgomery Åsberg Depression Scale [26], Young Mania Rating Scale [27], Clinical Global Impression [28], and Hamilton Anxiety Rating Scale [29]. The collected demographic information includes gender, age, socioeconomic status (average annual income, education level, and occupation), phone number, height, weight, marital status, number of children, religion, smoking, and medical history (past medical history, psychiatric history, recent medical history, family history, etc.). For DRG, the same evaluation items are applied in the smartphone app. CRG participants are provided with a wearable device (Fitbit HR2 or later version device) that can be worn on the participant’s nondominant wrist and paired with a smartphone; wearable devices are optional for DRG. When a wearable device is linked with the app, study participants’ life logs such as pulse rate, activity level, and sleep are recorded automatically.

Non-face-to-face assessment for both centralized research group and decentralized research group

The evaluation on the S.Y.M. app is conducted through both CRG and DRG, and daily panic symptoms, mood, energy, anxiety, and irritation states are scored and recorded through the application. Further, daily alcohol intake (frequency, time of the intake, type of liquor), caffeine (time of the intake, type of caffeine drink), food consumption (time of the food intake), and exercise levels (time of exercise, exercise type), smoking (number of cigarettes smoked), and menstruation status are recorded by app users. With daily data recording, light exposure is captured through an illuminance sensor in the app and automatically adjusted. The following self-reported psychological scale evaluations are also included: Patient Health Questionnaire-9 [30], State-Trait Anxiety Inventory [31], Generalized Anxiety Disorder Scale-7 [32], Albany Panic and Phobia Questionnaire [33], Center for Epidemiological Studies–Depression Scale [34], Agoraphobic Cognition Questionnaire [35], Body Sensation Questionnaire [35], The Short Form of the Korean Occupational Stress Scale [36], Beck’s Scale for Suicidal Ideation [37], Alcohol Use Disorders Identification Test [38], Heavy Smoking Index [39], Drug Abuse Screening Test [40], Internet Lifestyle Questionnaire [41], Smartphone Lifestyle Questionnaire [42], Composite Scale of Morningness [43], Seasonal Pattern Assessment Questionnaire [44], The Korean version of the Biological Rhythms Interview of Assessment in Neuropsychiatry [45], Life Experiences Survey [46], The International Physical Activity Questionnaire–Short Form [47], Mood Disorder Questionnaire [48], State-Trait Anxiety Inventory [49], Korean Resilience Quotient-53 [50], Korean version of World Health Organization Quality of Life Scale abbreviated version [51], Spiritual Well-Being Scale [52], Korean Spirituality Scale [53], Korean version of the 20-item Toronto Alexithymia Scale [54], Brief-Fear of Negative Evaluation Scale [55], Korean Social Avoidance and Distress Scale [56], Korean Version of Drug Attitude Inventory-10 [57], and Childhood Trauma Questionnaire [58] (Table 2).

Blood sample collection

Venous blood (10 mL) is obtained at baseline for CRG only. The blood sample is stored at ethylenediaminetetraacetic acid bottles in a -30°C freezer. It is used for genomic analysis in combination with digital and clinical phenotypic data.

Database analyses

We plan to apply various analysis methods depending on the data characteristics and hypothesis. To analyze the basic clinical data including longitudinal courses, we plan to perform paired t-test, logistic regression analysis, repeated-measures analysis of variance, Cox proportional hazard regression, mixed linear models, or other appropriate analysis methods. To comprehensively analyze the digital phenotype and clinical and genomic data of the individuals, analysis methods such as machine learning will be actively used. The following data will be used to predict specific clinical events, including panic attacks and relapse risk of mood or anxiety episodes. In addition, it can also be used to identify any new subphenotype of a psychiatric disorder, which can be utilized for understanding and reconstructing diagnosis criteria.

CONCLUSION

To date, most clinical research in psychiatry has mainly involved a conventional centralized research design. In this study protocol, we explain the design and methods of a prospective smartphone app-based study for the digital phenotyping of mood and anxiety symptoms mixed with centralized and decentralized research forms. In this project, we can collect digital phenotypes by measuring daily mood and anxiety states with life logs using wearable devices and the S.Y.M. application. Through the systematic and harmonious collection of patients’ clinical, biological, and digital data, this study is expected to open up opportunities for the development of personalized psychiatry approaches that can predict each person’s psychiatric condition and thus provide tailored treatment options. By maximizing and applying digital technology, our study presents the possibility of realizing a mixed model of centralized and decentralized research design for use in future studies.

Supplementary Materials

The online-only Data Supplement is available with this article at https://doi.org/10.30773/pi.2022.0102.
Supplementary Data
pi-2022-0102-suppl1.pdf

Notes

Availability of Data and Material

The datasets generated or analyzed during the study are available from the corresponding author on reasonable request.

Conflicts of Interest

The authors have no potential conflicts of interest to disclose.

Author Contributions

Conceptualization: Chul-Hyun Cho. Writing—original draft: all authors. Writing—review & editing: all authors.

Funding Statement

This work was supported by a National Research Foundation (NRF) of Korea grant funded by the Ministry of Science and Information and Communications Technology (MSIT), Government of Korea (NRF2020R1C1C1007463 and NRF-2021R1A5A8032895), and Information and Communications Technology (ICT) and Future Planning for Convergent Research in the Development Program for R&D Convergence over Science and Technology Liberal Arts (NRF-2022M3C1B6080866).

Figure 1.
Schematic research flow of Search Your Mind project mixed with centralized and decentralized research design. Light gray squared figures represent the centralized research design, while white circled figures represent the decentralized research design. Dark gray hexagonal figures represent the contents of the smartphone application and wearable device used in this study, and the period and interval of the research activity are indicated in braces.
pi-2022-0102f1.tif
Table 1.
Assessment interval of self-rating scales recorded via the smartphone app
Assessment interval (wk) Self-rating scale
4 PHQ-9, STAI-X1, GAD-7, APPQ
12 CES-D, ACQ, BSQ, KOSS-SF, SSI, AUDIT, HSI, DAST, ILQ, SLQ, CSM, BRIAN, LES, IPAQ-SF
26 MDQ, STAI-X2, KRQ-53, WHOQOL-BREF, SWBS, KSS, TAS-20K
52 BFNE, SADS, SPAQ, DAI-10, CTQ

PHQ-9, Patient Health Questionnaire-9; STAI-X1, State-Trait Anxiety Inventory-X1; GAD-7, Generalized Anxiety Disorder Scale-7; APPQ, Albany Panic and Phobia Questionnaire; CES-D, Center for Epidemiological Studies–Depression Scale; ACQ, Agoraphobic Cognition Questionnaire; BSQ, Body Sensation Questionnaire; KOSSSF, The Short Form of Korean Occupational Stress Scale; SSI, Beck’s Scale for Suicidal Ideation; AUDIT, Alcohol Use Disorders Identification Test; HSI, Heavy Smoking Index; DAST, Drug Abuse Screening Test; ILQ, Internet Lifestyle Questionnaire; SLQ, Smartphone Lifestyle Questionnaire; CSM, Composite Scale of Morningness; BRIAN, Biological Rhythms Interview of Assessment in Neuropsychiatry; LES, Life Experiences Survey; IPAQ-SF, International Physical Activity Questionnaire–Short Form; MDQ, Mood Disorder Questionnaire; STAI-X2, State-Trait Anxiety Inventory-X2; KRQ-53, Korean Resilience Quotient-53; WHOQOL-BREF, World Health Organization Quality of Life Scale abbreviated version; SWBS, Spiritual Well-Being Scale; KSS: Korean Spirituality Scale; TAS-20K, Korean version of the 20-item Toronto Alexithymia Scale; BFNE, Brief-Fear of Negative Evaluation Scale; SADS, Social Avoidance and Distress Scale; SPAQ, Seasonal Pattern Assessment Questionnaire; DAI-10, Drug Attitude Inventory-10; CTQ, Childhood Trauma Questionnaire

Table 2.
Comparison of assessment and evaluation items used for centralized and decentralized research groups
Assessment and evaluation item Centralized research group Decentralized research group
Demographic information Case report form and S.Y.M. app platform - required S.Y.M. app platform - optional
Gender, age, height, weight, socio-economic status, average annual household income, education level, occupation, marital status (number of children), religion, menopause (for women only) Gender, age, height, weight, average annual household income, education level, occupation, marital status (number of children), religion, menopause (for women only)
Clinical information Case report form and S.Y.M. app platform - required S.Y.M. app platform - optional
Past medical and psychiatric history, current medication history, previous suicide attempt history, current suicidal ideation and attempt, family history, smoking, alcohol drinking Past medical and psychiatric history, current medication history, previous suicide attempt history, current suicidal ideation and attempt, family history
Blood sample collection Venous blood 10 mL -
Objective assessment (by clinical investigator) MINI, ALDA, MADRS, YMRS, CGI-BP, HAM-A -
Subjective assessment (self-rating) S.Y.M. app platform - required S.Y.M. app platform - optional
PHQ-9, STAI-X1 and X2, GAD-7, APPQ, CES-D, ACQ, BSQ, KOSS-SF, SSI, AUDIT, HSI, DAST, ILQ, SLQ, CSM, SPAQ, BRIAN, LES, IPAQ-SF, MDQ, KRQ-53, WHOQOL-BREF, SWBS, KSS, TAS-20K, BFNE, SADS, DAI-10, CTQ
S.Y.M. app platform
Daily Lifelog Alcohol, caffeine, smoking, meal, exercise, menstruation (for women only)
Daily Mood Log Panic symptoms (onset time, duration, intensity, detailed symptom type)
Affective states (mood, energy, anxiety, irritation) scoring
Mood Calendar Today’s mood (emoticon), stories about today (freewriting)
Wearable device Fitbit wearables - required Fitbit or Xiaomi wearables - optional
Heart rate, activity, sleep Heart rate, activity, sleep

S.Y.M. app, Search Your Mind application; MINI, Mini International Neuropsychiatric Interview; ALDA, ALDA questionnaire for Lithium treatment response; MADRS, Montgomery Åsberg Depression Scale; YMRS, Young Mania Rating Scale; HAM-A, Hamilton Anxiety Rating Scale; CGI-BP, Clinical Global Impression-Bipolar; PHQ-9, Patient Health Questionnaire-9; STAI, State-Trait Anxiety Inventory; GAD-7, Generalized Anxiety Disorder Scale-7; APPQ, Albany Panic and Phobia Questionnaire; CES-D, Center for Epidemiological Studies–Depression Scale; ACQ, Agoraphobic Cognition Questionnaire; BSQ, Body Sensation Questionnaire; KOSS-SF, The Short Form of Korean Occupational Stress Scale; SSI, Beck’s Scale for Suicidal Ideation; AUDIT, Alcohol Use Disorders Identification Test; HSI, Heavy Smoking Index; DAST, Drug Abuse Screening Test; ILQ, Internet Lifestyle Questionnaire; SLQ, Smartphone Lifestyle Questionnaire; CSM, Composite Scale of Morningness; SPAQ, Seasonal Pattern Assessment Questionnaire; BRIAN, Biological Rhythms Interview of Assessment in Neuropsychiatry; LES, Life Experiences Survey; IPAQ-SF, International Physical Activity Questionnaire–Short Form; MDQ, Mood Disorder Questionnaire; KRQ-53, Korean Resilience Quotient-53; WHOQOL-BREF, World Health Organization Quality of Life Scale abbreviated version; SWBS, Spiritual Well-Being Scale; KSS, Korean Spirituality Scale; TAS-20K, Korean version of the 20-item Toronto Alexithymia Scale; BFNE, Brief-Fear of Negative Evaluation Scale; SADS, Social Avoidance and Distress Scale; DAI-10, Drug Attitude Inventory-10; CTQ, Childhood Trauma Questionnaire

REFERENCES

1. Roth M, Gurney C, Garside RF, Kerr TA. Studies in the classification of affective disorders. The relationship between anxiety states and depressive illnesses. I. Br J Psychiatry 1972;121:147–161.
crossref pmid
2. American Psychiatric Association. Diagnostic and statistical manual of mental disorders (5th ed). Arlington: American Psychiatric Association; 2013.

3. Alonso J, Angermeyer MC, Bernert S, Bruffaerts R, Brugha TS, Bryson H, et al. Prevalence of mental disorders in Europe: results from the European Study of the Epidemiology of Mental Disorders (ESEMeD) project. Acta Psychiatr Scand Suppl 2004;109(s420):21–27.
crossref
4. Waraich P, Goldner EM, Somers JM, Hsu L. Prevalence and incidence studies of mood disorders: a systematic review of the literature. Can J Psychiatry 2004;49:124–138.
crossref pmid
5. Somers JM, Goldner EM, Waraich P, Hsu L. Prevalence and incidence studies of anxiety disorders: a systematic review of the literature. Can J Psychiatry 2006;51:100–113.
crossref pmid
6. Locke AB, Kirst N, Shultz CG. Diagnosis and management of generalized anxiety disorder and panic disorder in adults. Am Fam Physician 2015;91:617–624.
pmid
7. Xiong J, Lipsitz O, Nasri F, Lui LMW, Gill H, Phan L, et al. Impact of COVID-19 pandemic on mental health in the general population: a systematic review. J Affect Disord 2020;277:55–64.
crossref pmid pmc
8. Newson JJ, Hunter D, Thiagarajan TC. The heterogeneity of mental health assessment. Front Psychiatry 2020;11:76
crossref pmid pmc
9. Allsopp K, Read J, Corcoran R, Kinderman P. Heterogeneity in psychiatric diagnostic classification. Psychiatry Res 2019;279:15–22.
crossref pmid
10. Costello EJ, Pine DS, Hammen C, March JS, Plotsky PM, Weissman MM, et al. Development and natural history of mood disorders. Biol Psychiatry 2002;52:529–542.
crossref pmid
11. Uher R. The implications of gene-environment interactions in depression: will cause inform cure? Mol Psychiatry 2008;13:1070–1078.
crossref pmid
12. Smoller JW. The genetics of stress-related disorders: PTSD, depression, and anxiety disorders. Neuropsychopharmacology 2016;41:297–319.
crossref pmid pmc
13. Marsch LA. Digital health data-driven approaches to understand human behavior. Neuropsychopharmacology 2021;46:191–196.
crossref pmid pmc
14. Insel TR. Digital phenotyping: technology for a new science of behavior. JAMA 2017;318:1215–1216.
crossref pmid
15. Insel TR. Digital phenotyping: a global tool for psychiatry. World Psychiatry 2018;17:276–277.
crossref pmid pmc
16. Jain SH, Powers BW, Hawkins JB, Brownstein JS. The digital phenotype. Nat Biotechnol 2015;33:462–463.
crossref pmid
17. Onnela JP, Rauch SL. Harnessing smartphone-based digital phenotyping to enhance behavioral and mental health. Neuropsychopharmacology 2016;41:1691–1696.
crossref pmid pmc
18. Cho CH, Lee T, Kim MG, In HP, Kim L, Lee HJ. Mood prediction of patients with mood disorders by machine learning using passive digital phenotypes based on the circadian rhythm: prospective observational cohort study. J Med Internet Res 2019;21:e11029
crossref pmid pmc
19. Cho CH, Lee T, Lee JB, Seo JY, Jee HJ, Son S, et al. Effectiveness of a smartphone app with a wearable activity tracker in preventing the recurrence of mood disorders: prospective case-control study. JMIR Ment Health 2020;7:e21283
crossref pmid pmc
20. Price J, Goodson N, Warren EJ, Wicks P, Reites J. Resilient design: decentralized trials recovered faster from the impact of COVID-19 than traditional site-based designs. Expert Rev Med Devices 2021;18(sup1):1–4.
crossref
21. Rogers A, De Paoli G, Subbarayan S, Copland R, Harwood K, Coyle J, et al. A systematic review of methods used to conduct decentralised clinical trials. Br J Clin Pharmacol 2022;88:2843–2862.
crossref pmid
22. Van Norman GA. Decentralized clinical trials. JACC Basic Transl Sci 2021;6:384–387.
crossref pmid pmc
23. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry 1998;59 Suppl 20:22–33.
pmid
24. Hou L, Heilbronner U, Degenhardt F, Adli M, Akiyama K, Akula N, et al. Genetic variants associated with response to lithium treatment in bipolar disorder: a genome-wide association study. Lancet 2016;387:1085–1093.
pmid pmc
25. Grof P, Duffy A, Cavazzoni P, Grof E, Garnham J, MacDougall M, et al. Is response to prophylactic lithium a familial trait? J Clin Psychiatry 2002;63:942–947.
crossref pmid
26. Montgomery SA, Asberg M. A new depression scale designed to be sensitive to change. Br J Psychiatry 1979;134:382–389.
crossref pmid
27. Young RC, Biggs JT, Ziegler VE, Meyer DA. A rating scale for mania: reliability, validity and sensitivity. Br J Psychiatry 1978;133:429–435.
crossref pmid
28. Guy W. ECDEU assessment manual for psychopharmacology. Rockville: National Institute of Mental Health; 1976.

29. Schwab JJ, Bialow MR, Clemmons RS, Holzer CE. Hamilton rating scale for depression with medical in-patients. Br J Psychiatry 1967;113:83–88.
crossref pmid
30. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med 2001;16:606–613.
crossref pmid pmc
31. Spielberger CD, Sydeman SJ, Owen AE, Marsh BJ. Measuring anxiety and anger with the State-Trait Anxiety Inventory (STAI) and the StateTrait Anger Expression Inventory (STAXI). Mahwah: Lawrence Erlbaum Associates Publishers; 1999.

32. Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med 2006;166:1092–1097.
crossref pmid
33. Rapee RM, Craske MG, Barlow DH. Assessment instrument for panic disorder that includes fear of sensation-producing activities: the Albany Panic and Phobia Questionnaire. Anxiety 1994;1:114–122.
crossref pmid
34. Roberts RE, Vernon SW. The center for epidemiologic studies depression scale: its use in a community sample. Am J Psychiatry 1983;140:41–46.
crossref pmid
35. Chambless DL, Caputo GC, Bright P, Gallagher R. Assessment of fear of fear in agoraphobics: the body sensations questionnaire and the agoraphobic cognitions questionnaire. J Consult Clin Psychol 1984;52:1090–1097.
crossref pmid
36. Chang SJ, Koh SB, Kang D, Kim SA, Kang MG, Lee CG, et al. Developing an occupational stress scale for Korean employees. Korean J Occup Environ Med 2005;17:297–317.
crossref
37. Beck AT, Kovacs M, Weissman A. Assessment of suicidal intention: the Scale for Suicide Ideation. J Consult Clin Psychol 1979;47:343–352.
crossref pmid
38. Fleming MF, Barry KL, MacDonald R. The alcohol use disorders identification test (AUDIT) in a college sample. Int J Addict 1991;26:1173–1185.
crossref pmid
39. Kozlowski LT, Porter CQ, Orleans CT, Pope MA, Heatherton T. Predicting smoking cessation with self-reported measures of nicotine dependence: FTQ, FTND, and HSI. Drug Alcohol Depend 1994;34:211–216.
crossref pmid
40. Skinner HA. The drug abuse screening test. Addict Behav 1982;7:363–371.
crossref pmid
41. Demetrovics Z, Szeredi B, Rózsa S. The three-factor model of Internet addiction: the development of the Problematic Internet Use Questionnaire. Behav Res Methods 2008;40:563–574.
crossref pmid
42. Gonçalves S, Dias P, Correia AP. Nomophobia and lifestyle: smartphone use and its relationship to psychopathologies. Comput Hum Behav Rep 2020;2:100025
crossref
43. Smith CS, Reilly C, Midkiff K. Evaluation of three circadian rhythm questionnaires with suggestions for an improved measure of morningness. J Appl Psychol 1989;74:728–738.
crossref pmid
44. Thompson C, Stinson D, Fernandez M, Fine J, Isaacs G. A comparison of normal, bipolar and seasonal affective disorder subjects using the Seasonal Pattern Assessment Questionnaire. J Affect Disord 1988;14:257–264.
crossref pmid
45. Giglio LM, Magalhães PV, Andreazza AC, Walz JC, Jakobson L, Rucci P, et al. Development and use of a biological rhythm interview. J Affect Disord 2009;118:161–165.
crossref pmid
46. Sarason IG, Johnson JH. The life experiences survey: preliminary findings. Springfield: National Technical Information Service; 1976.

47. Hagströmer M, Oja P, Sjöström M. The International Physical Activity Questionnaire (IPAQ): a study of concurrent and construct validity. Public Health Nutr 2006;9:755–762.
crossref pmid
48. Hirschfeld RM, Williams JB, Spitzer RL, Calabrese JR, Flynn L, Keck PE Jr, et al. Development and validation of a screening instrument for bipolar spectrum disorder: the Mood Disorder Questionnaire. Am J Psychiatry 2000;157:1873–1875.
crossref pmid
49. Spielberger CD. State-trait anxiety inventory for adults. Redwood City: Mind Garden; 1983.

50. Kim JH. Resilience. Goyang: Wisdom House; 2011.

51. The WHOQOL Group. Development of the World Health Organization WHOQOL-BREF quality of life assessment. Psychol Med 1998;28:551–558.
crossref pmid
52. Paloutzian RF, Ellison CW. Manual for the spiritual well-being scale. Nyack: Life Advance; 1991.

53. Wheat LW. Development of a scale for the measurement of human spirituality [master’s thesis] College Park, University of Maryland. 1991.

54. Taylor GJ, Ryan D, Bagby RM. Toward the development of a new selfreport alexithymia scale. Psychother Psychosom 1985;44:191–199.
crossref pmid
55. Leary MR. A brief version of the Fear of Negative Evaluation Scale. Pers Soc Psychol Bull 1983;9:371–375.
crossref
56. Watson D, Friend R. Measurement of social-evaluative anxiety. J Consult Clin Psychol 1969;33:448–457.
crossref pmid
57. Hogan TP, Awad AG, Eastwood R. A self-report scale predictive of drug compliance in schizophrenics: reliability and discriminative validity. Psychol Med 1983;13:177–183.
crossref pmid
58. Bernstein DP, Fink L, Handelsman L, Foote J. Childhood trauma questionnaire. In: Feindler EL, Rathus JH, Silver LB, editor. Assessment of family violence: a handbook for researchers and practitioners. Washington, DC: American Psychological Association, 1998, p. 158–160.