Clinical Correlates of False Positive Assignment in Bipolar Screening Measures Across Psychiatric Diagnoses among Patients without Bipolar Disorder

Ji Hyun Baek; Ji Sun Kim; Andrew A. Nierenberg; Hong Jin Jeon; Kyung Sue Hong

doi:10.30773/pi.2020.0246

Psychiatry Investig > Volume 17(11); 2020 > Article

Baek, Kim, Nierenberg, Jeon, and Hong: Clinical Correlates of False Positive Assignment in Bipolar Screening Measures Across Psychiatric Diagnoses among Patients without Bipolar Disorder

Original Article

Psychiatry Investigation 2020;17(11):1118-1125.

Published online: November 18, 2020

DOI: https://doi.org/10.30773/pi.2020.0246

Clinical Correlates of False Positive Assignment in Bipolar Screening Measures Across Psychiatric Diagnoses among Patients without Bipolar Disorder

Ji Hyun Baek¹

, Ji Sun Kim²

, Andrew A. Nierenberg³

, Hong Jin Jeon¹

, Kyung Sue Hong¹

¹Department of Psychiatry, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea

²Department of Psychiatry, Sooncheonhyang University Cheonan Hospital, Cheonan, Republic of Korea

³Bipolar Clinical and Research Program, Massachusetts General Hospital, Boston, MA, USA

Correspondence: Kyung Sue Hong, MD, PhD Department of Psychiatry, Samsung Medical Center, Sungkyunkwan University School of Medicine, 81 Irwon-ro, Gangnam-gu, Seoul 06351, Republic of Korea Tel: +82-2-3410-3589, Fax: +82-2-3410-0050, E-mail: hongks@skku.edu

Received June 26, 2020 Revised August 26, 2020 Accepted September 5, 2020

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Objective

In this study, we aimed to determine clinical correlates of false positive assignment (FPA) on commonly used bipolar screening questionnaires.

Methods

A retrospective chart review was conducted to a total of 3885 psychiatric outpatients. After excluding patients who have bipolar spectrum illnesses, patients who were assigned as having hypomania on the mood disorder questionnaire (MDQ) or the hypomania checklist-32 (HCL-32) were identified as patients who had FPA. Psychiatric diagnoses and severity of emotional symptoms were compared between patients with and without FPA.

Results

Patients with FPA on the MDQ showed significant associations with presence of major depressive disorder, generalized anxiety disorder, and alcohol-use disorder, while patients with FPA on the HCL-32 showed associations with presence of panic disorder and agoraphobia. FPA on the MDQ was also associated with greater emotional symptoms and lifetime history of suicide attempts. Logistic regression analysis showed that male sex, younger age, presence of alcohol-use disorder, and severity of depression and obsessive-compulsive symptoms were significantly associated with FPA on the MDQ.

Conclusion

The FPA for the MDQ was associated with clinical factors linked to trait impulsivity, and the FPA for both the MDQ and the HCL-32 could be related to increased anxiety.

Keywords: Hypomania, Self-report questionnaire, False positive assignment, MDQ, HCL-32

INTRODUCTION

Bipolar disorder (BD) is considered an under-recognized disease. Under-diagnosis can lead to delayed diagnosis and mistreatment, which eventually results in a worse clinical course and poorer treatment outcome. However, it is still difficult to differentiate BD from unipolar depressive disorder in clinical settings.

Diagnosis of BD depends on a patient’s history of hypomanic/manic episodes, indicating the importance of capturing hypomania through retrospective examination. To facilitate early recognition of bipolar disorder, several self-reported screening questionnaires have been widely applied in clinical settings. The Mood Disorder Questionnaire (MDQ) [1] and the Hypomania Symptom Checklist-32 (HCL-32) [2] are two of the most commonly used questionnaires. Their abilities to detect bipolarity initially appear comparable [3], but several studies showed that the HCL-32 may be better at detecting hypomania than the MDQ [4].

Although the MDQ and the HCL-32 are designed to be used for patients with major depression to detect (hypo)mania, they both are commonly used to define so-called bipolarity in diverse populations, both in clinical and research settings [5-9]. But this can lead to different problems related to overscreening. These screening measures generally have low positive predictive values, so additional interviews with trained professionals are necessary to confirm the presence of mania/hypomania [10]. To use these questionnaires properly, we need to identify the clinical correlates of false positive assignment (FPA) from these questionnaires in patients whose clinical diagnoses are not bipolar disorders.

A few studies have reported on the clinical correlates of FPA for bipolar screening questionnaires. Two studies [11,12] reported that FPA from the MDQ was associated with elevated rates of anxiety, impulse control, substance use, and attention-deficit disorder. However, clinical correlates of FPA from the HCL-32 have not been studied.

This study aimed to identify the clinical correlates of FPA for the MDQ and the HCL-32 in Korean psychiatric outpatients with diverse mood and anxiety disorders. Among patients who were diagnosed with non-bipolar mood and anxiety disorders via standard psychiatric interviews, we explored clinical features associated with false positive assignment on the two most commonly used bipolar screening questionnaires.

METHODS

Study populations

Data were obtained from a retrospective chart review of patients who visited the Depression Center of the Department of Psychiatry, Samsung Medical Center, between January 2011 and December 2017. After an initial interview with a boardcertified psychiatrist, patients between 18 and 65 years old who were suspected to have mood and anxiety problems were referred to a psychologist for a comprehensive psychological evaluation. The psychologist who conducted the evaluation had more than two years of clinical experience. The psychological evaluation was part of routine care and designed to confirm subject clinical diagnosis based on the DSM-IV-TR and to evaluate symptom severity. After the psychologist finalized patients’ psychiatric diagnoses, the result was reviewed and confirmed by a psychiatrist who order the test. Patients suspected of psychosis, intellectual disability, cognitive impairment, organic brain disease or who had difficulty in understanding overall evaluation process were excluded. Additionally, those who required an emergency admission were not referred for evaluation. This study used test results from comprehensive psychological evaluations.

The study protocol was approved by the Institutional Review Board of Samsung Medical Center (IRB no. 2018-11-019). All identifying data were removed from the clinical database prior to analyses. Because this study was a retrospective chart review, no consent was needed from participants.

Applied measures

Evaluation of FPA on the bipolar screening measures The Mood Disorder Questionnaire (MDQ) [1] and the Hypomania Symptom Checklist-32 (HCL-32) [2] were used to evaluate subthreshold hypomania. The MDQ evaluates experiences of (hypo)manic episodes using 13 questions derived from items of DSM-IV manic episode. The HCL-32 asks an individual their experiences when they were in a ‘high’ mood. Each question asks specific behavior, thoughts and emotions that can be experienced during (hypo)manic state. Furthermore, the HCL-32 evaluates whether the episode impact on their daily living. Widely used cut-off scores showed relatively low specificity for BD [10], so we adopted cut-off scores previously shown to have >80% specificity in Korean populations: the cut-off score for the MDQ was 9 [13], and the cut-off score for the HCL-32 was 20 [9]. We defined the MDQ (+) group as patients with an MDQ score ≥9 and the HCL (+) group as patients with HCL-32 score ≥20.

The psychological assessment

Subject diagnoses were evaluated using the Korean version of the Mini International Neuropsychiatric Interviews (MINI) [14]. If patients have dual diagnoses based on the MINI, they were counted twice in comparing frequencies of psychiatric diagnoses. Of the MINI modules, the suicide module was used to evaluate suicide risk. Suicidality was measured using the MINI suicide-item modules and the HAMD suicide-item scores. The MINI suicide module is a six-question, yes-or-no, interviewer-administered questionnaire used to evaluate suicidality and current risk of suicide. The MINI suicide module asks about experiences of recurrent thoughts of death, idea of self-harm, presence of suicide ideation, plans and (current and past) suicide attempts. A single score is generated after summing the weighted scores. Suicide risk scores are categorized as low risk (<6), medium risk (6-9), or high risk (≥10) for a future suicide attempt [15].

The Hamilton Depression Rating Scale (HAM-D) (Hamilton, 1967) and the Beck Depression Inventory II (BDI-II) were used to evaluate current depressive symptoms. The Beck’s hopelessness scale (BHS) [16] was used to evaluate severity of pessimism. The Hamilton Anxiety Rating Scale (HAM-A) [17] and the Beck Anxiety Inventory (BAI) [18] were used to evaluate anxiety symptoms. The Anxiety Sensitivity Index-3 (ASI-3) [19] was used to evaluate anxiety sensitivity. The Albany Panic and Phobia Questionnaire (APPQ) [20] was used to assess fear of situations and activities that are commonly avoided by individuals with agoraphobia and social anxiety disorder. The Penn State Worry Questionnaire (PSWQ) [21] was used to evaluate severity of worry. The Liebowitz social anxiety scale [22] was used to measure severity of social anxiety. The Obsessive Compulsive Inventory-Revised (OCI-R) [23] was applied to obsessive compulsive symptoms.

Statistical analyses

Chi-square tests were used to compare rates of sex and independent Student’s t-test was used to compare age between the MDQ (+) and (-) groups, and the same analyses were conducted between the HCL-32 (+) and (-) groups. Multivariate logistic regression analyses was conducted to determine the association between DSM diagnoses and FPA after adjusting for age and sex. Each DSM diagnosis was entered as a dependent variable, and MDQ (+) group and the HCL-32 (+) group memberships were entered as independent variables. Two-way analyses of covariance (ANCOVA) were conducted to compare emotional symptom severity depending on the FPA membership. MDQ (+) group and the HCL-32 (+) group memberships were entered as independent variables, and age and sex were entered as covariates. We also compared suicide risk using multivariate logistic regression analyses. We additionally conducted logistic regression analyses to determine factors that discriminated FPA on each screening measure. Only significant variables in aforementioned analyses were included as independent variables in the logistic regression models.

All analyses were performed with SPSS 24.0 (IBM Corp., Armonk, NY, USA). Considering the exploratory nature of this study, statistical significance was evaluated using a twosided design with alpha set a priori at 0.01.

RESULTS

A total of 4162 subjects underwent the standard evaluation. After excluding patients with BD [bipolar I, bipolar II and bipolar disorder, not otherwise specified (NOS)], a total of 3,885 subjects was included in the final analyses. Among them, 815 (21.0%) received an FPA on the MDQ score [MDQ (+) group], and 404 (10.4%) received an FPA on the HCL-32 score [HCL-32 (+) group].

Both the MDQ (+) and HCL-32 (+) groups were younger [MDQ (+) group mean age=38.43 (standard deviation (SD)= 12.28] years old, MDQ (-) group mean age=44.19 (SD=13.30) years old, t=8.84, p<0.001; HCL-32 (+) group mean age=37.77 (SD=12.31) years old, HCL-32 (-) group mean age=43.56 (SD= 13.50) years old, t=7.04, p<0.001) and included more males [MDQ (+) group number of male=402 (49.3%), MDQ (-) group number of male=1065 (34.7%), χ2=58.69, p<0.001; HCL-32 (+) group number of male=200 (49.5%), HCL-32 (-) group number of male=1267 (36.4%), χ2=26.42, p<0.001] compared to (-) groups.

Table 1 shows the comparisons of psychiatric diagnoses of patients included in the study. The MDQ (+) group showed significant associations with major depressive disorder (adjusted odds ratio (aOR)=1.34, 95% confidence interval (CI): 1.13-1.59), generalized anxiety disorder (aOR=1.73, 95% CI: 1.38-2.18), and alcohol-use disorder (aOR=2.00, 95% CI: 1.47-2.73). The HCL (+) group showed significant associations with panic disorder (aOR=1.45, 95% CI: 1.12-1.88) and agoraphobia (aOR=1.85, 95% CI: 1.35-2.55).

Table 2 shows the comparisons of emotional symptom severities between groups. We conducted 2-way ANCOVA analyses with the MDQ membership and the HCL-32 memberships as independent variables after adjusting for age and sex. No significant interaction effects between the MDQ and HCL32 groups were detected. The MDQ (+) group showed significant associations with higher scores except the HAMD. In particular, the effect sizes of the association was small (η²>0.01) in terms of the ASI-3, BDI-II, BAI, and OCIR scores. In contrast, the HCL-32 (+) group showed significant associations with the ASI-3 and PSWQ scores, but the effect sizes were almost negligible (η²<0.01).

We also compared suicide risk between the two groups (Table 3). After adjusting for age, sex, and presence of major depressive disorder, the MDQ (+) group showed significant associations with lifetime history of suicide attempt (aOR=1.70, 95% CI: 1.21-2.38). The HCL-32 (+) group did not show significant associations with suicide risk.

We conducted logistic regression analyses to determine which variables contributed to the discrimination of FPA (Table 4). Variables shown significant associations with FPA were entered as independent variables. When the MDQ (+) group was entered as a dependent variable, the model χ2 was 312.49 (df=9, p<0.001). Using this model, 78.3% of subjects were classified correctly. Male sex, younger age, presence of alcohol-use disorder, and higher scores of BDI-II and OCIR were significantly associated with the MDQ (+) group. When HCL-32 (+) group was entered as a dependent variable, the model χ2 was 110.30 (df=8, p<0.001). Using this model, 89.6 % of subjects were classified correctly. But only male sex and younger age were significantly associated with the HCL-32 (+) group.

DISCUSSION

Although the MDQ and HCL-32 are widely used to define so called “bipolarity,” the FPA rate from these scales is substantial. The cut-off scores that are generally used for screening in clinical practice and in prior studies [3,10] are lower than those we used in this study. We adopted higher cut-off scores that yielded >80% specificity in previous studies [9,13]. Even with these cutoff scores, about 10-20% of our subjects had an FPA (MDQ: 21.0%, HCL-32: 10.4%). Previous studies argued that hidden or undiagnosed bipolar disorders are substantial among nonbipolar illnesses based on positive assignments from the questionnaires [24-26]. But, as observed from our study findings, a considerable number of subjects who were positively assigned based on the questionnaires may not have had actual mania or hypomania.

The FPAs observed in our study could be associated with subthreshold hypomania that only partially meets the DSM criteria. But in a prior study that compared HCL-32 scores and clinically significant subthreshold hypomanic symptoms that partially meet DSM criteria, the HCL-32 was not strongly correlated with subthreshold hypomanic symptoms [27]. In this regard, FPA from the questionnaires does not fully reflect true subthreshold hypomania based on DSM criteria.

Consistent with previous study findings conducted at academic hospitals [11,12], the MDQ (+) group showed significant associations with major depressive disorder, generalized anxiety disorder, and alcohol-use disorder. Additionally, the MDQ (+) group showed significant associations with severe depressive and anxiety symptoms. Cyprien et al. [28] reported that psychiatric comorbidity and symptom severity decreased the positive predictive value of MDQ in participants recruited at academic hospitals, which corroborates our study findings. Consistent with Cyprien et al., several studies reported that positive assignment from the MDQ was significantly associated with more severe forms of depression [29-31].

It is particularly notable that the MDQ (+) group showed associations with clinical factors that could be related to trait impulsivity, including alcohol-use disorder [32], obsessive compulsive symptoms (OCIR) [33], and lifetime suicide attempts [34]. Both bipolar disorder and unipolar depression had greater impulsivity compared with healthy controls [35], and impulsivity predicted increased risk for developing hypomania [36]. Prior study results reported that association between bipolarity and suicide risk [29,37] might be moderated by impulsivity.

Clinical correlates of FPA on the HCL-32 were different from those on the MDQ in our study. The HCL-32 (+) group did not show significant associations with variables related to trait impulsivity. Furthermore, the HCL-32 (+) group showed negligible associations with depressive and anxiety symptom severity. Since its development, the HCL-32 was intended to reflect the bright side of hypomania [2], and a meta-analysis suggested that the HCL-32 was better able to detect hypomania than the MDQ [4]. It is unclear if these well-known characteristics of the HCL-32 affect the differences in clinical FPA correlates for the HCL-32 and MDQ. Additional research is needed to examine clinical factors associated with FPA on the HCL-32.

One common factor associated with both the MDQ and the HCL-32 in our study was anxiety disorder. FPA was associated with increased anxiety. Although diagnosis and differentiation of unipolar depression and bipolar disorder have focused on mania and depression symptoms, anxiety is also tightly associated with BD. Anxiety disorder is very common both in unipolar depression [38] and bipolar disorder [39]. Anxiety is also a part of diagnostic criteria for mood disorder, and presence of anxiety is associated with poorer clinical courses. Recent epidemiologic studies showed that subjects who have manic episodes have an approximately equivalent risk of developing depressive episodes and anxiety disorders [40]. From this perspective, anxiety may not exist as a separate disease entity from mood disorder.

A prior study reported an association between FPA and anxiety disorder on the MDQ [11], and they suggested the association might reflect underlying emotional dysregulation. Emotional dysregulation is considered to be a core psychopathology that exists under diverse psychiatric conditions ranging from mood disorder to anxiety disorders [41]. A recent study reported that emotional instability showed a significant genetic overlap with bipolar disorder, unipolar depression, and anxiety [42]. Additional studies are needed to determine the biological correlates of positive assignment by bipolar screening questionnaires.

Another explanation of our study findings could be underlying bipolar spectrum that exists dimensionally. Classic definition of hypomania are too strict, and previous studies showed that softer hypomania that did not meet the full criteria of DSM were also clinically significant [43]. Prior studies using the bipolar screening questionnaires in defining hypomania also showed distinct neurobiological characteristics [5]. Further studies are needed to interpret true meaning of FPA observed in our study.

Our findings need to be interpreted within the context of our study design. First, this study used cross-sectional data. We relied on a one-time evaluation to determine DSM diagnoses and questionnaire responses. Second, we could not examine the effect of sub-factors often adopted in previous studies within the MDQ or HCL-32 [8,9], but several studies have confirmed that a single factor is enough to justify use of these measures in a clinical setting [44]. Third, we did not evaluate comorbid personality disorders that might have overlapping manifestations with those described in the MDQ or HCL-32 items. Last, we could not adjust patients’ education level which might impact on understanding the exact content of the questionnaire. We tried to exclude any patient who had difficulty in understanding the overall evaluation process.

Despite these limitations, this study explored the clinical correlates of FPA from commonly used bipolar screening questionnaires. The rate of FPAs on the MDQ and HCL-32 was substantial in patients without bipolar spectrum disorders. FPAs on the MDQ and the HCL-32 were both associated with anxiety disorder, which may link to underlying emotional dysregulation. The MDQ (+) group was associated with clinical conditions linked to trait impulsivity and greater symptom severity. The HCL-32 (+) group showed negligible association with depression and anxiety severity. Future studies using these questionnaires should be cautious in interpreting clinical meanings of the positive assignment.

ACKNOWLEDGEMENTS

This study was supported by a National Research Foundation of Korea (NRF) grant funded by the Korean government (MSIT) (No. 2019R1G1A1091679).

The authors have no potential conflicts of interest to disclose.

Author Contributions

Conceptualization: Ji Hyun Baek. Data curation: Ji Hyun Baek. Formal analysis: Ji Hyun Baek. Funding acquisition: Ji Hyun Baek. Investigation: Ji Hyun Baek. Methodology: Ji Hyun Baek, Ji Sun Kim. Supervision: Kyung Sue Hong, Andrew A. Nierenberg. Validation: Ji Hyun Baek. Visualization: Ji Hyun Baek. Writing—original draft: Ji Hyun Baek. Writing—review & editing: all authors.

Table 1.

Psychiatric diagnoses of patients; comparison between patients with and without false positive assignment (FPA)

	MDQ (-) N=3,070 (%)	MDQ (+) N=815 (%)	β	aOR	95% CI	p-value	HCL-32 (-) N=3,481 (%)	HCL-32 (+) N=404 (%)	β	aOR	95% CI	p-value
MDD	1,059 (34.5)	341 (41.8)	0.290	1.34	1.13-1.59	0.001	1,245 (35.8)	155 (38.4)	-0.014	0.97	0.79-1.24	0.906
Panic disorder	525 (17.1)	163 (20.0)	-0.005	1.00	0.81-1.23	0.964	590 (16.9)	98 (24.3)	0.372	1.45	1.12-1.88	0.005
Social phobia	159 (4.9)	60 (7.4)	0.024	1.03	0.73-1.43	0.888	185 (5.3)	24 (5.9)	-0.199	0.82	0.52-1.30	0.400
Agoraphobia	267 (8.7)	85 (10.4)	-0.077	0.93	0.70-1.23	0.590	291 (8.4)	61 (15.1)	0.616	1.85	1.35-2.55	<0.001
Specific phobia	70 (2.3)	22 (2.7)	0.283	1.33	0.79-2.24	0.286	84 (2.4)	8 (2.0)	-0.280	0.76	0.35-1.63	0.474
Generalized anxiety disorder	336 (10.9)	146 (17.9)	0.550	1.73	1.38-2.18	<0.001	422 (12.1)	60 (14.9)	-0.002	1.00	0.73-1.36	0.988
Obsessive compulsive disorder	41 (1.3)	20 (2.5)	0.059	1.06	0.59-1.91	0.843	50 (1.4)	11 (2.7)	0.327	1.39	0.69-2.80	0.362
Somatoform disorder	314 (10.2)	64 (7.9)	-0.096	0.91	0.67-1.23	0.528	349 (10.0)	7.2 (378)	-0.203	0.82	0.54-1.23	0.334
Posttraumatic stress disorder	34 (1.1)	22 (2.7)	0.749	2.12	1.17-3.82	0.013	47 (1.4)	9 (2.20)	0.112	1.12	0.52-2.40	0.772
Eating disorder	20 (0.7)	7 (0.9)	-1.419	0.24	0.03-2.00	0.188	20 (0.7)	7 (0.9)	-0.064	0.94	0.11-7.76	0.953
Alcohol and substance use disorder	150 (4.9)	82 (10.1)	0.695	2.00	1.47-2.73	<0.001	199 (5.7)	33 (8.2)	-0.008	0.99	0.66-1.50	0.969
ADHD	23 (0.7)	25 (3.1)	0.651	1.92	1.03-3.56	0.039	37 (1.1)	11 (2.7)	0.344	1.41	0.68-2.4	0.358

Covariates: age and sex. HCL-32: hypomania checklist, MDQ: mood disorder questionnaire, MDD: major depressive disorder, ADHD: attention-deficit/hyperactivity disorder, aOR: adjusted odds ratio, CI: confidence interval

Table 2.

Comparisons of emotional symptoms depending on false positive assignment on the mood disorder questionnaire (MDQ) and the hypomania checklist-32 (HCL-32)

	MDQ (-)	MDQ (+)	HCL-32 (-)	HCL-32 (+)	MDQ			HCL-32
	N=3,070; mean (SD)	N=815; mean (SD)	N=3,481; mean (SD)	N=404; mean (SD)	F	p	Eta²	F	p	Eta²
HAMD score	14.39 (6.31)	15.65 (5.87)	14.59 (6.28)	15.22 (5.87)	9.59	0.002	0.002	0.95	0.329	<0.001
HAMA score	17.43 (7.02)	19.41 (6.72)	17.74 (7.01)	18.73 (6.86)	22.68	<0.001	0.006	1.15	0.283	<0.001
ASI-3 score	23.46 (6.60)	32.32 (16.76)	24.48 (16.92)	33.56 (15.90)	41.17	<0.001	0.016	22.78	<0.001	0.009
APPQ score	52.54 (41.76)	67.15 (42.10)	54.57 (42.10)	65.33 (42.48)	22.67	<0.001	0.007	4.64	0.031	0.001
BDIII	22.44 (12.56)	28.78 (11.81)	23.28 (12.60)	28.67 (12.28)	45.07	<0.001	0.018	11.98	0.001	0.005
BHS	8.41 (6.01)	10.12 (6.95)	8.68 (6.03)	9.71 (6.03)	12.77	<0.001	0.005	0.054	0.816	<0.001
BAI	18.82 (12.83)	24.86 (13.15)	19.52 (12.93)	25.65 (13.67)	31.81	<0.001	0.013	19.06	<0.001	0.008
PSWQ	54.04 (13.69)	61.42 (12.32)	55.00 (13.67)	61.45 (13.02)	22.32	<0.001	0.009	12.48	<0.001	0.005
LSAS	47.51 (34.01)	63.40 (31.19)	50.02 (33.92)	59.60 (34.03)	21.07	<0.001	0.008	0.57	0.449	<0.001
OCIR	16.50 (12.78)	24.53 (13.61)	17.72 (13.15)	23.06 (14.42)	50.52	<0.001	0.020	4.28	0.0.39	0.002

Covariates: age and sex. Post-hoc analyses were conducted using the least significant difference (LSD) methods. SD: standard deviation, HCL-32: hypomania checklist, MDQ: mood disorder questionnaire, MINI: mini international neuropsychiatric interview, HAMD: Hamilton rating scale for depression, HAMA: Hamilton rating scale for anxiety, ASI-3: anxiety sensitivity index-3, APPQ: Albany Panic and Phobia Questionnaire, BDI-II: Beck Depression Inventory, BHS: Beck Hopelessness scale, BAI: Beck’s Anxiety Inventory, PSWQ: Penn State Worry Questionnaire, LSAS: Liebowitz social anxiety scale, OCIR: Obsessive-Compulsive Inventory

Table 3.

Comparisons of suicide risk evaluated using the MINI suicide module depending on false positive assignment on the mood disorder questionnaire (MDQ) and the hypomania checklist-32 (HCL-32)

	MDQ (-) N=3,070 (%)	MDQ (+) N=815 (%)	β	aOR	95% CI	p-value	HCL-32 (-) N=3,481 (%)	HCL-32 (+) N=404 (%)	β	aOR	95% CI	p-value
Recurrent thoughts of death	463 (24.0)	183 (33.50)	0.308	1.36	1.06-1.76	0.018	564 (25.3)	82 (32.3)	0.118	1.13	0.80-1.57	0.493
Wish to self-harm	54 (2.8)	22 (4.0)	-0.219	0.80	0.46-1.39	0.436	68 (3.1)	8 (3.1)	-0.231	0.79	0.36-1.75	0.567
Suicide idea	224 (11.6)	90 (16.5)	0.131	1.14	0.84-1.56	0.410	274 (12.3)	40 (15.7)	0.062	1.06	0.71-1.60	0.766
Suicide plan	44 (2.3)	20 (3.7)	0.194	1.21	0.68-2.18	0.515	59 (2.7)	5 (2.0)	-0.625	0.54	0.21-1.40	0.202
(Recent) Suicide attempt	32 (1.7)	15 (2.7)	0.292	1.34	0.68-2.63	0.396	42 (1.9)	5 (2.0)	-0.248	0.78	0.29-2.08	0.620
Lifetime history of suicide attempt	143 (7.4)	74 (13.5)	0.529	1.70	1.21-2.38	0.002	184 (8.3)	33 (13.0)	0.223	1.25	0.81-1.93	0.314
Moderate-to-high suicide risk	229 (11.8)	94 (17.2)	0.151	1.16	0.86-1.58	0.335	282 (12.7)	41 (16.1)	0.041	1.04	0.70-1.56	0.842
High suicide risk	87 (4.5)	46 (8.4)	0.381	1.46	0.97-2.22	0.072	114 (5.1)	19 (7.5)	0.082	1.09	0.63-1.88	0.769

Covariates: age and sex. HCL-32: hypomania checklist, MDQ: mood disorder questionnaire

Table 4.

Logistic regression analyses to determine variables contributing to the discrimination of false positive assignment on the mood disorder questionnaire (MDQ) and the hypomania checklist-32 (HCL-32)

Variables	B	SE	Odds ratio	95% CI	p-value
Model 1. MDQ (+) as a dependent variable
Age	-0.035	0.004	0.97	0.96-0.97	<0.001
Sex	0.512	0.110	1.67	1.35-2.07	<0.001
Alcohol use disorder	0.575	0.190	1.78	1.23-2.58	0.002
Generalized anxiety disorder	0.211	0.141	1.24	0.94-1.63	0.134
Major depressive disorder	-0.270	0.124	0.76	0.60-0.97	0.030
ASI3 total score	0.008	0.004	1.01	1.00-1.02	0.044
BDI-II score	0.028	0.007	1.03	1.01-1.04	<0.001
BHS score	-0.026	0.012	0.98	0.95-1.00	0.038
OCIR score	0.022	0.005	1.02	1.01-1.03	<0.001
Model 2. HCL-32 (+) as a dependent variable
Age	-0.021	0.005	0.98	0.97-0.99	<0.001
Sex	0.488	0.139	1.63	1.04-2.14	<0.001
Panic disorder	0.285	0.168	1.33	0.96-1.85	0.089
ASI3 total score	0.013	0.006	1.01	1.00-1.03	0.027
BDI-II score	0.009	0.008	1.01	0.99-1.03	0.266
BAI score	0.008	0.008	1.01	0.99-1.02	0.316
PSWQ score	0.010	0.007	1.01	1.00-1.03	0.170

HCL-32: hypomania checklist, MDQ: mood disorder questionnaire, ASI3: anxiety sensitivity index-3, APPQ: Albany Panic and Phobia Questionnaire, BDI-II: Beck Depression Inventory, BHS: Beck Hopelessness scale, BAI: Beck’s Anxiety Inventory, PSWQ: Penn State Worry Questionnaire, LSAS: Liebowitz social anxiety scale, OCIR: Obsessive-Compulsive Inventory

REFERENCES

1. Hirschfeld RM. The mood disorder questionnaire: a simple, patientrated screening instrument for bipolar disorder. Prim Care Companion J Clin Psychiatry 2002;4:9-11.

2. Angst J, Adolfsson R, Benazzi F, Gamma A, Hantouche E, Meyer TD, et al. The HCL-32: towards a self-assessment tool for hypomanic symptoms in outpatients. J Affect Disord 2005;88:217-233.

3. Wang YY, Xu DD, Liu R, Yang Y, Grover S, Ungvari GS, et al. Comparison of the screening ability between the 32-item Hypomania Checklist (HCL-32) and the Mood Disorder Questionnaire (MDQ) for bipolar disorder: a meta-analysis and systematic review. Psychiatry Res 2019;273:461-466.

4. Carvalho AF, Takwoingi Y, Sales PM, Soczynska JK, Kohler CA, Freitas TH, et al. Screening for bipolar spectrum disorders: a comprehensive meta-analysis of accuracy studies. J Affect Disord 2015;172:337-346.

5. Mason L, O’Sullivan N, Blackburn M, Bentall R, El-Deredy W. I want it now! Neural correlates of hypersensitivity to immediate reward in hypomania. Biol Psychiatry 2012;71:530-537.

6. O’Sullivan N, Szczepanowski R, El-Deredy W, Mason L, Bentall RP. fMRI evidence of a relationship between hypomania and both increased goalsensitivity and positive outcome-expectancy bias. Neuropsychologia 2011;49:2825-2835.

7. Glaus J, Van Meter A, Cui L, Marangoni C, Merikangas KR. Factorial structure and familial aggregation of the Hypomania Checklist-32 (HCL-32): Results of the NIMH Family Study of Affective Spectrum Disorders. Compr Psychiatry 2018;84:7-14.

8. Bae M, Lee K, Baek JH, Kim JS, Cho Y, Ryu S, et al. Lifetime experiences of hypomanic symptoms are associated with delayed and irregular sleep-wake cycle and seasonality in non-clinical adult samples. Compr Psychiatry 2014;55:1111-1115.

9. Lee K, Oh H, Lee EH, Kim JH, Kim JH, Hong KS. Investigation of the clinical utility of the hypomania checklist 32 (HCL-32) for the screening of bipolar disorders in the non-clinical adult population. BMC Psychiatry 2016;16:124

10. Zimmerman M. Screening for bipolar disorder with self-administered questionnaires: a critique of the concept and a call to stop publishing studies of their performance in psychiatric samples. Depress Anxiety 2017;34:779-785.

11. Parker G, Graham R, Rees AM, Futeran S, Friend P. A diagnostic profile of those who return a false positive assignment on bipolar screening measures. J Affect Disord 2012;141:34-39.

12. Zimmerman M, Galione JN, Chelminski I, Young D, Dalrymple K. Psychiatric diagnoses in patients who screen positive on the Mood Disorder Questionnaire: Implications for using the scale as a case-finding instrument for bipolar disorder. Psychiatry Res 2011;185:444-449.

13. Jon D, Yoon B, Jung H, Ha K, Shin Y, Bahk W. A validation study of the Korean version Mood Disorder Questionnaire (K-MDQ). J Korean Neuropsychiatr Assoc 2005;44:583-590.

14. Yoo S, Kim Y, Noh J. Validity of Korean version of the mini-international neuropsychiatric interview. Anxiety Mood 2006;2:50-55.

15. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry 1998;59(Suppl 20):22-33. quiz 34-57.

16. Beck AT, Weissman A, Lester D, Trexler L. The measurement of pessimism: the hopelessness scale. J Consult Clin Psychol 1974;42:861-865.

17. Hamilton M. The assessment of anxiety states by rating. Br J Med Psychol 1959;32:50-55.

18. Beck AT, Epstein N, Brown G, Steer RA. An inventory for measuring clinical anxiety: psychometric properties. J Consult Clin Psychol 1988;56:893-897.

19. Taylor S, Zvolensky MJ, Cox BJ, Deacon B, Heimberg RG, Ledley DR, et al. Robust dimensions of anxiety sensitivity: development and initial validation of the Anxiety Sensitivity Index-3. Psychol Assess 2007;19:176-188.

20. Rapee RM, Craske MG, Barlow DH. Assessment instrument for panic disorder that includes fear of sensation-producing activities: the Albany Panic and Phobia Questionnaire. Anxiety 1994;1:114-122.

21. Meyer TJ, Miller ML, Metzger RL, Borkovec TD. Development and validation of the Penn State Worry Questionnaire. Behav Res Ther 1990;28:487-495.

22. Liebowitz MR. Social phobia. Mod Probl Pharmacopsychiatry 1987;22:141-173.

23. Foa EB, Huppert JD, Leiberg S, Langner R, Kichic R, Hajcak G, et al. The Obsessive-Compulsive Inventory: development and validation of a short version. Psychol Assess 2002;14:485-496.

24. Mbaba M, Brown SE, Wooditch A, Kiss M, Murphy A, Kumari S, et al. Prevalence, diagnosis, and treatment rates of mood disorders among opioid users under criminal justice supervision. Subst Use Misuse 2018;53:1519-1528.

25. Kivilcim Y, Altintas M, Domac FM, Erzincan E, Gulec H. Screening for bipolar disorder among migraineurs: the impact of migraine-bipolar disorder comorbidity on disease characteristics. Neuropsychiatr Dis Treat 2017;13:631-641.

26. de Sousa Gurgel W, da Silva Carneiro AH, Barreto Reboucas D, Negreiros de Matos KJ, do Menino Jesus Silva Leitao T, de Matos e Souza FG, et al. Prevalence of bipolar disorder in a HIV-infected outpatient population. AIDS Care 2013;25:1499-1503.

27. Goodday SM, Preisig M, Gholamrezaee M, Grof P, Angst J, Duffy A. The association between self-reported and clinically determined hypomanic symptoms and the onset of major mood disorders. BJPsych Open 2017;3:71-77.

28. Cyprien F, Guillaume S, Jaussent I, Lopez-Castroman J, Mercier G, Olie E, et al. Impact of axis-I comorbidity and suicidal behavior disorders on sensitivity and specificity of the Mood Disorder Questionnaire in complex depressed inpatients. Compr Psychiatry 2014;55:876-882.

29. Rybakowski JK, Dudek D, Pawlowski T, Lojko D, Siwek M, Kiejna A. Use of the Hypomania Checklist-32 and the Mood Disorder Questionnaire for detecting bipolarity in 1051 patients with major depressive disorder. Eur Psychiatry 2012;27:577-581.

30. Park YM, Lee BH. Treatment response in relation to subthreshold bipolarity in patients with major depressive disorder receiving antidepressant monotherapy: a post hoc data analysis (KOMDD study). Neuropsychiatr Dis Treat 2016;12:1221-1227.

31. Amin-Esmaeili M, Motevalian A, Rahimi-Movaghar A, Hajebi A, Sharifi V, Mojtabai R, et al. Bipolar features in major depressive disorder: results from the Iranian mental health survey (IranMHS). J Affect Disord 2018;241:319-324.

32. Dick DM, Smith G, Olausson P, Mitchell SH, Leeman RF, O’Malley SS, et al. Understanding the construct of impulsivity and its relationship to alcohol use disorders. Addict Biol 2010;15:217-226.

33. Grassi G, Figee M, Ooms P, Righi L, Nakamae T, Pallanti S, et al. Impulsivity and decision-making in obsessive-compulsive disorder after effective deep brain stimulation or treatment as usual. CNS Spectr 2018;23:333-339.

34. Liu RT, Trout ZM, Hernandez EM, Cheek SM, Gerlus N. A behavioral and cognitive neuroscience perspective on impulsivity, suicide, and nonsuicidal self-injury: Meta-analysis and recommendations for future research. Neurosci Biobehav Rev 2017;83:440-450.

35. Peluso MA, Hatch JP, Glahn DC, Monkul ES, Sanches M, Najt P, et al. Trait impulsivity in patients with mood disorders. J Affect Disord 2007;100:227-231.

36. Ng TH, Stange JP, Black CL, Titone MK, Weiss RB, Abramson LY, et al. Impulsivity predicts the onset of DSM-IV-TR or RDC hypomanic and manic episodes in adolescents and young adults with high or moderate reward sensitivity. J Affect Disord 2016;198:88-95.

37. Park YM. Relationship between childhood maltreatment, suicidality, and bipolarity: a retrospective study. Psychiatry Investig 2017;14:136-140.

38. IsHak WW, Mirocha J, Christensen S, Wu F, Kwock R, Behjat J, et al. Patient-reported outcomes of quality of life, functioning, and depressive symptom severity in major depressive disorder comorbid with panic disorder before and after SSRI treatment in the star*d trial. Depress Anxiety 2014;31:707-716.

39. Simon NM, Otto MW, Wisniewski SR, Fossey M, Sagduyu K, Frank E, et al. Anxiety disorder comorbidity in bipolar disorder patients: data from the first 500 participants in the Systematic Treatment Enhancement Program for Bipolar Disorder (STEP-BD). Am J Psychiatry 2004;161:2222-2229.

40. Olfson M, Mojtabai R, Merikangas KR, Compton WM, Wang S, Grant BF, et al. Reexamining associations between mania, depression, anxiety and substance use disorders: results from a prospective national cohort. Mol Psychiatry 2017;22:235-241.

41. Hofmann SG, Sawyer AT, Fang A, Asnaani A. Emotion dysregulation model of mood and anxiety disorders. Depress Anxiety 2012;29:409-416.

42. Ward J, Tunbridge EM, Sandor C, Lyall LM, Ferguson A, Strawbridge RJ, et al. The genomic basis of mood instability: identification of 46 loci in 363,705 UK Biobank participants, genetic correlation with psychiatric disorders, and association with gene expression and function. Mol Psychiatry 2020;25:3091-3099.

43. Miller S, Dennehy EB, Suppes T. The prevalence and diagnostic validity of short-duration hypomanic episodes and major depressive episodes. Curr Psychiatry Rep 2016;18:27

44. Court H, Forty L, Jones L, Gordon-Smith K, Jones I, Craddock N, et al. Improving the psychometric utility of the hypomania checklist (HCL-32): a Rasch analysis approach. J Affect Disord 2014;152-154:448-453.