Psychometric Properties of Behavioral Checklist for Coping with Stress in Patients with Mood Disorders
Article information
Abstract
Objective
Even though the importance of stress-coping, there is no reliable and valid scale to measure the stress-coping behavior yet. The purpose of this study is to explore the psychometric properties of Behavioral Checklist for Coping with Stress (BCCS).
Methods
A total of 458 subjects including healthy subjects and patients with bipolar or depressive disorders were analyzed. The reliability and validity of BCCS were examined by Chronbach’s alpha and exploratory factor analysis using Principal Component Analysis. In order to evaluate criterion-related validity, the Pearson’s correlation analyses between factors of BCCS and relevant scales were performed.
Results
BCCS showed good Chronobach’s alpha (0.695–0.833) and had acceptable validity. Factor 1 and factor 4 of BCCS were negatively correlated with depression, anxiety and positivity correlated with task and problem-solving, avoidance, tension-releasing copings in common. Factor 2 and 3 were positively correlated with impulsivity, emotionality, avoidance, behavioral and verbal aggression and tension-releasing copings in common. Different from factor 2, factor 3 was positively correlated with depression, anxiety and anger-suppression.
Conclusion
The results of this study suggest that this BCCS might be a reliable and valid scale for measuring stress-coping behaviors. This scale could facilitate research to investigate clinical implications related to behavioral stress-coping.
INTRODUCTION
Stressful events could be one of the important factors affecting the onset and prognosis of psychiatric disorders [1,2]. Especially, there were significant relationships between stressful life events and mood disorders. Stressful life events in childhood play an important role in the onset of major depressive disorder [3]. An experience of childhood emotional abuse is associated with higher risk of depressive symptoms when confronted with stressful situations [4]. In bipolar disorder, stressful life events can have negative influences on the onset and course. Stressful life events related to social rhythm disruption were associated with the onset of manic episode in bipolar disorder [5]. Negative life events also predicted increase of depressive symptoms and delayed recovery from mood episodes in patients with bipolar disorder [6,7].
In order to minimize the negative consequences of stressful life events, it is crucial to cope with stress efficiently. Nevertheless, patients with mood disorders often fail to properly cope with stressful situations. Compared to healthy people, patients with depression are likely to use maladaptive coping, such as avoidance and denial, and have difficulties in finding positive meanings from stressful events [8]. Bipolar patients are more likely to use emotion-focused coping related to negative consequences than healthy controls [9]. A recent study implies the differential effects of coping strategies between bipolar disorder and depressive disorder [10]. This study reported that patients with depressive disorder tend to use less task and avoidant coping than patients with bipolar disorders.
Previous studies on stress-coping strategies mostly focused on cognitive strategies and emotional stress responses [11,12]. As a matter of fact, it is well known that these factors were meaningfully related to mood symptoms and prognosis in mood disorders [13,14]. Cognitive strategies such as problem-solving coping or task-oriented coping were associated with cognitive control to properly solve stressful situations through the functions of the frontal lobe [15]. Meanwhile, emotional coping such as self-blaming or emotional outburst might reflect the overactivity of the emotional neural circuit by the stress responses caused by inappropriate coping [16]. These cognitiveemotional approaches were mainly addressed [17].
In contrast, the behavioral aspect on stress-coping had less attention than cognitive-emotional strategy until now. In fact, many people frequently take their own stress-coping behaviors to relieve stress responses [18]. For instance, someone can use behaviors to seek relaxation, such as reading a book, taking a shower or meditating. Otherwise, people would try to pursue the pleasure-seeking behaviors to compensate for the discomfort caused by stressful situations, such as gambling, reckless driving or smoking. Besides, someone can have a reaction towards stressful situations, such as crying and binge-eating. Like these, people can show a number of behaviors in stressful situations. Some behaviors could be associated with adaptive coping to reduce stress responses properly. In contrast, several behaviors improperly cope with stress and can lead to negative consequences.
Given that the popularity of stress-coping behaviors as coping strategies, it could be clinically useful to measure stresscoping behaviors. Since stress-coping behaviors are explicitly revealed, it is easy to recognize and modulate their own stresscoping strategies. If people tend to use maladaptive coping behaviors, an intervention to change maladaptive behaviors to adaptive behaviors can be applied. For these reasons, measuring and analyzing stress-coping behaviors can be important in the evaluation and management of people suffering from stressful situations. However, there is lack of scale to efficiently measure the stress-coping behaviors among scales that measure stress-coping strategies [11,12]. Though several stress-coping scales were used in patients with mood disorders, stress-coping behaviors were assessed by only a few items in scales [11,12,13,19]. Some obstacles, such as diversity of stress-coping behaviors and difference in individual intentions to use stress-coping behaviors, may discourage developing stress-coping behavior scales. A previous study implies that these behaviors could be classified into several groups, such as personal activity, pleasure-seeking activity, compulsive activity and social activity [18]. The purpose of this study is to examine psychometric properties of the behavioral checklist for coping with stress (BCCS) used in the previous study in order to explore the potentiality for developing a scale to measure stress-coping behaviors in patients with mood disorders.
METHODS
Study design
This study cross-sectionally examined the reliability and validity of BCCS in patients with bipolar or depressive disorder and healthy subjects.
Subjects
A total of 458 subjects including 161 patients with bipolar or depressive disorders and 297 healthy subjects were analyzed. The patients with bipolar or depressive disorders were recruited from the subjects who visited the Mood disorder clinic in the department of psychiatry at Pusan National University Hospital between January 2012 and January 2019. Inclusion criteria was as follows: 1) patients with diagnosed as bipolar disorders or depressive disorders according to the Diagnostic and Statistical Manual of Mental disorder 4th Edition (DSM-IV-TR). The exclusion criteria were as follow: 1) patients who had serious medical diseases, 2) patients with organic mental disorders or mental retardation, and 3) illiterate people. Among 97 patients with bipolar disorders, 32 subjects were diagnosed with bipolar I disorder (33.0%), 24 subjects with bipolar II disorder (24.7%) and 41 subjects with bipolar disorder not otherwise specified (42.3%). In 64 patients had depressive disorders, 39 subjects had major depressive disorder (60.9%), 5 subjects had dysthymic disorder (7.8%) and 20 subjects had depressive disorder not otherwise specified (31.3%). The healthy subjects were recruited from the people encountered in public places, such as transportation stations, malls, hospitals, places of business and educational institutions. The inclusion criteria were as follow: 1) subjects at age of 18–65 years old, 2) no distressing problems requiring psychiatric treatment. The exclusion criteria were as follow: 1) people with any history of psychiatric diagnosis and treatment, 2) persons who had serious medical diseases, 3) individuals with organic mental disorders or mental retardation, and 4) illiterate people. The purpose of the study was explained to each participant, and their written informed consent was obtained. Sociodemographic and clinical characteristics of participants in this study are shown in Table 1. This study was approved by the Pusan National University Hospital Institutional Review Board (H-1804-024-066).
Assessments
Behavioral checklist for coping with stress (BCCS)
The BCCS was used to evaluate stress-coping behaviors [18]. After stress-coping behaviors were interviewed in patients with mood disorders, a 53-item behavioral checklist for coping with stress was collected. Even though the previous study showed the possibility of developing the BCCS as a scale for measuring stress-coping behaviors, several items in it showed problems of low factor loading and highly correlated with other factors simultaneously. In this study, after removing items with low factor loading and high factor loading on more than two items, 39-item behavioral checklist was finally used. The main question of the BCCS asked “How often do you use the following behaviors to cope with stress?.” Each behavioral item of the BCCS to above question was responded in a 5-point Likert scale (0 to 4 score).
Beck Depression Inventory II (BDI-II)
BDI is a self-reported scale developed by Beck in order to evaluate the severity of depressive symptoms [20]. The BDI is composed of 21-item and measure emotional, cognitive, motivational and physiological aspects of depression. The validation study of the Korean version of BDI-II in this study showed good reliability and validity [21]. According to this study, a depressive state was defined as a cut-off score of 18.
State-Trait Anxiety Inventory (STAI)
The STAI is a self-reported scale developed by Spielberger to measure anxiety symptoms in clinical populations as well as general populations [22]. The STAI is consist of 20-item of state anxiety and 20-item of trait anxiety. State anxiety means an anxiety in response of specific situation, trait anxiety means an innate anxiety trait. After measuring the state anxiety, the trait anxiety is evaluated subsequently. In this study, the Korean version of STAI which was translated by Kim was used [23].
Barratt impulsivity scale (BIS)
The BIS is a 30-item self-rated scale developed by Barratt to measure impulsivity [24]. The BIS consists of three factors, cognitive impulsiveness, motor activity impulsiveness and non-planning impulsiveness. The cognitive impulsiveness is related to rapid decision, motor activity impulsiveness means to act something without thought and non-planning impulsiveness refers to lack of plan for the future. This study used the Korean version which was translated by Lee [25].
Coping inventory for stressful situation (CISS)
The CISS is a 48-item self-report scale developed by Endler and Parker to measure coping strategy in stressful situations [26]. The CISS is composed of three factors task-oriented coping, emotion-oriented coping and avoidance-oriented coping. Task-oriented coping describes intentional task-oriented efforts or attempts to change the situation to solve the problem. Emotion-oriented coping refers to a self-oriented emotional reaction to reduce stress, self-preoccupation and fantasizing. Avoidance-oriented coping is related to the activities and cognitive changes to avoid stressful situation. The Korean version of CISS used in this study had acceptable reliability and validity in a previous study with Korean adolescent samples and patients with mood disorders [19,27].
Anger Coping Scale (ACS)
The ACS is a 44-item self-report inventory developed by Koh to measure coping strategy in situations to provoke anger [28]. The ACS is composed of five factors, behavioral aggression, verbal aggression, problem-solving, tension releasing and anger suppression. Behavioral and verbal aggression refer to venting his/her anger by beating, having physical quarrel, cursing or having verbal quarrel. Problem-solving coping is an effort to look for a proper solution in the anger situation. Tension-releasing coping means finding a way to alleviate inner anger feeling. Anger suppression is avoiding anger outburst and holding anger feeling. In this study, the Korean version of ACS developed by Koh was used [28].
Statistics
Categorical variables were compared by chi-square test, and continuous variables were compared by independent t-test. The clinical characteristics among more than three groups were analyzed by analysis of variance (ANOVA) and post hoc test with Scheffe. The reliability of this checklist was evaluated by Chronbach’s alpha representing internal consistency. Exploratory Factor Analysis was performed to evaluate the construct validity of behavioral items for measuring stresscoping behaviors. Principal Component Analysis was used to extract factors. Numbers of factors were made from the decisions by four factors for the consideration of scree plot, the size of eigenvalues and the number of factors in the previous study. We chose items greater than 0.35 as a cutoff for the factor loading. In order to evaluate criterion-related validity, the Pearson’s correlation analysis between the factors of the BCCS and relevant scales, such as BDI, STAI, BIS, CISS, and ACS, was performed. Furthermore, the factors of the BCCS were compared among three groups that consists of patients with bipolar disorders, patients with depressive disorders and healthy subjects by ANOVA and post hoc test with Scheffe. The Statistical analyses were performed using the Statistical Package for Social Sciences version 23.0 (IBM Corp., Armonk, NY, USA). A two-tailed p-value <0.05 was considered as a statistical significance.
RESULTS
Sociodemographic and clinical characteristics of the sample
Sociodemographic and clinical characteristics of patients with bipolar or depressive disorders and healthy subjects in this study are shown in Table 1. Mean ages of the subjects in this study were 31.48 years (±10.537) in patients with bipolar disorders, 34.55 years (±14.097) in patients with depressive disorders and 33.26 years (±9.296) in healthy subjects. There were no significant differences in age and sex among three groups. In contrast, sociodemographic such as education, job and marital status showed significant differences among three groups (education p<0.001; job p<0.001; marital status p<0.001). There were significant differences in clinical variables, such as BDI, STAI-S, STAI-T and BIS among three groups (BDI p<0.001; STAI-S p<0.001; STAI-T p<0.001; BIS p<0.001).
The reliability of behavioral checklist for coping with stress
The values of Chronbach’s alpha in factors are shown in Table 2. The values were ranged from 0.695 to 0.833 and within acceptable or excellent levels.
The construct validity of behavioral checklist for coping with stress
According to exploratory factor analysis, structural validity was evaluated. Four factors explained 17.1%, 9.7%, 7.1% and 5.2% of the variance in total scores and accounted for 39.1%. Items in factor 1 (personal activity) showed a factor loading higher than 0.310 (‘drinking coffee’). Items in factor 2 (pleasureseeking activity) showed a factor loading higher than 0.379 (‘stealing’). Items in factor 3 (compulsive activity) a showed factor loading higher than 0.258 (‘sleep’). The item of ‘saying nasty things’ had high factor loadings on factor 3 (0.373) and 4 (-0.351) simultaneously. Items in factor 4 (social activity) showed a factor loading higher than 0.378 (‘social club’). The item of ‘talking something over’ had high factor loadings on factor 3 (0.414) and 4 (-0.564) simultaneously. The item of ‘journey’ also had high factor loadings on factor 1 (0.396) and 4 (-0.428) simultaneously.
The criterion-related validity of behavioral checklist for coping with stress
The results of Pearson’s correlation between BCCS and other scales are shown in Table 3. Factor 1 (personal activity) was negatively correlated with BDI, STAI-T, STAI-S and BIS (BDI p<0.001; STAI-S p<0.001; STAI-T p<0.001; BIS p<0.001). Factor 2 (pleasure-seeking activity) was positively correlated with BIS (p<0.001). Factor 3 (compulsive activity) was positively correlated with BDI, STAI-T, STAI-S and BIS (BDI p<0.001; STAI-S p<0.001; STAI-T p<0.001; BIS p<0.001). Factor 4 (social activity) was negatively correlated with BDI, STAT-S and STAI-T (BDI p<0.001; STAI-S p<0.001; STAI-T p<0.001).
In a correlation analysis with the CISS, factor 1 (personal activity) was positively correlated with task-oriented (p<0.001) and avoidance-oriented copings of the CISS (p<0.001) and negatively correlated with emotion-oriented coping (p=0.020). Factor 2 (pleasure seeking activity) was positively correlated with emotion-oriented (p=0.044) and avoidance-oriented coping of the CISS (p=0.001). Factor 3 (compulsive activity) was negatively correlated with task-oriented coping (p=0.010) and positively correlated with avoidance-oriented coping of the CISS (p<0.001). Factor 4 (social activity) was positively correlated with task-oriented (p<0.001) and avoidance-oriented copings of the CISS (p<0.001).
Meanwhile, in a correlation analysis with the ACS, factor 1 (personal activity) was positively correlated with problem-solving (p<0.001) and tension-releasing copings of the ACS (p<0.001). Factor 2 (pleasure seeking activity) was positively correlated with behavioral aggression (p<0.001), verbal aggression (p<0.001) and tension-releasing coping of the ACS (p=0.002). Factor 3 (compulsive activity) was positively correlated with behavioral aggression (p<0.001), verbal aggression (p<0.001) and anger suppression coping of the ACS (p<0.001). Factor 4 (social activity) was positively correlated with verbal aggression (p<0.001), problem-solving (p<0.001) and tension-releasing copings of the ACS (p<0.001).
The comparison of behavioral checklist for coping with stress among patients with bipolar or depressive disorders and healthy subjects
The mean comparison of four factors in the BCCS was compared among patients with bipolar or depressive disorders and healthy subjects (Table 4). The mean value of factor 1 (personal activity) in total patients with bipolar or depressive disorders was significantly lower than in healthy subjects (p<0.001). The mean value of factor 3 (compulsive activity) in total patients with bipolar disorders was significantly higher than in healthy subjects (p<0.001). The mean value of factor 4 (social activity) in total patients with bipolar or depressive disorders was significantly lower than in healthy subjects (p<0.001).
In order to compare the factors of the BCCS between euthymic and depressive state according to bipolar or depressive disorders, the mean values among five groups were compared. The mean values of factor 1 (personal activity) in depressed patients with bipolar or depressive disorders were significantly lower than euthymic patients with bipolar disorder or healthy subjects (p<0.001). The mean values of factor 3 (compulsive activity) in depressed patients with bipolar disorders was significantly higher than euthymic patients with bipolar or depressive disorder or healthy subjects (p<0.001). The depressed patients with depressive disorder also showed higher compulsive activity than euthymic patients with depressive disorders (p<0.001). The mean value of factor 4 (social activity) in depressed patients with bipolar or depressive disorders was significantly lower than healthy subjects (p<0.001). Additionally, euthymic patients with bipolar disorder significantly showed higher social activity than depressed patients with depressive disorder (p<0.001).
DISCUSSION
This study reported the psychometric properties of the Behavioral Checklist for Coping with Stress (BCCS). The factors of the BCCS represented acceptable internal consistency (Chronbach’s alpha: 0.695 to 0.833). The construct validity of a 39-items behavioral checklist was observed within an acceptable level except several items. Furthermore, this behavioral checklist showed good criterion-related validity with several scales related to psychiatric symptoms and stress-coping. Additionally, the significant differences of the BCCS factors among bipolar or depressive disorder and healthy subjects suggested discriminant validity. Even though the current BCCS showed acceptable reliability and validity, after proper corrections of several items, this behavioral checklist could be a more useful scale to measure stress-coping behaviors.
The results of construct validity by exploratory factor analysis reported that some items had a relatively low factor loading. The factor loading of ‘drinking coffee’ was 0.310. Based on the results of several studies, caffeinated-beverage consumption was increased in stressful situations [29,30]. However, the purpose of drinking coffee might be different. Some people may drink coffee in social situations and others tend to use coffee to improve attention power at job demand [29,31]. In this study, even though ‘drinking coffee’ was classified into factor 1 (personal activity), the heterogenous reasons to use ‘drinking coffee’ might lead to a relatively low factor loading. Item of ‘sleeping’ also showed a low factor loading (0.258) in factor 3 (compulsive activity). Patients with atypical depression can represent hypersomnia as a kind of depressive symptom in stressful situations [32]. However, some people can also use ‘sleeping’ in order to get restoration and forget stressful problems for a while [33]. For this reason, stress-coping behavior of ‘sleeping’ was not strongly related to factor 3 (compulsive activity). The additional problem in results of construct validity by exploratory factor analysis refers to a high factor loading in more than two factors simultaneously. Items such as ‘saying nasty things’, ‘talking something over’ and ‘journey’ could mean that single behavior intended to seek a different purpose, respectively. In case of ‘journey’, there might be some different meanings between journey alone (factor 1, personal activity) and together (factor 4, social activity). This item needs to be separate with ‘journey alone’ or ‘journey together’ in future studies. Meanwhile, items such as ‘saying nasty things’ and ‘talking something over’ had high factor loadings on compulsive and social activities simultaneously. The original purpose of these behaviors might be associated with both resolving inner anxiety and satisfying with social relationship. Given that social supports can alleviate anxiety symptoms, social seeking behavior of using ‘talking something over’ when feeling anxiety can be predictable [34,35]. In contrast, social rejection or stressful situation related to social relationship can lead to verbal aggressions or saying nasty things that are not socially advantageous [36,37]. These items imply that some people tend to choose different stress-coping behaviors according to their own psychological states. If these items are used, the behaviors should be described specifically in order to express the purpose of using each behavior.
Based on the results of criterion-related validity, the factors of the BCCS were meaningfully correlated with each scale of depression, anxiety, impulsivity and coping. Personality or social activities were closely related to adaptive coping such as task-oriented or problem-solving coping [38]. Individuals with personal activity were less likely to use impulsivity, emotionoriented and avoidance-oriented coping. Different from individuals with personal activity, those with social activity were more likely to use verbal aggressions. As previously explained, people who are seeking social relationship can react aggressively when they are faced with stressful situations related to social relationship [36,37]. Meanwhile, pleasure-seeking activity was positively correlated with impulsivity, emotion-oriented and avoidance-oriented copings, physical and verbal aggression and tension-releasing anger coping. In other words, pleasure-seeking activity was mostly associated with maladaptive consequences [39,40]. Compulsivity activity was positively correlated with depression, anxiety, impulsivity, emotion-oriented and avoidance-oriented copings, physical and verbal aggression and anger suppression, and negatively correlated with task-oriented coping. Individuals with compulsive activity showed similar characteristics of those with pleasure-seeking activity. However, they were more likely to feel depressive and anxious symptoms [41,42]. All factors of the BCCS had a significantly positive correlation with avoidance coping of the CISS. This means that behavioral coping might be a kind of avoidance coping. Even though avoidance coping is known to be a maladaptive coping, some parts of avoidance coping might be adaptive or maladaptive according to the types of stress-coping behaviors [43].
The results of comparison of the BCCS factors among bipolar or depressive disorder and healthy subjects showed the differential aspects of stress-coping behaviors according to mood status and diagnostic subtypes of mood disorders. Bipolar or depressive patients tend to use maladaptive behavioral coping strategies, i.e., pleasure-seeking or compulsive activities, not to effectively solve stressful situation compared to healthy subjects. Previous studies suggest that depressed patients with bipolar or depressive disorders were more likely to have maladaptive coping than euthymic patients with mood disorders or healthy subjects [8,9]. In addition, individuals at risk of affective disorders may also have maladaptive coping strategies [44]. These results support the discriminant validity of the BCCS in patients with mood disorders. The evaluation on stress-coping behaviors can predict the mood status and diagnostic subtype of mood disorders.
There are some limitations in this study. Firstly, the sample size in patients with bipolar or depressive disorders was relatively small compared to healthy subjects. Secondly, several items of this checklist have relatively low factor loadings and high factor loadings in more than two factors simultaneously. These items need to be revised to improve the psychometric properties of the BCCS in a future study. Thirdly, BCCS used in this study had not yet been standardized. Thus, BCCS needs to be standardized in larger and representative samples. Also, other tools to confirm its validity such as Received Operating Characteristic Curve analysis as a scale to measure stress-coping strategy should be explored. In addition, since factor structure can be different according to diagnostic subtype of mood disorders, further validation studies in large sample are required.
Nevertheless, this study showed the potentiality of this BCCS as a scale to measure stress-coping behaviors. The evaluation on stress-coping behaviors can predict the symptom status and diagnostic subtype of mood disorders. Additionally, stress-coping behaviors could be an important target to be managed by psychiatrists. The results of this study also suggest the useful information for improving the psychometric properties of the BCCS. Given that the potential role of stress-coping behaviors in stress managements, developing a scale to measure stress-coping behaviors has a clinically crucial implication. In a future study, a modification of this behavioral checklist is expected to facilitate the development of scale to measure stresscoping behaviors.
Acknowledgements
This study was supported by a grant of Jisan Lee Sejong research fund for cultural psychiatry of Korean Neuropsychiatric Association (2018-172).
Notes
The authors have no potential conflicts of interest to disclose.
Authors’ contribution
Conceptualization: Hyun Ju Lim, Hwagyu Suh, Eunsoo Moon. Data curation: Hyun Ju Lim, Sun Kyeong Yang, Hwagyu Suh, Eunsoo Moon, Hee Jeong Jeong, Soo Yeon Kim, Kangyoon Lee. Formal analysis: Hyun Ju Lim, Sun Kyeong Yang, Min Yoon. Investigation: Hyun Ju Lim, Hwagyu Suh, Eunsoo Moon. Methodology: Eunsoo Moon, Je Min Park, Byung Dae Lee, Young Min Lee, Min Yoon. Project administration: Eunsoo Moon. Resources: Eunsoo Moon. Software: Hyun Ju Lim. Supervision: Eunsoo Moon, Je Min Park, Byung Dae Lee, Young Min Lee. Validation: Je Min Park, Byung Dae Lee, Young Min Lee. Visualization: Hyun Ju Lim. Writing—original draft: Hyun Ju Lim, Sun Kyeong Yang, Eunsoo Moon. Writing—review & editing: Je Min Park, Byung Dae Lee, Young Min Lee, Hee Jeong Jeong, Soo Yeon Kim, Kangyoon Lee, Min Yoon.