Validation of the Center for Epidemiological Studies Depression Scale among Korean Adolescents
Article information
Abstract
Objective
The Center for Epidemiological Studies Depression Scale (CES-D) is designed to measure the current level of depressive symptomatology in the general population. However, no review has examined whether the scale is reliable and valid among children and adolescents in Korea. The purpose of this study was to test whether the Korean form of the CES-D is valid in adolescents.
Methods
Data were obtained from 1,884 adolescents attending grades 1–3 in Korean middle schools. Reliability was evaluated by internal consistency (Cronbach’s alpha). Concurrent validity was evaluated by a correlation analysis between the CES-D and other scales. Construct validity was evaluated by exploratory factor and confirmatory factor analyses.
Results
The internal consistency coefficient for the entire group was 0.88. The CES-D was positively correlated with scales that measure negative psychological constructs, such as the State Anxiety Inventory for Children, the Korean Social Anxiety Scale for Children and Adolescents, and the Reynold Suicidal Ideation Questionnaire, but it was negatively correlated with scales that measure positive psychological constructs, such as the Korean version of the Rosenberg Self-Esteem Scale and the Connor-Davidson Resilience Scale-2. The CES-D was examined by three-dimensional exploratory factor analysis, and the three-factor structure of the scale explained 53.165% of the total variance. The variance explained by factor I was 24.836%, that explained by factor II was 15.988%, and that explained by factor III was 12.341%. The construct validity of the CES-D was tested by confirmatory factor analysis, and we applied the entire group’s data using a three-factor hierarchical model. The fit index showed a level similar to those of other countries’ adolescent samples.
Conclusion
The CES-D has high internal consistency and addresses psychological constructs similar to those addressed by other scales. The CES-D showed a three-factor structure in an exploratory factor analysis. The present findings suggest that the CES-D is a useful and reliable tool for measuring depression in Korean adolescents.
INTRODUCTION
Depressive symptoms are common in adolescents [1]. The prevalence of adolescent depressive disorders ranges from 1.5% to 8% in community and clinical samples, and the lifetime prevalence is estimated to be as high as 20% [1]. Depression in adolescents is associated with serious negative outcomes, such as increased risk for substance abuse, school dropout, and suicide attempts [2].
The most commonly used self-report measure of child depression is the Children’s Depression Inventory (CDI), which was developed by Kovacs as a downward revision of the Beck Depression Inventory (BDI-I & II) [3]. However, Hensel and Matson [4] assessed depression in children aged 6–18 years and demonstrated that age is a significant factor in depression scores, whereas race and gender are not. Older children tend to display more depressive symptomatology, suggesting that the CDI has limited utility for detecting depression among adolescents. The CDI was translated into Korean and validated by Cho and Lee [5], and the factor structure of the CDI in children and adolescents was determined by Kim et al. [6] In that study, children showed a three-factor structure and adolescents showed four factors. Therefore, the factor structure of the CDI differs by developmental level [6]. The BDI-I & II are useful for measuring depression, but they are of limited applicability for purposes of research and high-risk group selection. Indeed, the BDI is used to evaluate the severity of depression and for screening depression in clinical practice and in the general population of adolescents and adults [7].
The purpose of the Center for Epidemiologic Studies Depression (CES-D) differs from that of previous depression scales used chiefly for diagnosis at clinical intake and/or for the evaluation of the severity of illness over the course of treatment. The CES-D was designed to measure the current level of depressive symptomatology, with emphasis on the affective component, depressed mood. The symptoms addressed by the CES-D include those on which a diagnosis of clinical depression is based; however, they may also accompany, to some degree, other diagnoses (and “normal”) [8]. Therefore, the purpose of the CES-D is slightly different from that of the BDI-I & II.
Data on the BDI have shown that not all student and community samples with elevated scores meet the diagnostic criteria for major depression [7]. If the subjects of a community sample study are primarily adolescents, a scale that measures a major depressive episode may not be sensitive for screening purposes.
Although originally developed to identify depressive symptoms among adults, the CES-D has been widely used to examine depressive symptoms in adolescents [1]. The reliability, validity, and utility of identifying cases of major depressive disorder using the CES-D and other symptom screening scales have been established in adult populations [8], but the same clinical thresholds have not been applied to child and adolescent samples [9].
The CES-D is a short self-report scale designed to measure the current level of depressive symptomatology in the general population. The major components of depressive symptomatology include depressed mood, feelings of guilt and worthlessness, feelings of helplessness and hopelessness, psychomotor retardation, loss of appetite, and sleep disturbance [8]. It is a short self-report assessment scale that has been developed for screening purposes and is commonly used in scientific studies [10]. The advantages of the CES-D are its free use (no need to pay a copyright fee), its translation into many languages, its widespread usage, and its suitability for use in cross-cultural studies [11]. The CES-D has been validated to screen for depression among adolescent Native Hawaiians and members of other ethnic groups [12]. The CES-D not only measures depression but also predicts major depression and dysthymia.
The CES-D was validated in adolescents from Vietnam in 2016 [13], in those from Hong Kong in 2015 [14] in those from mainland China in 2013 [15] and in those from Turkey in 2013 [11]. Additionally, a factor structure analysis was performed in Filipino-Americans [16] and American Indians (Native Americans) [17]. In Korea, the CDI [5], BDI-I [18], and BDI-II [19] have been validated in adolescents, but the CES-D has not been validated in adolescents.
The purpose of this study was to test whether the Korean form of the CES-D is an effective tool for identifying depression in adolescents by determining its reliability and validity in an adolescent sample.
METHODS
Participants
Data were obtained from students attending grades 1–3 in middle schools in Korea. We explained the purpose of the study, contents, and procedure to the subjects, who provided written consent. We also sent a communication about the study to students’ homes. Students who provided consent whose parent or guardian also provided written informed consent completed self-report questionnaires. This study was approved by the Eulji University Hospital Institutional Review Board (EMC2014-07-009-001).
In total, 1,884 students were included in the study (1,252 males (66.5%) and 632 females (33.5%). The sample was comprised of 145 (7.7%) first-grade, 1,536 (81.5%) second-grade, and 203 (10.8%) third-grade students. There were 43 (2.3%) 13-year-olds, 318 (16.9%) 14-year-olds, 1,292 (68.6%) 15-year-olds, and 204 (10.8%) 16-year-olds. The demographic characteristic of the sample are presented Table 1.
Measures
Center for Epidemiological Studies Depression Scale (CES-D)
The CES-D [8] consists of 20 items describing a wide range of depressive symptoms. Respondents rated their symptoms in the past week on a 0–3 scale from “rarely or never (<1 day)” to “most or all of the time (5–7 days).” The total summed score was 0–60 [20]. The Korean version of CES-D was translated by Chon and Rhee [21]. In this study, we used the scales translated by Chon et al. [22] In that study, the researchers developed a newly integrated version using items contained in three earlier versions currently available in Korea. The Cronbach’s alpha among adults was 0.91, and the scale contained a four-factor structure similar to the original English scale.
State Anxiety Inventory for Children (SAIC)
The SAIC was developed by Spielberger [23]. Cho and Choi [24] translated and standardized this scale using Korean elementary school students. The SAIC and Trait Anxiety Inventory for Children each consist of 20 items rated on a scale from 1 to 3, with total scores ranging from 0 to 60. Only the SAIC was used in the present study, and Cronbach’s alpha was 0.87.
Korean Social Anxiety Scale for Children and Adolescents (K-SAS-CA)
Based on translations of the Social Anxiety Scale for Children Revised [25] and the Social Phobia and Anxiety Inventory for Children [26], the K-SAS-CA was constructed and the psychometric properties evaluated by Moon and Oh [27]. This scale consists of 40 items rated on a 5-point Likert scale. The results of a factor analysis performed by Moon and Oh indicated that the scale consists of five factors: Performance anxiety, Fear of negative evaluation, Avoidance, Fear of new situations or unfamiliar peers, and Nonassertiveness. Internal consistencies for the subscales have ranged from 0.79 to 0.92, and construct validity is good.
Reynolds Suicide Ideation Questionnaire (RSIQ)
We used the self-report RSIQ scale [28] to assess suicidal ideation among adolescents during the previous month. Shin [29] validated this scale, which consists of 30 items rated on a scale from 0 to 6, for Koreans. A total score of 180 points is possible, and a higher score indicates more suicidal ideation. In this study, Cronbach’s alpha was 0.97
Korean version of the Rosenberg Self-Esteem Scale (K-RSES)
This scale, which measures self-esteem, consists of 5 positive self-esteem items and 5 negative self-esteem items. This is a self-report measure that relies on a 4-point Likert scale, with higher total scores reflecting higher self-esteem. We used the version translated and validated by Bae et al. [30] In that study, Cronbach’s alpha was 0.90, and Cronbach’s alpha was 0.86 in the present study.
Connor-Davidson Resilience Scale-2 (CD-RISC2)
The original CD-RISC was developed by Connor and Davision [31] to assess resilience. This is a self-report scale consisting of 25 items rated on a 5-point Likert scale (0–4), with higher scores reflecting greater resilience. We used the CD-RISC2, which is a shortened version of the CD-RISC that has the advantage of requiring considerably less time to administer while maintaining similar efficiency. The CD-RISC2 includes 2 items that assess whether respondents are “able to adapt to change” and “tend to bounce back after illness or hardship.” [32] We used the Korean version of the CD-RISC2 validated by Jeong et al. [33] In their study, Cronbach’s alpha was 0.75, and Cronbach’s alpha was 0.73 in the present study.
Statistical analysis
The reliability of the CES-D was evaluated in terms of internal consistency (Cronbach’s alpha). Validity was determined in terms of concurrent validity and construct validity. To investigate concurrent validity, we conducted a correlation analysis to examine whether the CES-D was positively correlated with scales that measure negative psychological constructs and negatively correlated with scales that measure positive psychological constructs. To investigate construct validity, we conducted exploratory factor and confirmatory factor analyses. The confirmatory factor analysis was conducted using a structural equation model to validate the elementary factors produced by the exploratory factor analysis using the Comparative Fit Index (CFI), Tucker-Lewis Index (TLI), Goodness of Fit Index (GFI), and Root Mean Square Error of Approximation (RMSEA). The data were analyzed with SPSS 22 and Amos 22 software (IBM Corp., Armonk, NY, USA).
RESULTS
Reliability
Internal consistency
To examine the reliability of the CES-D, the Cronbach’s alpha internal consistency coefficient was computed. In this study, the internal consistency coefficient for the entire group was 0.88, indicating that the CES-D is reliable for assessing depressive symptoms in the adolescent and general adult population. The results of the item analysis are presented in Table 2, and the correlations between the CES-D items for Korean adolescents are presented in Table 3.
Validity
Concurrent validity
The CES-D was positively correlated with scales that measure negative psychological constructs, such as the SAIC, K-SAS-CA, and RSIQ, but was negatively correlated with the K-RSES and CD-RISC2, which measure positive psychological constructs (Table 4). This means that the CES-D addresses psychological constructs similar to those addressed by these other measures.
Construct validity
Exploratory factor analysis
The construct validity of the CES-D was first tested with an exploratory factor analysis. Principal components analysis with a varimax rotation was applied to all data. The exploratory factor analysis determined that the scale was three dimensional and that the three-factor structure of the scale explained 53.17% of the total variance. The variance explained by factor I was 24.836%, that by factor II was 15.988%, and that by factor III was 12.341% (Table 5).
Factor I consisted of ten items: 14 (Lonely), 19 (Dislike), 18 (Sad), 15 (Unfriendly), 17 (Crying), 6 (Depressed), 10 (Fearful), 3 (Blues), 13 (Talk), and 11 (Sleep). Factor II consisted of six items: 1 (Bothered), 5 (Mind), 7 (Effort), 20 (Get Going), 2 (Appetite), and 9 (Failure). Factor III consisted of four items: 16 (Enjoy), 12 (Happy), 8 (Hopeful), and 4 (Good).
Confirmatory factor analysis
The construct validity of the CES-D was tested by confirmatory factor analysis, and we examined all data using a three-factor hierarchical model. Model A was based on the findings from the present study. The CFI was 0.780, the TLI was 0.725, the GFI was 0.781, and the RMSEA was 0.104. The fit index for the confirmatory factor analysis of the other model, which examined Korean adults, was similar to the present results. The factor loadings for each of the items calculated by the confirmatory factor analysis are presented in Table 6. The fit schema of the scale to the three-factor structure is presented in Figure 1. Model B was based on the findings of Radloff for an adult sample8 and consisted of a four-factor structure: factor I (items 3, 6, 9, 10, 14, 17, and 18), factor II (items 4, 8, 12, and 16), factor III (items 1, 2, 5, 7, 11, 13, and 20), and factor IV (items 15 and 19). We applied this model to Korean adolescents. The results of this model were similar to our results (CFI=0.794, TLI=0.738, GFI=0.794, and RMSEA=0.101). Model C by Shin et al. [34] consisted of four factors: factor I (items 5, 7, 9, 10, 13, 14, 15, 19, and 20), factor II (items 4, 8, 12, and 16), factor III (items 1, 2, 3, 6, and 11), and factor IV (items 17 and 18). The fit indices for this model among Korean adolescents did not differ from those for our model (CFI=0.794, TLI=0.738, GFI=0.784, RMSEA=0.101). Model D, which was developed by Kim et al. [35] was comprised of three factors: factor I (items 1, 2, 3, 5, 6, 7, 8, 9, 10, 11, and 13), factor II (items 4, 12, and 16), and factor III (items 14, 15, 17, 18, 19, and 20). The fit of this model was similar to that estimated for the Korean adolescents (CFI=0.737, TLI=0.672, GFI=0.738, RMSEA=0.113). Model E was developed by Chon et al. [22] and consisted of four factors: factor I (items 1, 2, 3, 5, 6, 7, 13, and 20), factor II (items 4, 8, 12, and 16), factor III (items 9, 14, 15, and 19), and factor IV (items 10, 11, 17, and 18). Model E showed similar results (CFI=0.788, TLI=0.731, GFI=0.789, RMSEA=0.103). Based on these findings, we concluded that these models produced very similar results among Korean adolescents.
DISCUSSION
In the reliability analysis, the Cronbach’s alpha in our study was 0.88, which was similar to the figures of 0.85 for the general population reported in Radloff’s study [8], of 0.89 for an adult sample in Korea reported by Chon and Rhee [21], and of 0.80 for the Korean adult group studied by Shin et al. [34] These results indicate that the CES-D shows similar internal consistency among Korean adolescent and adult groups.
In the concurrent validity analysis, the CES-D was positively associated with the SAIC, which measures state anxiety, the K-SAS-CA, which measures social anxiety, and the RSIQ, which measures suicidal ideation. Additionally, the CES-D was negatively associated with the K-RSES, which measures self-esteem, and the CD-RISC2.
Principal components factor analysis of the 20-item scale in this study showed that the CES-D has a three-factor structure. Several studies have examined whether the factor structure of the CES-D differs among adolescents as a function of ethnic group. Radloff (1977) reported similar four-factor solutions among European-Americans and African-Americans, and this has been replicated in other studies [37]. In Radloff’s study, factor IV, Interpersonal (unfriendly, dislike), was a separate and independent factor. In our study, factor IV, Interpersonal, was integrated with factor I, Depressed Affect. In Radloff’s study, items 11 (Sleep) and 13 (Talk) were included in Somatic and Retarded activity. However, in our study, these items belonged in factor I, Depressed affect. Items 11 and 13 were in different categories, but, occasionally, both statements fell into different categories.
Item 9 (Failure) was in the Somatic factor in our study, whereas it was in Depressed Affect in Radloff’s study. In Shin et al. [34] and Chon and Rhee [21] model of Korean adults, the Positive Affect Factor [items 4 (Good), 8 (Hopeful), 12 (Happy), and 16 (Enjoy)] was identical to that in our model; however, other factors did not correspond with those in our model.
Three factors were examined in the factorial structure of the CES-D in American Indian adolescents [17]. Similar studies have suggested that the four-factor structure reported by Radloff [8] may not be appropriate for some samples of other ethnicities. Other studies conducted in Asian-American, Hispanic-American, and Native American samples suggested three factors [38-40]. Three dimensions were also reported in a study of mainland Chinese adolescents [15].
Two factors provided a reasonably good fit in Filipino-American adolescents [16]; factor I combined Depressed Affect, Somatic Retardation, and interpersonal items; and factor II consisted of the remaining four positive-affect items. The factor solutions for Korean- and Filipino-Americans in Kuo’s study [41] also combined Depressed Affect and Somatic Retardation items and consisted of only two factors.
The fit indices from the confirmatory factor analysis in our study were slightly low, but the fit indices were similar to those in another study that examined the validity of the CES-D in adolescents. Among Vietnam adolescents, the CFI was 0.89, the TLI was 0.87, and the RMSEA was 0.884 [13]. The RMSEA showed a mediocre fit, but the CFI and TLI were <0.90. Considering the limitations of that and our study, the goodness of fit from the confirmatory analysis in adolescents differed by ethnicity, especially with regard to differences between respondents from the east and west. The CES-D was first developed with Caucasians, so this scale may not reflect ethnic and cultural differences. As is the case with American Indian adolescents [17], the goodness-of-fit index for the three-factor model vs. Radloff’s original four-factor structure model was 0.966. The three-factor structure combined the Somatic and Depressed factors (similar to studies of other ethnic populations) with a single-factor structure [17]. As these findings suggest that adolescents’ responses differ according to ethnicity [16], the use of the CES-D in different adolescent ethnic groups requires further study.
Taken together, the validity and reliability studies demonstrate that the Korean form of the CES-D is as effective in adolescents as it is in adults. The scale is available free of charge and is suitable for screening purposes [11].
This study is the first to determine whether the Korean form of the CES-D is reliable and can be used effectively in adolescents.
Some limitations of this study should be discussed. We did not retest depression among adolescents using the CES-D, so we were unable to evaluate the reliability of CES-D over time. We did not compare the CES-D to other depression scales. We did not examine adolescents of all ages, and the sample was drawn from only one location. At the beginning of the data analysis, we confirmed the normal distribution of the data through the Kolmogorov-Smirnov test, but the data did not form a normal distribution. Additionally, we reanalyzed the the data by performing log transformation to adjust the data, but the results were unchanged. The research subject is limited to a certain area and some students and not large in number, so it may not generalized. It is possible that this could not have been significant statistically in confirmatory factor analysis and that the item 2, 4, 8 showed a low correlation in item-total correlation. Therefore, we will have to do more work and identify more evidence through research on larger numbers and different populations.
The CES-D is a useful and reliable measure of depression in Korean adolescents, but the fit indices from the confirmatory factor analysis were slightly low, and the responses differed among ethnicities [16].
Thus, the CES-D requires further study to determine its concurrent validity with other depression scales, such as the CDI and BDI-II, in adolescents and to examine whether the results of the CES-D are stable across developmental stages. The CES-D-R was developed by Dam and Earleywine in 2011 [42]. The CES-D-R Korean version was translated and validated in patients and healthy controls by Lee et al. [43] in 2016. Further studies measuring depression using the CES-D-R in adolescents will be needed; indeed, comparisons between the original and revised versions of the CES-D will enable researchers to select the most valid and useful tools to measure adolescent depression.
Acknowledgements
This research was supported by EMBRI Grants 2014EMBRI DI0003 from the Eulji University.