Are Teacher Ratings and Parent Ratings Differently Associated with Children's Intelligence and Cognitive Performance?

Article information

Psychiatry Investig. 2011;8(1):15-21

Publication date (electronic) : 2010 December 03

doi : https://doi.org/10.4306/pi.2011.8.1.15

Soo-Churl Cho ¹, Hyo-Won Kim ², Boong-Nyun Kim ¹, Min-Sup Shin ¹, Hee Jeong Yoo ³, Jae-Won Kim ¹, Soo-Young Bhang ⁴, In Hee Cho ⁵

¹Department of Child and Adolescent Psychiatry, Seoul National University College of Medicine, Seoul, Korea.

²Department of Psychiatry, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Korea.

³Department of Psychiatry, Seoul National University Bundang Hospital, Seongnam, Korea.

⁴Department of Psychiatry, Ulsan University Hospital, Ulsan, Korea.

⁵Department of Psychiatry, Gachon University of Medicine and Science, Incheon, Korea.

Correspondence: Hyo-Won Kim, MD, PhD. Department of Psychiatry, University of Ulsan College of Medicine, Asan Medical Center, 86 Asanbyeongwon-gil, Songpa-gu, Seoul 138-736, Korea. Tel: +82-2-3010-3414, Fax: +82-2-485-8381, shingubi@gmail.com

Received 2010 June 21; Revised 2010 September 04; Accepted 2010 November 03.

Abstract

Objective

The present study investigated whether teacher ratings and parent ratings of inattentive or hyperactive/impulsive symptoms were differently associated with intelligence or cognitive performance in Korean children.

Methods

Six hundred sixty-seven children were recruited from nine schools in five Korean cities. The teachers and parents of 580 of these children (9.0±0.7 years old, 333 boys and 306 girls) completed the Korean version of the Attention-Deficit/Hyperactivity Disorder Rating Scales (K-ARS), and the children performed the abbreviated form of the Korean Educational Development Institute-Wechsler Intelligence Scales (KEDI-WISC) and a neurocognitive battery consisting of the continuous performance test, the Children's Color Trails Test, and the Stroop Color-Word Test. Diagnosis of full-syndrome and subthreshold attention-deficit/hyperactivity disorder (ADHD) were based on the Diagnostic Interview Schedule for Children Version-IV (DISC-IV).

Results

The level of agreement between teacher and parent ratings was low (r=0.21-0.26) in children with full-syndrome and subthreshold ADHD and low to moderate (r=0.31-0.41) in the normative sample. Teacher-rated ARS showed significant correlations with most sub-scores of KEDI-WISC and the neurocognitive battery both in the normative sample (r=-0.50-0.37) and in children with full-syndrome and subthreshold ADHD (r=-0.26-0.29). Correlations between parent-rated ARS and cognitive tests were lower and were found in fewer subscales of tests.

Conclusion

These results suggest the importance of considering the teacher's report of a child's school functioning during the assessment of ADHD.

Keywords: Attention-deficit/hyperactivity disorder; Cognition; Intelligence; Parent and teacher rating scale

INTRODUCTION

Attention-deficit/hyperactivity disorder (ADHD) is the most common childhood psychiatric disorder, affecting about 5% of the population worldwide.1 The core symptoms of ADHD (inattention, hyperactivity, and impulsivity) often give rise to significant functional problems, such as school difficulties, academic underachievement, troublesome interpersonal relationships with family members and peers, and low self-esteem.2

According to the Diagnostic and Statistical Manual of Mental Disorders-4th Edition (DSM-IV), impairment from the symptoms in two or more settings and at least six symptoms of inattention and/or six symptoms of hyperactivity/impulsivity must be present for a diagnosis of ADHD to be made. In general, the cross-setting criterion for ADHD has been ascertained in terms of home and school behaviors as reported by parents and teachers. However, the agreement between parent and teacher reports about the symptoms of ADHD has been found to be low to moderate in both children with ADHD3-5 and typically developing children.6,7 The general literature on behavior rating scales has found that teachers report more behavior problems and ADHD symptoms than do parents8 and that parent reports of in-school ADHD behavior correlate more highly with their own reports of their child's behavior at home than with teacher reports of their child's behavior at school.3 On the other hand, other studies have reported increased symptoms of ADHD in parent ratings.9 In contrast to poor agreement between parent- and teacher-rated symptoms of ADHD, good convergence between reports from groups of parents and teachers during methylphenidate10 and atomoxetine trials11 have been identified. Although many studies have addressed the issue of parent-teacher agreement for the diagnosis of ADHD and for assessments of change during treatment, only a few researches has focused on the association between parent or teacher ratings of children's behavior and cognitive performance.

Children with ADHD are reported to exhibit deficits in cognitive functions such as working memory, strategies and planning, selective attention, sustained attention, attention switching, resistance to interference, and inhibition.2 Performance on neuropsychological measures, particularly executive function tests, are considered to be sensitive to ADHD, pointing to a possible underlying neuropsychological process and to a closer connection to genetic functionality.12 Mares et al.7 found that teachers reported greater variety and severity of executive function impairment than did parents, based on rating scales. However, only a few studies have evaluated the relationships between parent or teacher ratings of children's behavior and objectively measured cognitive performance. Thus, the purpose of this study was to investigate whether teacher ratings and parent ratings of inattentive or hyperactive/impulsive symptoms differed in their association with intelligence or cognitive performance in Korean children.

METHODS

Study population and recruitment

The present study was conducted from April through October 2008. Participants were recruited from third- and fourth-grade students (age range 8-10) in five Korean cities: Seoul (metropolitan), Seongnam (suburban), Ulsan and Incheon (industrial), and Yeoncheon (rural). We selected between one and three schools per area (nine in total) that best represented the local demographics. Of 1,000 eligible children, the parents of 667 gave consent for their child to participate in the study. Thus, the total response rate was 66.7%. The research design of this study has previously been described in detail.13 The nine selected schools agreed to participate in the study, which was approved by the Institutional Review Board of the Seoul National University Hospital. The parents were informed about the study through letters sent by the teachers. Written informed consent was obtained from the parents before each interview.

Assessment of ADHD symptoms and diagnosis

Inattentiveness and hyperactivity were evaluated both by parents and by teachers based on the Korean version of the ADHD rating scale (K-ARS). The ADHD Rating Scale (ARS) assesses the severity of ADHD symptoms. It was designed by Dupaul and his collegues14 and contains 18 items; nine of these assess inattention, and nine are related to hyperactivity and impulsivity. The K-ARS parent and teacher forms are considered to have high validity and reliability.6

Full-syndrome and subthreshold ADHD were determined based on the parent version of Diagnostic Interview Schedule for Children Version-IV (DISC-IV), a highly structured diagnostic instrument. Full syndrome ADHD was defined according to DSM-IV criteria for ADHD. Subthreshold ADHD was operationally defined as the presence of at least three and no more than five inattentive and/or hyperactive/impulsive symptoms. Some impairment from the symptoms needed to be present in two or more settings. Children had also to fulfill DSM-IV ADHD age-of-onset and impairment criteria to qualify for a diagnosis of subthreshold ADHD. This definition of subthreshold ADHD is identical to that implemented in previous research.15,16 Good test-retest reliability of the DISC-IV has been reported.17 The reliability and validity of the Korean version of the DISC-IV has been previously determined.18

Assessment of neurocognitive function

The abbreviated form of the Korean Educational Development Institute-Wechsler Intelligence Scales for Children (KEDI-WISC) and a neurocognitive battery consisting of the continuous performance test (CPT), the Children's Color Trails Test (CCTT), and the Stroop Color-Word Test were administered to each child. All of the data are presented as T-scores adjusted for age and gender. Higher T-scores indicate better function in all tests except the CPT, in which lower T-scores indicate better attention and response inhibition ability.

KEDI-WISC, the abbreviated form

The abbreviated form of the KEDI-WISC19 tests vocabulary, arithmetic, picture arrangement, and block design. Scores from this battery are highly correlated with the WISC full-scale IQ.20

CPT

A computerized CPT21,22 was used to measure cognitive functions. The four major variables recorded were 1) omission errors, 2) commission errors, 3) response times, and 4) the standard deviations of the response times for correct responses to the target (response time variability).

CCTT

The CCTT is based on the adult version of the Color Trails Test.23 The Korean version was standardized by Shin and Koo.24 Two time scores (the total time to finish CCTT-1 and CCTT-2) and the difference interference index (CCTT-2 total time to finish-CCTT-1 total time to finish) were assessed.

Stroop Color-Word Test

The Stroop Color-Word Test was developed by Charles Gordon for children aged 5-14.25 The Korean version was standardized by Shin and Park.26 The interference scores were calculated as the correct number of concordant color letters (color score)-correct number of discordant color letters (color-word score).

Data analysis

Student's t-tests or analyses of variance were used for continuous variables, and the chi-squared test was used for categorical variables. Pearson correlation tests were used to determine the relationship between the parent or teacher rating and the intelligence and cognitive performance. All statistical analyses were performed using Statistical Package for the Social Sciences (SPSS) 15.0 for Windows (SPSS Inc., Chicago, IL, USA). All comparisons were two-tailed, and statistical significance was defined as p<0.05.

The level of clinical significance was considered to be low when intraclass correlations were below 0.40, moderate between 0.40 and 0.59, good between 0.60 and 0.74, and excellent when they were between 0.75 and 1.00.27

RESULTS

Study population characteristics

A total of 667 children were recruited from nine schools in five Korean cities. The number of participants in each city was as follows: Seoul, 279; Seongnam, 73; Incheon, 126; Ulsan, 113; and Yeoncheon, 76. Of the 667 children, teacher-rated ARS results were available for 643 (96.4%), parent-rated ARS ratings were available for 597 (89.5%), and both measures were available for 580 children (87.0%).

The mean age of the 580 subjects included in the final analysis was 9.0 years ±0.7, (range 8-11); 306 (49.8%) were female, and 333 (50.2%) were male. No significant differences in age, gender, father's educational level, birth-weight, teacher-rated ARS, or parent-rated ARS were found between the children included and those excluded from the analysis (p=0.284, p=0.382, p=0.934, p=0.230, p=0.641, and p=0.595, respectively).

Among the 580 children, 20 (3.4%) were diagnosed with full-syndrome ADHD, and 68 (11.7%) with subthreshold ADHD. The mean ages of the full-syndrome and subthreshold ADHD were 9.2 (SD=0.8) and 9.0 (SD=0.7), respectively. Eighteen (90.0%) of the full-syndrome ADHD and 33 (48.5%) of the subthreshold ADHD were boys. Among 20 children with full-syndrome ADHD, 10 (50.0%) were predominantly inattentive type, 6 (30.0%) were combined type, and 4 (20%) were predominantly hyperactive-impulsive type. The two girls with full-syndrome ADHD were predominantly inattentive type. There were significant differences in parent- and teacher-rated ARS and cognitive tests between children with and without ADHD except Block Design and Picture Arrangement on abbreviated KEDI-WISC, Stroop interference, CCTT 1 and interference on CCTT, reaction times on the CPT (Table 1).

Table 1

Comparison of parent- and teacher-rated ARS and cognitive tests for children with and without full-syndrome and subthreshold ADHD

Table 2 shows Pearson correlations between teacher-rated and parent-rated ARS among all 580 children. All sub-scores of teacher-rated and parent-rated ARS were weakly to moderately correlated. The correlations between teacher-rated and parent-rated ARS and intelligence or the cognitive performance are shown in Table 3. The inattention sub-scores and total scores of teacher-rated ARS were correlated with all sub-scores of the abbreviated KEDI-WISC, CPT, CCTT, and Stroop tests except for Stroop interference. The hyperactivity/impulsivity sub-scores of teacher-rated ARS were associated with Vocabulary and Picture Arrangement sub-scores of KEDI-WISC, all sub-scores of the CPT, the CCTT2 sub-score of the CCTT, and the Color and Color-Word sub-scores of the Stroop test. The parent-rated ARS was also associated with some sub-scores of the KEDI-WISC, CPT, and Stroop test; the pattern was similar to that for the teacher-rated ARS, although the correlations were weak.

Table 2

Pearson correlations between the parent- and teacher-rated ARS in normative sample (N=580)

Table 3

Pearson correlations between the parent- and teacher-rated ARS and measures of the cognitive function in normative sample (N=580)

Among full-syndrome and subthreshold ADHD children, a positive association was found between parent-rated and teacher-rated inattention and between parent-rated and teacher-rated hyperactivity/impulsivity (Table 4). Moreover, teacher-rated ARS was negatively associated with intelligence, as measured by the KEDI-WISC, and cognitive performance, as assessed by the CPT, CCTT, and Stroop tests.

Table 4

Pearson correlations between the parent- and teacher-rated ARS in children diagnosed with full-syndrome and subthreshold ADHD (N=88)

In the parent-rated ARS, inattention sub-scores showed a significant association with the response times of the CPT only, and hyperactivity/impulsivity sub-scores showed significant associations with the Vocabulary sub-score of the KEDI-WISC only (Table 5).

Table 5

Pearson correlations between the parent- and teacher-rated ARS and measures of the cognitive function in children diagnosed with full-syndrome and subthreshold ADHD (N=88)

DISCUSSION

This investigation examined the relationship between teacher-rated and parent-rated symptoms of ADHD and the neurocognitive function of children. Teacher ratings of inattention and hyperactivity/impulsivity were closely associated with children's cognitive performance in both a general population sample of children and in children with full-syndrome and subthreshold ADHD, but there were few significant relationships between parent-rated symptoms and cognitive performance especially in children with full-syndrome and subthreshold ADHD.

The level of agreement between teacher and parent ratings was low in children with full-syndrome and subthreshold ADHD and low to moderate in the normative sample. These results are consistent with some previous studies that found low to non-significant correlations between parent and teacher ratings for an ADHD sample3,28 and moderate correlations for typically developing children.6,7 The degrees of association were similar to those found in the present study. Parents and teachers appear to be reporting on important but distinct aspects of child functioning, and the lack of agreement on symptoms ratings may be due to variation in children's behavior in different situations and differences in the way different observers judge children's behavior.29

In the present study, we found that the association between ADHD symptoms and IQ and cognitive performance was stronger in teacher ratings than in parent ratings. These results are consistent with a previous finding, which showed a positive association of poor cognitive performance with teacher ratings of ADHD symptoms but not with parent ratings.30,31 Teachers may have a clearer opinion on ADHD symptoms than parents because they can make comparisons with other pupils,32 be familiar with age-appropriate behavior and better attuned to developmental changes in children.5 Parents generally reported higher behavioral problems than teachers, but teachers scored higher than parents on the items related to academic functioning. In contrast, parents are more sensitive than teachers to internalizing symptoms important for differential diagnosis of ADHD.33 Teacher observations of ADHD symptoms have been considered to be reliable and to agree with direct observation more than parent ratings,34 and to outperform parent ratings when considering sensitivity, specificity, and overall classification accuracy.33

Although there were only 20 children with full syndrome ADHD in our study, 68 with subthreshold ADHD were also included. Recently, there is increased interest in children who show inattentive or hyperactive/impulsive symptoms of ADHD but do not meet the diagnostic threshold, i.e. subthreshold ADHD. Subthreshold ADHD is reported to be more prevalent than full syndrome ADHD,35 associated with psychosocial adversity and functional impairment and related to a greater risk for developing clinical-level ADHD.36-38 Several researches which assessed the validity of subthreshold ADHD16,39-40 suggested that subthreshold ADHD might be a milder form of the disorder.

Children with full-syndrome and subthreshold ADHD showed significantly deficits in selective attention (increased omission errors on the CPT), sustained attention (increased response time variability on the CPT), response inhibition (increased commission errors on the CPT and lower color-word score on the Stroop Word-Color Test) in this study. These results are consistent with previous studies which addressed the core neurocognitive deficits of ADHD.2,41 However, there were no significant differences in Interference scores on the CCTT and Stroop tests between children with and without ADHD. Moreover, parent-rated and teacher-rated ADHD symptoms were not associated with the interference score on the Stroop test both in children with ADHD and in normative children. In recent meta-analysis,42 the Stroop interference effect was not larger in children with ADHD and significant differences in the Stroop test between children with ADHD and age-matched controls were found in the color and the color-word condition, congruent with our results. Further studies which addressed the Stroop interference effects in ADHD are needed. Some limitations should be considered in interpreting our findings. First, the moderate response rate and missing data of the teacher-rated and parent-rated ARS could lead to attrition bias. Second, because only third- and fourth-grade students were included, it is difficult to generalize our findings to the entire age range of children affected by ADHD. Future research with children in other age ranges may expand the current findings. Third, only 20 with full-syndrome ADHD among 580 children were included in the analysis, which is small number to generalize the results to entire population with ADHD. Despite these caveats, this study has the following strengths: a) a large community sample was assessed, minimizing selection bias; b) both general population of children and children with full-syndrome and subthreshold ADHD were evaluated; c) subjects in this study were recruited from a non-Western culture in Asia.

In conclusion, these results suggest that teacher ratings are more strongly associated than parent ratings with intelligence and cognitive performance in Korean children. Our results emphasize the importance of considering the teacher's report of a child's school functioning during the assessment of ADHD.

Acknowledgments

This study was supported by the Jeon Sang-Bae Child and Adolescent Research Fund of Korean Neuropsychiatry Research Foundation in 2000.

References

1. Polanczyk G, de Lima MS, Horta BL, Biederman J, Rohde LA. The worldwide prevalence of ADHD: a systematic review and metaregression analysis. Am J Psychiatry 2007;164:942–948. 17541055.

2. Barkley RA. Attention-deficit hyperactivity disorder: a handbook for diagnosis and treatment 2006. 3 edth ed. New York: The Guilford Press.

3. Mitsis EM, McKay KE, Schulz KP, Newcorn JH, Halperin JM. Parent-teacher concordance for DSM-IV attention-deficit/hyperactivity disorder in a clinic-referred sample. J Am Acad Child Adolesc Psychiatry 2000;39:308–313. 10714050.

4. Murray DW, Kollins SH, Hardy KK, Abikoff HB, Swanson JM, Cunningham C, et al. Parent versus teacher ratings of attention-deficit/hyperactivity disorder symptoms in the Preschoolers with Attention-Deficit/Hyperactivity Disorder Treatment Study (PATS). J Child Adolesc Psychopharmacol 2007;17:605–620. 17979581.

5. de Nijs PF, Ferdinand RF, de Bruin EI, Dekker MC, van Duijn CM, Verhulst DC. Attention-deficit/hyperactivity disorder (ADHD): parents' judgment about school, teachers' judgment about home. Eur Child Adolesc Psychiatry 2004;13:315–320. 15490279.

6. So YK, Noh JS, Kim YS, Ko SG, Koh SJ. The reliability and validity of Korean parent and teacher ADHD Rating Scale. J Korean Neuropsychiatr Assoc 2002;41:283–289.

7. Mares D, McLuckie A, Schwartz M, Saini M. Executive function impairments in children with attention-deficit hyperactivity disorder: do they differ between school and home environments? Can J Psychiatry 2007;52:527–534. 17955916.

8. Offord DR, Boyle MH, Racine Y, Szatmari P, Fleming JE, Sanford M, et al. Integrating assessment data from multiple informants. J Am Acad Child Adolesc Psychiatry 1996;35:1078–1085. 8755805.

9. Gioia GA, Isquith PK, Kenworthy L, Barton RM. Profiles of everyday executive function in acquired and developmental disorders. Child Neuropsychol 2002;8:121–137. 12638065.

10. Faraone SV, Biederman J, Zimmerman B. Correspondence of parent and teacher reports in medication trials. Eur Child Adolesc Psychiatry 2005;14:20–27. 15756512.

11. Bohnstedt BN, Kronenberger WG, Dunn DW, Giauque AL, Wood EA, Rembusch ME, et al. Investigator ratings of ADHD symptoms during a randomized, placebo-controlled trial of atomoxetine: a comparison of parents and teachers as informants. J Atten Disord 2005;8:153–159. 16110045.

12. Oosterlaan J, Scheres A, Sergeant JA. Which executive functioning deficits are associated with AD/HD, ODD/CD and comorbid AD/HD+ODD/CD? J Abnorm Child Psychol 2005;33:69–85. 15759592.

13. Cho SC, Kim BN, Hong YC, Shin MS, Yoo HJ, Kim JW, et al. Effect of environmental exposure to lead and tobacco smoke on inattentive and hyperactive symptoms and neurocognitive performance in children. J Child Psychol Psychiatry 2010;51:1050–1057. 20406335.

14. Dupaul GJ, Power TJ, Anastopoulos AD, Reid R. The ADHD rating scale-IV: Checklists, norm, and clinical interpretation 1998. New York: Guilford Press.

15. Kim HW, Cho SC, Kim BN, Kim JW, Shin MS, Kim Y. Perinatal and familial risk factors are associated with full syndrome and subthreshold attention-deficit hyperactivity disorder in a korean community sample. Psychiatry Investig 2009;6:278–285.

16. Faraone SV, Biederman J, Doyle A, Murray K, Petty C, Adamson JJ, et al. Neuropsychological Studies of Late Onset and Subthreshold Diagnoses of Adult Attention-Deficit/Hyperactivity Disorder. Biol Psychiatry 2006;60:1081–1087. 16876139.

17. Shaffer D, Fisher P, Lucas CP, Dulcan MK, Schwab-Stone ME. NIMH Diagnostic Interview Schedule for Children Version IV (NIMH DISC-IV): description, differences from previous versions, and reliability of some common diagnoses. J Am Acad Child Adolesc Psychiatry 2000;39:28–38. 10638065.

18. Cho SC, Kim BN, Kim JW, Kim HW, Choi HJ, Jung SW, et al. The Reliability and Validity of Diagnostic Interview Schedule for Children Version IV-Korean Version (DISC-IV). J Korean Acad Child Adolesc Psychiatry 2007;18:138–144.

19. Park KS, Yoon JY, Park HJ, Park HJ, Kwon KU. Development of KEDI-WISC, individual intelligence test for Korean children 1996. Seoul: Korean Educational Development Institute.

20. Kaufman AS. A four test short form of the WISC-R. Contemp Educ Psychol 1976;1:180–196.

21. Greenberg LM, Waldman ID. Developmental normative data on the test of variables of attention (T.O.V.A.). J Child Psychol Psychiatry 1993;34:1019–1030. 8408366.

22. Shin MS, Cho SC, Chun SY, Hong KE. A study of the development and standardization of ADHD diagnostic system. J Child Adolesc Psychiatry 2000;11:91–99.

23. D'Elia LF, Satz P, Uchiyama CL, White T. Color Trails Test: Professional manual 1996. O Tdesa: Psychological Assessment Resources.

24. Koo HJ, Shin MS. A standardization study of children's color trails test. J Korean Acad Child Adolesc Psychiatry 2008;19:28–37.

25. Golden CJ. A group version of the stroop color and word test. J Pers Assess 1975;39:386–388. 16367401.

26. Shin MS, Park MJ. Stroop Color and Word Test: A Manual for Clinical and Experimental Uses 2007. Seoul: Hakjisa.

27. Cicchetti DV. Guidelines, criteria, and rules of thumb for evaluating nor-med and standardized assessment instruments in psychology. Psychol Assess 1994;6:284–290.

28. Antrop I, Roeyers H, Oosterlaan J, Oost PV. Agreement between parent and teacher ratings of disruptive behavior disorders in children with clinically diagnosed ADHD. J Psychopathol Behav Assess 2002;24:67–73.

29. Van der Ende J. In : Koot HM, Crijnen AAM, Ferdinand RF, eds. Multiple informants: Multiple views. Child psychiatry epidemiology Accomplishments and future directions 1990. Assen: Van Gorcum & Company. p. 39–52.

30. Naglieri JA, Goldstein S, Delauder BY, Schwebach A. Relationships between the WISC-III and the Cognitive Assessment System with Conners' rating scales and continuous performance tests. Arch Clin Neuropsychol 2005;20:385–401. 15797174.

31. Kuntsi J, Andreou P, Ma J, Borger NA, van der Meere JJ. Testing assumptions for endophenotype studies in ADHD: reliability and validity of tasks in a general population sample. BMC Psychiatry 2005;5:40. 16262903.

32. Zeiner P. Parent-reported symptoms of hyperactivity and attention deficits predict teacher-reported symptoms. Acta Paediatr 1997;86:178–182. 9055889.

33. Tripp G, Schaughency EA, Clarke B. Parent and teacher rating scales in the evaluation of attention-deficit hyperactivity disorder: contribution to diagnosis and differential diagnosis in clinically referred children. J Dev Behav Pediatr 2006;27:209–218. 16775518.

34. Dupaul GJ, Power TJ, McGoey KE, Ikeda MJ, Anastopoulos AD. Reliability and validity of parent and teacher ratings of Attention-Deficit/Hyperactivity Disorder symptoms. J Psychoeduc Assess 1998;16:55–68.

35. Lewinsohn PM, Shankman SA, Gau JM, Klein DN. The prevalence and co-morbidity of subthreshold psychiatric conditions. Psychol Med 2004;34:613–622. 15099416.

36. Scahill L, Schwab-Stone M, Merikangas KR, Leckman JF, Zhang H, Kasl S. Psychosocial and clinical correlates of ADHD in a community sample of school-age children. J Am Acad Child Adolesc Psychiatry 1999;38:976–984. 10434489.

37. Bird HR, Yager TJ, Staghezza B, Gould MS, Canino G, Rubio-Stipec M. Impairment in the epidemiological measurement of childhood psychopathology in the community. J Am Acad Child Adolesc Psychiatry 1990;29:796–803. 2228936.

38. Sanford MN, Offord DR, Boyle MH, Peace A, Racine YA. Ontario child health study: social and school impairments in children aged 6 to 16 years. J Am Acad Child Adolesc Psychiatry 1992;31:60–67. 1537783.

39. Faraone SV, Kunwar A, Adamson J, Biederman J. Personality traits among ADHD adults: implications of late-onset and subthreshold diagnoses. Psychol Med 2009;39:685–693. 18588742.

40. Cho SC, Kim BN, Kim JW, Rohde LA, Hwang JW, Chungh DS, et al. Full syndrome and subthreshold attention-deficit/hyperactivity disorder in a Korean community sample: comorbidity and temperament findings. Eur Child Adolesc Psychiatry 2009;18:447–457. 19205781.

41. Willcutt EG, Doyle AE, Nigg JT, Faraone SV, Pennington BF. Validity of the executive function theory of attention-deficit/hyperactivity disorder: a meta-analytic review. Biol Psychiatry 2005;57:1336–1346. 15950006.

42. Schwartz K, Verhaeghen P. ADHD and Stroop interference from age 9 to age 41 years: a meta-analysis of developmental effects. Psychol Med 2008;38:1607–1616. 18226285.

Article information Continued

(open-access, http://creativecommons.org/licenses/by-nc/3.0) :

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/3.0) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.