Abstract
Objective
Comorbidity poses a major challenge to conventional methods of diagnostic classification. While dimensional models of psychopathology have shed some light on this issue, the reason for inter-relationships among dimensions is unclear. The current study attempted to utilize an alternative approach to characterizing patterns of comorbidity among common mental disorders by modeling them instead as clusters by using latent class analysis.
Method
Latent class analyses (LCA) of DSM diagnoses from two nationally representative epidemiological samples – the National Comorbidity Survey (NCS) and National Comorbidity Survey – Replication (NCS-R) datasets were undertaken.
Results
Within each dataset, LCA yielded five latent classes exhibiting distinctive profiles of diagnostic comorbidity: a fear class (all phobias and panic disorder); a distress class (depression, generalized anxiety disorder, dysthymia); an externalizing class (alcohol and drug dependence, conduct disorder); a multimorbid class (highly elevated rates of all disorders); and a few disorders class (very low probability of all disorders). While some disorders were relatively specific to certain classes, others (major depression, PTSD, social phobia) appeared to be evident across all classes. Profiles for the five classes were highly similar across the two samples. When bipolar I disorder was added to the LCA models, in both samples, it occurred almost exclusively in the multimorbid class.
Conclusions
Comorbidity among mental disorders in the general population appears to occur in a finite number of distinct patterns. This finding has important implications for efforts to refine existing diagnostic classification schemes, as well as for research directed at elucidating the etiology of mental disorders.
The phenomenon of comorbidity poses a serious challenge to traditional psychiatric classification systems such as the DSM and the ICD, which conceptualize mental disorders as discrete pathologic conditions. Factor analytic studies have characterized observed co-occurrence among common mental disorders in terms of two correlated but distinct factors of internalizing (subsuming two interrelated subdimensions of “fear” and “anxious-misery”) and externalizing (antisocial and addictive disorders) [1]. However, the basis of the moderately large correlation between factors of internalizing and externalizing (i.e., the sources of overlap between disorders in one domain and the other) remains unclear [1-7].
A complementary approach to understanding comorbidity which might help shed light on this issue is latent class analysis (LCA) – that is to say, if the same set of disorders that are modeled as dimensions [1-3] are modeled instead as clusters or groups, they might reveal reasons for the correlations among dimensions. In other words, if one imagines diagnostic data as falling along a Cartesian coordinate system, the axes of that system would represent the orthogonal forms of those dimensions, and the classes would reflect “hotspots” of activity along those dimensions. Modeling data in this manner would help reveal what people who had comorbid internalizing and externalizing disorders look like. Is there a particular pattern to their profiles? Are there certain disorders that are more likely to “link” the dimensions? With this aim in mind, the current study utilized LCA to characterize patterns of comorbidity exhibited by individuals in two large-scale epidemiological cohorts – the National Comorbidity Survey (NCS), and the National Comorbidity Survey – Replication (NCS-R) sample. If comorbidity in such clusters or groups of individuals occurred in stable patterns, the number of latent classes revealed by LCA using this particular set of disorders and their configural profiles should replicate across the two epidemiological samples used in the current study.
Previous research has shown that bipolar disorder tends to co-occur frequently with both internalizing and externalizing disorders [8-10]. However, its position in dimensional models of psychopathology is relatively less clear, as it appears to be correlated equally with the fear, anxious-misery, and externalizing dimensions [10]. As a particular strength of the LCA method is that it is relatively unaffected by assumptions of multivariate normality, linearity, or homogeneity [11, 12], it can be used to analyze more severe and rarer forms of psychopathology such as bipolar disorder, which are usually not included in factor analytic models due to their low prevalence rates [1, 2]. Thus, as data regarding bipolar I disorder were available in both the NCS [13] and NCS-R [14], these were added to the LCA models to assess their place in conjunction with internalizing and externalizing psychopathology. These analyses were more exploratory in nature, the relationship between bipolar I disorder and other forms of psychopathology in classification systems is still a much-debated issue [15, 16].
Method
Participants
The NCS and NCS-R are two nationally representative surveys (Ns= 8098 and 9282, respectively) of mental health diagnoses conducted in the United States between 1990-1992 and 2001-2002, respectively, with response rates of 82.6% and 70.9%. Subjects in both surveys consist of noninstitutionalized participants (NCS age range: 15 – 54; NCS-R age range: 18 – 99). Further details regarding the recruitment, consent, and sampling strategy have been documented elsewhere [17-21].
Assessment of Mental Disorders
Lifetime diagnoses were utilized for all analyses of both the NCS and NCS-R datasets. Diagnoses for the two datasets are based on the World Mental Health Survey Initiative Version of the World Health Organization Composite International Diagnostic Interview (WMH-CIDI [22] a structured interview protocol. The version used in the NCS yielded DSM-IIIR [23] diagnoses and the version used in the NCS-R yielded DSM-IV [24] diagnoses. Further details regarding the assessment procedures for each sample are reported elsewhere [17, 19]. Given that the central aim of the study was to characterize patterns of comorbidity, non-hierarchical diagnoses were utilized.
Statistical Analyses
LCA models incorporating the design of the complex datasets including weighting, clustering, and stratification, were carried out using the Latent Gold 4.5 software package [25]. To account for the complex sampling design of the NCS and NCS-R datasets, models were estimated using weighted data, while controlling for stratification and clustering. Participants within each sample were assigned varying weights to adjust for survey nonresponding, variation in probability of selection within and between households, differences across successive phases of surveying, and to approximate the distribution of major demographic variables in the US population. This weighting procedure resulted in adjusted sample sizes (i.e., ‘weighted Ns’; see below) for each sample. Models specifying from 2 to 10 classes were compared. Model fit was assessed using the Bayesian Information Criterion (BIC) [26] and the Akaike Information Criterion (AIC) [27]. Both AIC and BIC are model selection indices that balance model fit and parsimony, but penalize model complexity to different degrees. When comparing models, generally, lowest values of both, or a scree-plot like test (i.e., where AIC and BIC values begin to level off) may be utilized to determine optimal model fit [28, 29]. Each model was run with 50 starting values to avoid problems with local maxima [30].
Four different sets of LCA models were examined including the following sets of disorders:
Mental disorders commonly used in structural models of epidemiological studies [1-3]: Disorders targeted for these LCA analyses consisted of conditions diagnosed most frequently in the general population: specific phobia, social phobia, agoraphobia, panic disorder, post-traumatic stress disorder (PTSD), major depressive disorder, generalized anxiety disorder (GAD), dysthymia, alcohol dependence, drug dependence, and conduct disorder. Separate models of these disorders were examined in both the NCS and NCS-R.
Next, LCA models for both samples were rerun after adding diagnoses of both bipolar disorderi. In each case, profiles obtained from optimal LCA solutions were compared to the models obtained in the previous step.
Although the NCS and NCS-R contain 8098 and 9282 participants, respectively, targeted subsets of each were used to provide full representation of disorders of interest that were present in both samples, to verify if results replicated across both samples. In particular, PTSD, antisocial behavior in the form of conduct disorder, and alcohol and drug problems were available only for subsamples of the NCS and NCS-R. PTSD was assessed in 5877 and 5692 participants of the NCS and NCS-R, respectively. Similarly, in the NCS-R, alcohol and drug problems were assessed only in the subsample with 5692 subjects. Diagnoses of antisocial personality disorder were not a part of the publicly available dataset; however, lifetime diagnoses of conduct disorder were available for a subsample of the NCS-R (N = 3197), ranging from 18-44 years of age. In summary, to permit direct comparison of findings across the two samples, LCAs were performed using subsamples of participants from the NCS and NCS-R (unweighted/weighted Ns = 5,877/5,877 and 3,197/2,980, respectively) who had been assessed for conduct disorder, PTSD and substance use problems, along with other disorders of interest.
Following determination of the best-fitting LCA model in each subsample, parameter estimates of probability of diagnoses for specific disorders, along with standard errors, were compared across classes. Because estimated probabilities for diagnoses of certain disorders were zero or almost zero in some cases, it was not possible to calculate relative indices such as odds ratios or relative risk ratios. As an alternative to this, 95% confidence intervals (CI = estimated value ± [1.96 × standard error of estimate]) are presented for the estimated probabilities of being diagnosed with a particular disorder among individuals in each of the LCA classes.
Results
Identification of Comorbidity Patterns using Latent Class Analysis
For the LCA models with just internalizing and externalizing disorders, in both the NCS and NCS-R samples, a 5-class model fit best according to BIC and AIC (see Table 1; note that AIC values level off after 5 classes for both models). For the LCA models with bipolar disorder, while the NCS revealed a 5-class solution again, in the NCS-R, the BIC indicated a 4-class model, while the AIC suggested a 5-class model. To reconcile this discrepancy, we examined bivariate residuals among disorders in this model (BVRs) [25], and employed the bootstrap likelihood ratio test (BLRT) [32] to formally assess the statistical significance of adding an extra class. BVRs indicate the strength of association between pairs of disorders, after accounting for those modeled by the latent classes; the presence of large BVRs in a model indicates that the model is not adequately capturing such associations. The BLRT evaluates the difference in log-likelihoods between two models by comparing it to an empirically estimated difference distribution generated by bootstrapping. An examination of BVRs among disorders in the 4-class model revealed several large significant associations among the internalizing disorders, suggesting that the 4-class model was not adequately accounting for all relationships among these disorders. Similarly, the BLRT indicated that the additional fifth class significantly improved model fit to data (p < .0001 with 500 replication samples) ii. Thus, given the weight of this evidence, the 5-class model was chosen as the best model in this set of LCA models as well.
Table 1.
Bayesian Information Criterion (BIC) values for latent class analysis models with classes ranging from 2- 10 for National Comorbidity Survey (NCS) subsample (N = 5877), and National Comorbidity Survey – Replication (NCS-R) subsample (N = 2980).
| NCS – INT and EXT Disorders | NCS-R – INT and EXT Disorders | NCS – INT, EXT, and Bipolar I Disorders | NCS-R – INT, EXT, and Bipolar I Disorders | |||||
|---|---|---|---|---|---|---|---|---|
| # of classes | BIC | AIC | BIC | AIC | BIC | AIC | BIC | AIC |
| 2 | 36245.48 | 36091.86 | 16739.16 | 16601.17 | 36489.39 | 36322.42 | 17127.18 | 16977.19 |
| 3 | 35817.59 | 35583.83 | 16622.61 | 16412.62 | 36066.20 | 35812.41 | 17012.32 | 16784.33 |
| 4 | 35660.46 | 35346.56 | 16592.92 | 16310.94 | 35913.46 | 35572.84 | 16972.16 | 16666.17 |
| 5 | 35515.29 | 35121.24 | 16588.74 | 16234.76 | 35761.90 | 35334.46 | 16978.32* | 16594.33 |
| 6 | 35556.84 | 35082.64 | 16621.62 | 16195.64 | 35812.70 | 35298.43 | 17014.53 | 16552.55 |
| 7 | 35605.47 | 35051.13 | 16696.94 | 16198.96 | 35861.43 | 35260.33 | 17094.66 | 16554.68 |
| 8 | 35663.87 | 35029.39 | 16770.71 | 16200.74 | 35930.38 | 35242.46 | 17173.70 | 16555.73 |
| 9 | 35733.12 | 35018.49 | 16849.27 | 16207.31 | 36006.53 | 35231.79 | 17257.67 | 16561.70 |
| 10 | 35808.01 | 35013.24 | 16924.57 | 16210.60 | 36090.67 | 35229.11 | 17344.03 | 16570.07 |
Note: INT – Internalizing; EXT – Externalizing; BIC – Bayes Information Criterion. Best-fitting model for each sample is in boldface.
Bootstrap likelihood ratio test indicates significant difference from 4-class model.
Characterizing the Latent Classes
Inspection of the profiles for the NCS and NCS-R five-class LCA models (see figures 1, 2, 3, and 4) revealed the following. Class 1, the largest of the five classes, showed extremely low probabilities of diagnosis of any disorder. Class 2 was composed of individuals with modal diagnoses of phobias (all types) and panic disorder (to a lesser extent), in conjunction with depression. Class 3 consisted predominantly of subjects diagnosed with depression in conjunction with dysthymia, and also GAD. Class 4 was distinguished by a high prevalence of externalizing disorders (conduct disorder, alcohol dependence, drug dependence), in conjunction with lesser elevations on certain other disorders including depression. The fifth and final class was composed of subjects who demonstrated high levels of both internalizing (fear, distress) and externalizing (antisocial, substance-related) psychopathology, in addition to bipolar I disorder. Given these disorder profiles, we labeled the five classes as follows: few-disorders, fear, distress, externalizing, and multimorbid.
Figure 1.
Profiles of parameter estimates for latent classes derived from best-fitting 5-class LCA model with internalizing and externalizing disorders within the National Comorbidity Survey subsample (NCS; N = 5877).
Figure 2.
Profiles of parameter estimates for latent classes derived from best-fitting 5-class LCA model with internalizing and externalizing disorders within the National Comorbidity Survey - Replication subsample (NCS-R; N = 2980).
Figure 3.
Profiles of parameter estimates for latent classes derived from best-fitting 5-class LCA model internalizing and externalizing disorders, and bipolar I disorder, within the National Comorbidity Survey subsample (NCS; N = 5877).
Figure 4.
Profiles of parameter estimates for latent classes derived from best-fitting 5-class LCA model internalizing and externalizing disorders, and bipolar I disorder, within the National Comorbidity Survey - Replication subsample (NCS-R; N = 2980).
Disorders Common Across Classes
As Figures 1 - 4 illustrate, besides showing marked elevations in disorders most distinct to their class, individuals in the fear, distress, and externalizing classes also showed elevated prevalence of certain other disorders. In particular, across the two participant samples, depression, PTSD, and social phobia occurred in all three of these classes at high rates (> 10% probability, in all cases). Notably, marked elevations in prevalence rates for all disorders were evident in the highly multimorbid class, with the prevalence of some disorders (panic disorder and PTSD, in particular) higher in this class than in any other class across both samples.
Discussion
The current work provides a quantitative-descriptive characterization of patterns of lifetime comorbidity among common mental disorders exhibited by individuals in two large-scale epidemiological samples. Within each sample, LCA revealed five classes with contrasting disorder profiles that were highly similar across the two samples. The classes included a “few-disorders” class with low probabilities of diagnoses of all disorders, and four classes showing elevated probabilities of particular lifetime disorders. While sample size and replication across two different nationally-representative datasets collected a decade apart from each other represent significant strengths of the current study, weaknesses include the fact that diagnoses were determined by interviews administered by laypersons, lifetime diagnoses were based on retrospective recall, and that each sample consisted only of noninstitutionalized subjects. Additionally, certain disorders (PTSD in both the NCS and NCS-R; conduct disorder and substance use disorders in the NCS-R) were assessed on a follow-up basis in selected subsets of participants who met criteria for other diagnoses in an initial assessment. Thus, it is possible that such disorders showed evidence of greater comorbidity because they were selectively associated with classes exhibiting some other diagnosable form of psychopathology.
Nonetheless, despite these limitations, the results are in accordance with previous research that has examined comorbidity using dimensional models in general community or twin samples [1, 2, 33]. In parallel with the models specified in these studies, distinct patterns of comorbidity were evident among individual participants in the current study, reflecting systematic coherency among fear-related disorders (social and specific phobia, agoraphobia, and to a lesser extent panic disorder), among disorders entailing high levels of distress and dysphoria (GAD, dysthymia, and major depression), and among disorders involving deficient impulse control (conduct disorder, alcohol dependence, and drug dependence). Notably, the fear, distress, and externalizing classes were each characterized by high levels of a core group of two to three disorders. This pattern of results indicates that these latent classes do not reflect subsets of individuals who differ simply in overall severity of mental illness, but rather distinct groups of individuals prone to differing combinations of disorders. Additionally, and more importantly, a class emerged that has not been identified in dimensional models—namely, the “multimorbid” class. Across both samples, this class emerged as the smallest of the five classes and it was clearly associated with the greatest overall severity of psychopathology, in terms of high probabilities of endorsement for all disorders. Additionally, what distinguished this class from other classes was the markedly elevated rates of bipolar I disorder relative to all other classes.
With regard to the current findings, it is worth noting that three prior studies have undertaken LCAs of DSM-based disorders and have reported optimal solutions ranging from 6 to 8 latent classes [34-36]. While some commonalities in results are evident across these investigations, direct comparisons are difficult because different sets of disorders and differing time referents (e.g., lifetime versus 12-month diagnoses) were used in these studies. Additionally, the purpose of the current study was to examine psychopathology from a complementary modeling perspective rather than to make a decisive statement on the structure of psychopathology (e.g., x number of classes). Thus, we made a series of a priori decisions that guided our approach in terms of the disorders and time referents utilized in the current analyses, with the aim of using our findings to provide additional insight into the nature of comorbidity underlying internalizing and externalizing psychopathology.
Overlap between Internalizing and Externalizing Domains of Psychopathology
In addition to providing converging evidence for distinct domains of psychopathology marked by excessive fear or pervasive distress (internalizing disorders) or by deficient impulse control (externalizing disorders), the current work also sheds new light on a key unanswered question emerging from dimensional-structural studies: What accounts for the overlap between internalizing and externalizing disorders, reflected in moderate-to-high correlations among factors and subfactors in dimensional models of comorbidity?
The current findings point to two systematic sources for this overlap. One of these pertains to elevated rates within the fear, distress, and externalizing classes of what might be termed cross-class disorders—that is, disorders evident at elevated rates (exceeding estimated probabilities of diagnosis of .1) in each of these classes. This set of disorders included major depression, social phobia, and PTSD. The other source consists of a distinctive subgroup of individuals exhibiting heightened rates of all disorders from both the internalizing and externalizing domains—i.e., the multimorbid class. Across the two study samples, individuals in this class showed: (1) high rates of all phobic disorders (agoraphobia as well as social and specific phobias) – comparable to or higher than those evident in the fear class – along with markedly higher rates of panic disorder; (2) rates of depression, dysthymia, and GAD comparable to those observed in the distress class, along with the highest rates of PTSD compared to all classes; and (3) rates of conduct disorder, alcohol dependence, and drug dependence that substantially exceeded rates in other classes aside from the externalizing class. These observations, by highlighting major ways in which individuals in the fear, distress, and externalizing classes manifest particular disorders characteristic of other classes, suggest ways to account for the overlap that exists between internalizing and externalizing domains.
Homogeneity and Heterogeneity of Disorders
The current findings have implications for traditional conceptions of mental disorders as discrete, etiologically coherent entities. In line with findings from previous structural modeling studies [1-3], common mental disorders were found to co-occur reliably in distinctive patterns, consistent with the idea of shared etiologic underpinnings to differing disorders [37, 38]. As noted above, however, for the four comorbid classes in both the NCS and NCS-R, heightened rates of disorders characteristic of other classes were also evident, with one particular set of disorders (i.e., depression, social phobia, and PTSD) elevated across classes. Although somewhat speculative, this raises the possibility that mechanisms governing manifestations of particular disorders vary according to what class they occur in – i.e., as a function of the overall pattern of affiliated comorbidity.
Consider, for example, major depression, which emerged as one of the three most prevalent diagnoses in all five classes across both samples. While at odds with the traditional idea of depression as a coherent entity, further consideration reveals deeper ties to the extant literature. Longstanding debates exist regarding depression subtypes, and a number of schemes have been proposed including unipolar versus bipolar, episodic versus chronic, and reactive versus endogenous. The occurrence of depression in the context of differing patterns of comorbidity may indicate variability in the nature and etiology of depressive syndromes. Thus, whereas recurrent depression in the context of dysthymia and GAD may reflect a core dysphoric liability, episodes of depression in the context of chronic antisocial behavior and substance abuse may reflect the cumulative impact of adverse consequences over time. Indeed, in this context, it is worth noting that there have been recent calls to demarcate melancholia as a distinct mood disorder from major depression in the upcoming version of the DSM [39]. A similar argument can be made with regard to the syndrome of PTSD, which has been conceptualized as including both internalizing and externalizing variants [40, 41].
More broadly, these cross-class disorders may reflect characteristic output pathways along which psychological discomfort tends to be expressed in most individuals. In support of this notion, rates for these particular disorders were elevated even within the few disorders class in both samples. This suggests that these disorders may be more indicative of general distress or difficulty in dealing with adverse life events. For example, symptoms of depression represent a natural reaction to loss or defeat, symptoms associated with PTSD (e.g., persisting distress and wariness) are common following exposure to extreme stressors, and discomfort in situations involving social performance or evaluation is normative in the population. Thus, though our findings indicate groups of individuals with a preponderance of problems in distinct domains (possibly implying specific underlying vulnerabilities or diatheses along each of these lines), such individuals may be prone to greater levels of psychological discomfort in general, resulting in elevated rates of these common disorders across all classes identified in the current study.
Bipolar I Disorder and Internalizing and Externalizing Psychopathology
An interesting feature of our results pertains to the multimorbid class in the current study, which exhibited high rates of all relatively common disorders utilized in the LCA models, as well as bipolar I disorder. These results fit with data indicating that bipolar I disorder shows substantial comorbidity with internalizing and externalizing disorders of differing types [8, 9]. However, what is particularly noteworthy about this class is that it suggests that the presence of high levels of internalizing and externalizing psychopathology appears to be associated with more than just either.
Understanding Comorbidity from Multiple Perspectives
A final important point concerns how to interpret and understand the phenomenon of comorbidity utilizing results from previous factor analytic work and from work in the current study. As noted earlier, the purpose of the current study was an attempt to provide a complementary descriptive perspective on psychopathology by examining how comorbidity could be understood, when examined as clusters of persons occurring along dimensions of psychopathology. Results from the current study suggest that certain forms of psychopathology – i.e., major depression, social phobia, and PTSD – appear to “link” the dimensions, in addition to a multimorbid class. Thus, these findings could be interpreted from a purely mathematical and statistical point of view, without attributing a deeper meaning to the latent classes we found in the current study.
Alternatively, if one were to interpret the model used in the current study in the spirit of the latent variable model that was utilized, then the results might support the existence of latent classes of mental disorders. For example, as proposed by Jablensky, it could be hypothesized that each of the classes obtained in the current study are “syndromes” reflecting “facets of the same clinical entity” [42]. If one were to draw analogies from this perspective to medical disorders, applying a structural model to symptoms such as fever and headaches that are common to differing disorders such as bacterial meningitis and influenza, would yield correlated “fever” and “headache” factors. This would not mean that meningitis and influenza are the same, nor would it mean that the fever and headache symptoms are unimportant. On the contrary, it is valuable to know both what general syndrome is present so that the appropriate broadband treatment can be applied (e.g., antibiotics, antivirals, or other medication), as well as what individual symptoms (e.g., fever) require in terms of focal treatment. Thus, information from both levels (i.e., both the individual symptoms, as well as how they cluster together) is important to understand and treat the disorder. A similar case can be made for psychopathological syndromes as well.
A third alternative, as noted by Jaspers [43], and more recently suggested by Maj, is that psychopathology may indeed be “intrinsically heterogeneous”, with “ ‘true diseases’ (such as general paresis), which have clear boundaries among themselves and with normality; ‘circles’ (such as manic-depressive insanity and schizophrenia), which have clear boundaries with normality but not among themselves; and ‘types’ (such as neuroses and abnormal personalities), which do not have clear boundaries either among themselves or with normality” [44]. Indeed, results from the current study support such an interpretation as well in that bipolar disorder only appears to intersect with extremes of internalizing and externalizing psychopathology (i.e., the multimorbid class). Future research is doubtless required to understand what the true nature of psychopathology may be [45].
In this context of attempting to understand interrelations among psychopathology from differing perspectives, it is worth noting that there has been a recent effort to develop a “metastructure” of mental disorder clusters for the upcoming version of the DSM (see Psychological Medicine, December 2009 special issue [16, 46-50]). However, a point acknowledged by contributing authors [46] and highlighted in accompanying commentaries [51-53] was that further empirical evidence is required to support a move in this direction. Results from the current study could contribute to such efforts from the perspective of latent variable modeling. However, alternative methods to understanding comorbidity rather than latent variable modeling [54] have been proposed as well. Thus, it remains to be seen which approach will prove most useful with regard to nosological considerations of psychopathology.
In conclusion, our analyses importantly extend prior work by suggesting some possible reasons for overlap among differing dimensions of psychopathology. Ultimately, research that incorporates findings from multiple perspectives of interrelations among differing mental disorders is likely to contribute most to understanding, remediation, and prevention, of disorders of this type.
Acknowledgements
This work was supported by grants MH 65137, MH 072850, and MH 089727 (Patrick), and grants DA 024417, DA 13240, and DA 05147 (Iacono) from the National Institutes of Health.
Footnotes
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication.As a service to our customers we are providing this early version of the manuscript.The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
Declaration of Interest: None
A clinical reappraisal study by Kessler et al. [13] of the diagnoses of bipolar I disorder diagnosis collected in the NCS noted that only a particular form of manic episodes (those that entailed euphoria, grandiosity, and decreased need for sleep) could be validly assessed with the CIDI, and that analyses that used the broader definition of bipolar I disorder that was provided with the dataset might lead to false positives. Thus, we used only this set of manic episodes in our analyses, rather than the diagnostic data provided for bipolar I disorder as a whole. However, we refer to these as “bipolar I disorder” throughout the remainder of the manuscript for the sake of consistency with the bipolar I disorder diagnosis utilized from the NCS-R dataset.
With regard to the NCS-R diagnosis of bipolar I disorder, as there was concern about over-estimation of Bipolar I disorder again by the CIDI, the diagnostic algorithm for bipolar I disorder was recalibrated after data-collection [31]. Consequently, we used this more stringent version of the bipolar I disorder variable that was provided with the NCS-R dataset.
The 4-class solution of this particular NCS-R model collapsed the fear and distress classes into a larger internalizing class.
Contributor Information
Uma Vaidyanathan, Department of Psychology, Florida State University, 1107 W. Call Street, Tallahassee, FL 32306..
Christopher J. Patrick, Department of Psychology, Florida State University, 1107 W. Call Street, Tallahassee, FL 32306..
William G. Iacono, Department of Psychology, University of Minnesota, 75 East River Road, Minneapolis, MN 55455..
References
- 1.Krueger RF. The structure of common mental disorders. Archives of General Psychiatry. 1999;56:921–6. doi: 10.1001/archpsyc.56.10.921. [DOI] [PubMed] [Google Scholar]
- 2.Vollebergh WAM, Iedema J, Bijl RV, de Graaf R, Smit F, Ormel J. The structure and stability of common mental disorders: the NEMESIS study. Archives of General Psychiatry. 2001;58:597–603. doi: 10.1001/archpsyc.58.6.597. [DOI] [PubMed] [Google Scholar]
- 3.Slade T, Watson D. The structure of common DSM-IV and ICD-10 mental disorders in the Australian general population. Psychological Medicine. 2006;36:1593–600. doi: 10.1017/S0033291706008452. [DOI] [PubMed] [Google Scholar]
- 4.Fu Q, Heath AC, Bucholz KK, Nelson E, Goldberg J, Lyons MJ, et al. Shared genetic risk of major depression, alcohol dependence, and marijuana dependence: Contribution of antisocial personality disorder in men. Archives of General Psychiatry. 2002;59:1125–32. doi: 10.1001/archpsyc.59.12.1125. [DOI] [PubMed] [Google Scholar]
- 5.Koenen KC, Fu QJ, Lyons MJ, Toomey R, Goldberg J, Eisen SA, et al. Juvenile conduct disorder as a risk factor for trauma exposure and posttraumatic stress disorder. Journal of Traumatic Stress. 2005;18:23–32. doi: 10.1002/jts.20010. [DOI] [PubMed] [Google Scholar]
- 6.Kim-Cohen J, Caspi A, Moffitt TE, Harrington H, Milne BJ, Poulton R. Prior juvenile diagnoses in adults with mental disorder: developmental follow-back of a prospective-longitudinal cohort. Archives of General Psychiatry. 2003;60:709–17. doi: 10.1001/archpsyc.60.7.709. [DOI] [PubMed] [Google Scholar]
- 7.Subbarao A, Rhee SH, Young SE, Ehringer MA, Corley RP, Hewitt JK. Common genetic and environmental influences on major depressive disorder and conduct disorder. Journal of Abnormal Child Psychology. 2008;36:433–44. doi: 10.1007/s10802-007-9189-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Krishnan KRR. Psychiatric and medical comorbidities of bipolar disorder. Psychosomatic Medicine. 2005;67:1–8. doi: 10.1097/01.psy.0000151489.36347.18. [DOI] [PubMed] [Google Scholar]
- 9.Simon NM, Otto MW, Wisniewski SR, Fossey M, Sagduyu K, Frank E, et al. Anxiety disorder comorbidity in bipolar disorder patients: data from the first 500 participants in the Systematic Treatment Enhancement Program for Bipolar Disorder (STEP-BD). American Journal of Psychiatry. 2004;161:2222–9. doi: 10.1176/appi.ajp.161.12.2222. [DOI] [PubMed] [Google Scholar]
- 10.Watson D. Rethinking the mood and anxiety disorders: a quantitative hierarchical model for DSM-V. Journal of Abnormal Psychology. 2005;114:522–36. doi: 10.1037/0021-843X.114.4.522. [DOI] [PubMed] [Google Scholar]
- 11.Magidson J, Vermunt JK. Latent Class Models. In: Kaplan D, editor. Handbook of Quantitative Methodology. Sage; London: 2004. pp. 175–98. [Google Scholar]
- 12.McCutcheon AL. Latent class analysis. Sage; Newbury Park, CA: 1987. [Google Scholar]
- 13.Kessler RC, Rubinow DR, Holmes C, Abelson JM, Zhao S. The epidemiology of DSM-III-R bipolar I disorder in a general population survey. Psychological Medicine. 1997;27:1079–89. doi: 10.1017/s0033291797005333. [DOI] [PubMed] [Google Scholar]
- 14.Merikangas KR, Akiskal HS, Angst J, Greenberg PE, Hirschfeld RMA, Petukhova M, et al. Lifetime and 12-Month prevalence of bipolar spectrum disorder in the National Comorbidity Survey Replication. Archives of General Psychiatry. 2007;64:543–52. doi: 10.1001/archpsyc.64.5.543. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Goldberg DP, Andrews G, Hobbs MJ. Where should bipolar disorder appear in the meta-structure? Psychological Medicine. 2009;39:2071–81. doi: 10.1017/S0033291709990304. [DOI] [PubMed] [Google Scholar]
- 16.Carpenter WT, Bustillo JR, Thaker GK, van Os J, Krueger RF, Green MJ. The psychoses: Cluster 3 of the proposed meta-structure for DSM-V and ICD-11. Psychological Medicine. 2009;39:2025–42. doi: 10.1017/S0033291709990286. [DOI] [PubMed] [Google Scholar]
- 17.Kessler RC, McGonagle KA, Zhao S, Nelson CB, Hughes M, Eshleman S, et al. Lifetime and 12-Month prevalence of DSM-III-R psychiatric disorders in the United States: results from the National Comorbidity Survey. Archives of General Psychiatry. 1994;51:8–19. doi: 10.1001/archpsyc.1994.03950010008002. [DOI] [PubMed] [Google Scholar]
- 18.Kessler RC, Merikangas KR. The National Comorbidity Survey Replication (NCS-R): background and aims. International Journal of Methods in Psychiatric Research. 2004;13:60–8. doi: 10.1002/mpr.166. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Archives of General Psychiatry. 2005;62:593–602. doi: 10.1001/archpsyc.62.6.593. [DOI] [PubMed] [Google Scholar]
- 20.Kessler RC, Berglund P, Chiu WT, Demler O, Heeringa S, Hiripi E, et al. The US National Comorbidity Survey Replication (NCS-R): design and field procedures. International Journal of Methods in Psychiatric Research. 2004;13:69–92. doi: 10.1002/mpr.167. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Wittchen H-U. Reliability and validity studies of the WHO-Composite International Diagnostic Interview (CIDI): A critical review. Journal of Psychiatric Research. 1994;28:57–84. doi: 10.1016/0022-3956(94)90036-1. [DOI] [PubMed] [Google Scholar]
- 22.World Health Organization . International Classification of Diseases, 10th Revision (ICD-10) World Health Organization; Geneva, Switzerland: 1992. [Google Scholar]
- 23.American Psychiatric Association . Diagnostic and Statistical Manual of Mental Disorders, Revised Third Edition. American Psychiatric Association; Washington, DC: 1987. [Google Scholar]
- 24.American Psychiatric Association . Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition. American Psychiatric Association; Washington, DC: 1994. [Google Scholar]
- 25.Vermunt JK, Magidson J. Technical Guide to Latent Gold 4.5. Statistical Innovations Inc.; Belmont, MA: 2007. [Google Scholar]
- 26.Schwarz G. Estimating the dimension of a model. The Annals of Statistics. 1978;6:461–4. [Google Scholar]
- 27.Akaike H. A new look at the statistical model identification. Automatic Control, IEEE Transactions on. 1974;19:716–23. [Google Scholar]
- 28.Sclove SL. Application of model-selection criteria to some problems in multivariate analysis. Psychometrika. 1987;52:333–43. [Google Scholar]
- 29.Bradshaw CP, Buckley JA, Ialongo NS. School-based service utilization among urban children with early onset educational and mental health problems: The squeaky wheel phenomenon. School Psychology Quarterly. 2008;23:169–86. [Google Scholar]
- 30.Goodman LA. Exploratory latent structure analysis using both identifiable and unidentifiable models. Biometrika. 1974;61:215–31. [Google Scholar]
- 31.Revised Algorithm for Bipolar Spectrum. 2007 [Google Scholar]
- 32.McLachlan GJ, Peel D. Finite Mixture Models. John Wiley; New York: 2000. [Google Scholar]
- 33.Kendler KS, Prescott CA, Myers J, Neale MC. The structure of genetic and environmental risk factors for common psychiatric and substance use disorders in men and women. Archives of General Psychiatry. 2003;60:929–37. doi: 10.1001/archpsyc.60.9.929. [DOI] [PubMed] [Google Scholar]
- 34.Kessler RC, Chiu WT, Demler O, Walters EE. Prevalence, severity, and comorbidity of 12-Month DSM-IV disorders in the National Comorbidity Survey Replication. Archives of General Psychiatry. 2005;62:617–27. doi: 10.1001/archpsyc.62.6.617. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Kessler RC. The prevalence of psychiatric comorbidity. In: Wetzler S, Sanderson, William C, editors. Treatment Strategies for Patients With Psychiatric Comorbidity. John Wiley & Sons; New York, NY: 1997. pp. 23–48. [Google Scholar]
- 36.Sullivan PF, Kendler KS. Typology of common psychiatric syndromes. an empirical study. British Journal of Psychiatry. 1998;173:312–9. doi: 10.1192/bjp.173.4.312. [DOI] [PubMed] [Google Scholar]
- 37.Krueger RF, Hicks BM, Patrick CJ, Carlson SR, Iacono WG, McGue M. Etiologic connections among substance dependence, antisocial behavior and personality: modeling the externalizing spectrum. Journal of Abnormal Psychology. 2002;111:411–24. [PubMed] [Google Scholar]
- 38.Mineka S, Watson D, Clark LA. Comorbidity of anxiety and unipolar mood disorders. Annual Review of Psychology. 1998;49:377–412. doi: 10.1146/annurev.psych.49.1.377. [DOI] [PubMed] [Google Scholar]
- 39.Parker G, Fink M, Shorter E, Taylor MA, Akiskal H, Berrios G, et al. Issues for DSM-5: Whither melancholia? The case for Its classification as a distinct mood disorder. American Journal of Psychiatry. 2010;167:745–7. doi: 10.1176/appi.ajp.2010.09101525. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Miller MW, Greif JL, Smith AA. Multidimensional personality questionnaire profiles of veterans with traumatic combat exposure: Externalizing and internalizing subtypes. Psychological Assessment. 2003;15:205–15. doi: 10.1037/1040-3590.15.2.205. [DOI] [PubMed] [Google Scholar]
- 41.Miller MW, Kaloupek DG, Dillon AL, Keane TM. Externalizing and internalizing subtypes of combat-related PTSD: A replication and extension using the PSY-5 Scales. Journal of Abnormal Psychology. 2004;113:636–45. doi: 10.1037/0021-843X.113.4.636. [DOI] [PubMed] [Google Scholar]
- 42.Jablensky A. The syndrome - an antidote to spurious comorbidity? World Psychiatry. 2004;3:24–5. [PMC free article] [PubMed] [Google Scholar]
- 43.Jaspers K. General Psychopathology. Johns Hopkins University Press; Baltimore, MD: 1913. [Google Scholar]
- 44.Maj M. ‘Psychiatric comorbidity’: an artefact of current diagnostic systems? The British Journal of Psychiatry. 2005;186:182–4. doi: 10.1192/bjp.186.3.182. [DOI] [PubMed] [Google Scholar]
- 45.Kendell R, Jablensky A. Distinguishing between the validity and utility of psychiatric diagnoses. American Journal of Psychiatry. 2003;160:4–12. doi: 10.1176/appi.ajp.160.1.4. [DOI] [PubMed] [Google Scholar]
- 46.Andrews G, Goldberg DP, Krueger RF, Carpenter WT, Hyman SE, Sachdev P, et al. Exploring the feasibility of a meta-structure for DSM-V and ICD-11: could it improve utility and validity? Psychological Medicine. 2009;39:1993–2000. doi: 10.1017/S0033291709990250. [DOI] [PubMed] [Google Scholar]
- 47.Sachdev P, Andrews G, Hobbs MJ, Sunderland M, Anderson TM. Neurocognitive disorders: Cluster 1 of the proposed meta-structure for DSM-V and ICD-11. Psychological Medicine. 2009;39:2001–12. doi: 10.1017/S0033291709990262. [DOI] [PubMed] [Google Scholar]
- 48.Andrews G, Pine DS, Hobbs MJ, Anderson TM, Sunderland M. Neurodevelopmental disorders: Cluster 2 of the proposed meta-structure for DSM-V and ICD-11. Psychological Medicine. 2009;39:2013–23. doi: 10.1017/S0033291709990274. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Goldberg DP, Krueger RF, Andrews G, Hobbs MJ. Emotional disorders: Cluster 4 of the proposed meta-structure for DSM-V and ICD-11. Psychological Medicine. 2009;39:2043–59. doi: 10.1017/S0033291709990298. [DOI] [PubMed] [Google Scholar]
- 50.Krueger RF, South SC. Externalizing disorders: Cluster 5 of the proposed meta-structure for DSM-V and ICD-11. Psychological Medicine. 2009;39:2061–70. doi: 10.1017/S0033291709990328. [DOI] [PubMed] [Google Scholar]
- 51.First MB. Reorganizing the diagnostic groupings in DSM-V and ICD-11: a cost/benefit analysis. Psychological Medicine. 2009;39:2091–7. doi: 10.1017/S0033291709991152. [DOI] [PubMed] [Google Scholar]
- 52.Jablensky A. A meta-commentary on the proposal for a meta-structure for DSM-V and ICD-11. Psychological Medicine. 2009;39:2099–103. doi: 10.1017/S0033291709991292. [DOI] [PubMed] [Google Scholar]
- 53.Wittchen H-U, Beesdo K, Gloster AT. A new meta-structure of mental disorders: a helpful step into the future or a harmful step back to the past? Psychological Medicine. 2009;39:2083–9. doi: 10.1017/S0033291709991334. [DOI] [PubMed] [Google Scholar]
- 54.Cramer AOJ, Waldorp LJ, van der Maas HLJ, Borsboom D. Comorbidity: A network perspective. Behavioral and Brain Sciences. 2010;33:137–50. doi: 10.1017/S0140525X09991567. [DOI] [PubMed] [Google Scholar]




