SciELO - Scientific Electronic Library Online

 
vol.35 número1Eventos vitales estresantes en niños de 3 a 15 años duranse la pandemia de COVID-19: un análisis de clases latentesConducta suicida y uso problemático de Internet en estudiantes universitarios índice de autoresíndice de assuntospesquisa de artigos
Home Pagelista alfabética de periódicos  

Serviços Personalizados

Journal

Artigo

Indicadores

Links relacionados

  • Em processo de indexaçãoCitado por Google
  • Não possue artigos similaresSimilares em SciELO
  • Em processo de indexaçãoSimilares em Google

Compartilhar


Psicothema

versão On-line ISSN 1886-144Xversão impressa ISSN 0214-9915

Psicothema vol.35 no.1 Oviedo Fev. 2023  Epub 12-Fev-2024

https://dx.doi.org/10.7334/psicothema2022.17 

Articles

Network analysis of internalizing and externalizing symptoms in children and adolescents

Análisis de redes de síntomas internalizados y externalizados en niños y adolescentes

Milagros Ocalin Sánchez-Hernández1  , Francisco Pablo Holgado-Tello2  , Miguel Á Carrasco2 

1National Autonomous University of Nicaragua, Leon (UNAN-León), Nicaragua

2National University of Distance Education (UNED)

Abstract

Background:

Experiencing psychological problems during childhood and adolescence is common. However, the detection of behaviors as symptoms of psychopathologies requiring clinical diagnosis and treatment remains low. In order to advance understanding of psychological phenomena and particularly their behavioral manifestations, new theoretical and methodological perspectives such as network analysis are applied.

Method:

In the present study, we explore the dynamics of the symptoms of different internalizing, externalizing, and personal-contextual problems using network analysis. We estimate networks of regularized partial correlations, including measures of standard centrality, and the global and structural impact of symptoms on each network.

Results:

The results show that the syndromes we studied are activated through dynamics of symptoms that are strongly related to each other and act as intermediaries of potential psychopathological problems in children and adolescents (e.g., “feels sad,” “worries,” “won't talk,” “nausea,” “threatens others,” “steals outside”). Centrality measures and impact coefficient ranges were strength (−2.39, 2.05), betweenness (−1.43, 3.38), closeness (−2.60, 2.23), and expected influence (−2.87, 2.13).

Conclusions:

The results suggest the need to explore attribute dynamics as well as symptomatic comorbidity between them.

Keywords: Symptoms; psychopathology; children; adolescents; network analysis

Resumen

Antecedentes:

La experiencia de problemas psicológicos durante la infancia y la adolescencia es común. Sin embargo, la detección de conductas como síntomas de Psicopatologías que requieren diagnóstico y tratamiento clínico sigue siendo infravalorada. Por ello, para evolucionar en la comprensión de los fenómenos psicológicos considerando sus manifestaciones conductuales particulares, se aplican nuevas perspectivas teóricas y metodológicas como el análisis de redes.

Método:

En el presente estudio exploramos la dinámica de los síntomas de diferentes problemas internalizados y externalizados y personales-contextuales aplicando el análisis de redes. Se estimaron redes de correlaciones parciales regularizadas que incluye medidas de centralidad estándar e impacto global y estructural de los síntomas de distintos síndromes.

Resultados:

Los resultados muestran que los síndromes se activan a través de dinámicas de síntomas fuertemente relacionados con los demás y que actúan como intermediarios de potenciales problemas psicopatológicos en niños y adolescentes (por ejemplo, "sentirse triste", "preocuparse", "negarse a hablar", "tener náuseas", "amenazar a los demás", "robar fuera"). Las medidas de centralidad y coeficientes de impacto oscilaron entre: fuerza (−2.39, 2.05), intermediación (−1.43, 3.38), cercanía (−2.60, 2.23) e influencia esperada (−2.87, 2.13).

Conclusiones:

Los resultados obtenidos sugieren la necesidad de explorar la dinámica multiconstructo, así como la comorbilidad sintomática entre ellas.

Palabras clave: Síntomas; psicopatología; niños; adolescentes; análisis de redes

Research shows that serious emotional and behavioral problems occur during childhood and adolescence (Ezpeleta et al., 2014; Polanczyk et al., 2015; Solmi et al., 2022). Development from infancy to adolescence involves the acquisition of numerous emotional, cognitive, and social skills in interaction with the multiple contexts in which children grow up (e.g., family, school, society). These interactions are the basis for children and adolescents reaching maturity and autonomy (Kostelnik et al., 2009; Maddux & Winstead, 2016). Throughout this process, the analysis and identification of dysfunctional behaviors and emotional symptoms play an essential role in the early detection of possible mental health problems (Solmi et al., 2022).

The study of mental health in the child-adolescent populations has evolved over the last three decades (Dozois, 2019). The existence of child psychopathology was recognized in the 19th century, and understanding of it improved substantially with the inclusion of childhood disorders in the categorical classifications for clinical diagnosis in the mid to late 1980s (Dozois, 2019; González, 2000). This included categorical classification systems such as the Diagnostic and Statistical Manual of Mental Disorders in its successive versions, up to the current one (American Psychiatric Association, 2013), which remains the predominant standard classification manual internationally for the identification of psychopathological disorders. Recently, in the search for further classificatory alternatives, two broad-spectrum dimensions that characterize child psychopathology were found based on empirical research: internalizing and externalizing problems (Achenbach, 1991; Achenbach et al., 2017). Internalizing disorders are characterized by disordered moods or behaviors such as withdrawal, anxiety, depression, or somatic complaints, whereas externalizing disorders are characterized by disordered behaviors such as rule-breaking and aggressive behavior syndromes. These broadband dimensions have been included even in dimensional taxonomies like the Hierarchical Taxonomy of Psychopathology [HiTOP], which proposes the idea that shared maladaptive symptoms and traits are grouped by nomological criteria into subfactors and spectra (Conway et al., 2019; DeYoung et al., 2022; Forbes et al., 2021; Kotov et al., 2021; Krueger et al., 2018; Ruggero et al., 2019).

Methodologically, to measure the relationships between psychological constructs and observable variables (items and particular manifest behavior), two traditional approaches have been applied: the reflective model congruent with Factor Analysis, where the psychological construct is seen as the common cause of the observed behaviors (e.g., depression is the cause of sadness, crying, etc.), and the formative model, where the observed behaviors define or determine the construct (e.g., diet, exercise, and self-care together define health). These two approaches involve conducting the statistical analysis on the structure of the psychopathological construct (as an aggregate score) but not on the dynamics of manifest symptoms (Borsboom et al., 2011; Fried et al., 2017; Guyon et al., 2017). In response to this important limitation, the network analysis paradigm emerges (Borsboom et al., 2011; Epskamp, 2017; Fonseca-Pedrero, 2017, 2018) as a way of exploring behaviors and symptoms that can lead to a more dynamic, dimensional, and transdiagnostic approach to psychopathology. The network perspective treats psychological constructs as dynamic systems whose components may be autonomous causal agents that influence each other beyond an underlying cause. From this perspective, the concept of latent variable is obviated in the measurement of variables, and instead specific behaviors (not constructs) theoretically and empirically recognized as dysfunctional are proposed (Epskamp, 2017; van Bork, 2019).

Analysis of the network as a dynamic system of relationships identifies the “core” components (i.e., those with the strongest connections) that are responsible for symptom activation and impact on the structure or connectivity of the system or network itself (Borsboom & Cramer, 2013; Fried, 2017; Guyon et al., 2017; Jones, 2017; Jones et al., 2021). On the network model, the notion of mental health would correspond to a stable state of a weakly connected network of symptoms, while psychological disorders would correspond to stable states of strongly connected symptom networks (Borsboom, 2017).

Although the last decade has brought a growing body of research studying psychopathology from the network perspective, there are still very few studies with child and adolescent populations focusing on the dynamics of the symptoms, especially on externalizing problems. McElroy et al. (2018) used network analysis to study the relationships between anxiety and depression symptoms in children from 5 to 14 years old in a sample of 1,147 children. They found that states of being “anxious,” “sad,” “nervous,” and “worthless” were core symptoms in maintaining the network of mixed anxiety and depression over the years studied. Subsequently, in a clinical sample of 37,162 participants with an average age of 13 years, this same research group identified the symptoms that had the greatest impact (expected influence) on the relationships between some internalizing symptoms such as “sudden feelings of anxiety for no apparent reason,” “fear of being ridiculous in public,” “worry,” and “feelings of worthlessness.” Eating problems and compulsive behaviors showed the least expected influence (McElroy & Patalay, 2019).

In a longitudinal analysis, Funkhouser et al. (2021) found three communities of symptoms or domains: Inattention, externalizing problems, and internalizing problems. In these three domains, the most central symptoms, which best predicted the rest, were depressive mood, inattention, and worry. With a sample of 551 Norwegian children (age 3-12) with moderate to high levels of conduct problems, Hukkelberg (2019) found the majority of behaviors clustered into two distinct domains, reflecting inattention and oppositional defiant behavior. Thus, “Does not obey house rules in his/her own (house),” which showed the highest betweenness centrality, appears to be a central behavior in connecting the various behaviors. In addition, the items “has a short attention span” and “verbally fights with friends his/her own age” showed high centrality strengths.

The general aim of this study is to identify the most relevant symptoms responsible for the activation of other associated symptoms. More specifically, the aim is to explore the dynamics of symptoms using a network analysis of the various syndromes of emotional and behavioral problems in children established by Achenbach and Rescorla (2001): Internalizing problems (depression, anxiety, withdrawal, and somatic complaints), externalizing problems (rule-breaking and aggressive behavior), and other problems of a mixed and contextual nature (attention problems, thought problems, and social problems). This allows us to know the dynamics of symptoms of psychological problems and the delimitation of potential mechanisms that give rise to a particular psychological disorder. It would be one of the few studies to explore the relationships among internalizing and externalizing symptoms in children and adolescents using network analysis.

In accordance with the previous studies, we expect symptoms related to negative affect (i.e., anxiety, sadness, fear) to be the most relevant symptoms responsible for activating internalizing symptoms (McElroy et al., 2018), whereas inattention and oppositional defiant behaviors are expected to be the most relevant symptoms for externalizing problems (Hukkelberg, 2019; Funkhouser et al., 2021). Since, to the best of our knowledge, no differential studies focused on each type of disorder have been conducted, no specific hypotheses can be formulated for each particular disorder.

Method

Participants

The sample consisted of 986 Spanish children and adolescents, including 540 girls (55%) and 446 boys (45%). Their ages ranged from 9 to 18 years (M = 13.09, SD = 2.01). Participants were selected from various public and charter schools in several Spanish cities (Logroño, Vitoria, Burgos, Cádiz, Algeciras, Jaen, Madrid, and Segovia). The participants were enrolled at three educational levels (primary school, secondary school, and bachelor's degree). The primary-school students were in grades 4 (9-10 years old) through 6 (11-12 years old), while for those in secondary school and above, all grades and levels were represented from the first-year course in secondary school (ages 12-13) to the fourth (ages 15-16) and from the first year of bachelor's studies (ages 16-17) to the second (ages 17-18). In general terms, the family structures were as follows: children, father, and mother living together (84.9%); children living with mother (6.2%); children living with father (1.1%); and children in shared custody (5.5%). As shown in Table 1, the distribution of participants according to age and sex variables was homogeneous (χ2 = 2.56, gl = 3, p = 0.47).

The inclusion criteria called for participants between the ages of 9 and 18, belonging to both sexes, who were present in the classroom on the days the instruments were administered and who had their parents' authorization to participate in the study (in the case of minors). The exclusion criteria were not having parental authorization to participate in the study and not being present at the evaluation sessions.

Table 1. Distribution of participants by sex and age groups. 

Sex 9-10 years old 11-12 years old 13-14 years old 15-18 years old Total
Boys 47 (4.77%) 119 (12.07%) 167 (16.93%) 113 (11.46%) 446 (45.23%)
Girls 60 (6.09%) 157 (15.92%) 176 (17.84%) 147 (14.91%) 540 (54.77%)
Total 107 (10.85%) 276 (27.99%) 343 (34.79%) 260 (26.36%) 986

Note.The percentages in brackets apply to the total sample.

Instruments

Clinical symptoms of depression were measured using the Center for Epidemiological Studies Depression Scale for Children and Adolescents, CES-DC (Radloff, 1977, 1991; Weissman et al., 1980), Spanish version, by Sánchez-Hernández et al. (2018). This scale groups behaviors into Depressed Affect, Somatic Symptoms, Interpersonal Problems, and Positive Affect. It consists of 20 items with four Likert-type response options (1 = almost nothing to 4 = a lot). The reliability of the scale using the Omega coefficient for this sample was ꞷ = .92. The dimensions measured were Depressed Affect (7 items, ꞷ = .91), Somatic Symptoms (7 items, ꞷ = .73), Interpersonal Problems (2 items, ꞷ = .72), and Positive Affect (4 items, ꞷ = .75) (using its natural score of constructs with positive connotation). Using the CES-DC as opposed to using only the Youth Self-Report (YSR) allowed the evaluation of a specific range of depressive symptoms, which was not sufficiently represented in the latter.

The YSR (Achenbach, 1991; Achenbach & Rescorla, 2001; Spanish version by Unitat d'Epidemiologia i de Diagnòstic en Psicopatologia del Desenvolupament, 2001) is a self-report that evaluates emotional and behavioral problems in children and adolescents. It has 112 items measured on a Likert-type scale with three answer options (0 = not true to 3 = true, very often, or fairly often). The higher the score on the subscales, the higher the degree of psychopathology. The test groups the constructs into: (a) Internalizing Problems (Anxiety-Depression, Withdrawn-Depression, and Somatic Complaints); (b) Externalizing Problems (Aggressive Behavior and Rule-Breaking Behavior); and (c) Problems of a Mixed Personal-Contextual Nature (Thought Problems, Attention Problems, and Social Problems). For the present study, certain symptoms referring to depression were excluded (items 14, 52, 91, and 33 of Anxiety-Depression; items 5, 102, and 103 of Withdrawn-Depression) because they were already contained in the CES-DC. Therefore, the respective reliabilities of the subscales for Internalizing Problems, applying the Omega coefficient for the present sample, were: Anxiety (8 items, ꞷ = .66), Withdrawn (5 items, ꞷ = .70), and Somatic Complaints (10 items, ꞷ = .71). Under Externalizing Problems, the reliabilities were: Aggressive Behavior (17 items, ꞷ = .84) and Rule-Breaking Behavior (15 items, ꞷ = 79). Under Problems of a Mixed Personal-Contextual Nature, the reliabilities were: Thought Problems (12 items, ꞷ = .75), Attention Problems (9 items, ꞷ = .78), and Social Problems (11 items, ꞷ = .71) .

Procedure

The Ethics Commission of the National University of Distance Education (UNED) authorized the study and affirmed its compliance with the ethical and data protection standards required by European legislation. Authorization was then requested from the schools and informed consent sought from the participants' parents and the participants themselves. To guarantee the participants' anonymity, all questionnaires were identified using a code that allowed anonymization. Participation was voluntary, and it was ensured that the instructions and evaluation conditions were similar for all participants.

The children answered the questionnaires collectively at the school building under researcher supervision. Since the administration was tightly controlled, practically all the children answered the questionnaires. Two 45-minute periods were used, adjacent to recess, during which students completed the sociodemographic questionnaire and assessment protocol. The guess response of each participant was neither evaluated nor controlled.

Data Analysis

The R software package Version 4.0.3 (R Core Team, 2020) was used to conduct all analyses. First, an exploratory descriptive analysis of the items was performed. In total, the highest percentages of missing data were 2% for the CES-DC items and 3% for the YSR items. It is standard to consider percentages under 20% to be candidates for imputation (Hair et al., 2014). Multiple imputation is recommended as the best method for Likert-type scales (Brown, 2015; Enders, 2010), even for CES-DC (Bono et al., 2007); and among the available multiple imputation techniques, considering the various patterns of missing data, the most appropriate one, is the random forest approach (Kokla et al., 2019; Shah et al., 2014; Tang & Ishwaran, 2017). Hence, in the present study, missing data were imputed with multiple imputation via the random forest technique using the MICE package Version 3.10.0 (van Buuren & Groothuis-Oudshoorn, 2011).

To explore the relationships between symptoms, regularized partial correlation networks were estimated, which graphically represent a model in which statistically significant relationships between symptoms are displayed. To identify the most salient symptoms, standard centrality measures were evaluated: strength [St] (sum of absolute partial correlation coefficients between a node and all other nodes), betweenness [Bet] (how many of the shortest paths between two nodes go through the node in question), closeness [Clo] (how strongly a node is indirectly connected to other nodes in the network), and expected influence [EI] (which takes into account negative associations among nodes) (Costantini et al., 2015; Epskamp, 2017). Both analyses were estimated using the qgraph, centralityTable, and centralityPlot functions in the qgraph package, Version 1.6.5 (Epskamp et al., 2012). The global strength impacts (GSI) (how a node affects the overall connectivity of the network) and network structure impacts (NSI) (how a node could cause changes in the network structure) of the nodes were studied. They were estimated using the impact function with the networktools package, Version 1.2.3 (Jones, 2020). Both indexes refer to the concept of impact and are related to the degree to which the nodes impact or could be affecting the network structure (Jones, 2017).

Results

Internalizing Problems

Figure 1 shows the centrality measures, impact coefficients, and regularized networks of each of the Internalizing Problems. The depressive symptoms that best activate others, facilitate rapid activation, and mediate the activation between symptoms in the network, as shown in Panel A, are: “Feels lonely” (CES14) (St = 2.05, EI = 1.63, Bet = 1.65, Clo = 1.38) and “Thinks life has been a failure” (CES9) (St = 1.30, EI = 1.12, Bet = 3.38, Clo = 2.23). A third symptom that stands out in the dynamics of depression is “Feels sad” (CES18), since it has a high influence on activating the network (St = 1.88, EI = 1.52) and has the greatest impact (GSI = 2.00) on connectivity. However, its activation speed (Clo = 0.38) and role as an intermediary (Bet = 0.46) are moderate.

Figure 1. Network Analysis Measures of Internalizing Problems. 

The symptoms that activate anxiety, as shown in Panel B, are characterized by being prominent intermediaries and connecting nodes in the network (high proximity), although the number and weight of their connections tend to be moderate : “Anxious” (YSR50) (St = 1.80, EI = 1.80, Bet = 1.35, Clo = 1.41), “Fears school” (YSR30) (St = 0.76, EI = 0.76, Bet = 1.35, Clo = 1.00), and “Worries” (YSR112) (St = 0.74, EI = 0.74, Bet = 0.75, Clo = 0.26). The latter has the greatest impact on the connectivity of symptoms (GSI > 1.00).

Withdrawn Behaviors are shown in the visualized partial correlation network in Panel C. This network is characterized by being scattered; the behaviors most notable for their connections are “Won't talk” (YSR65) (St = 1.72, EI = 1.72, Bet = 1.57, Clo = 1.52), and “Secretive” (YSR69) (Bet = 0.45, Clo = 0.44), which stands out as an intermediary and activator, having connections that are few, but strong (St = 0.03, EI = 0.03).

Somatic Complaints are shown in Panel D. This network is dense, and the most relevant behaviors due to the number of their connections and their being the best mediators are “Nausea” (YSR56c) (St = 1.79, EI = 1.71, Bet = 1.19) and “Vomiting "(YSR56g) (St = 1.18, Bet = 1.93).

Externalizing Problems

In Figure 2, centrality measures and impact coefficients of Externalizing Problems are presented. In Panel A, Aggressive Behaviors can be seen to be densely connected; but the most prominent for having the strongest connections, revealing itself as the best intermediary and quickly activating the network, is “Threatens others” (YSR97) (St = 1.56, EI = 1.15, Bet = 1.36, Clo = 1.26). Other relevant behaviors are: “Attacks people” (YSR57) (St = 0.77, EI = 1.09), which is relevant for its strength, and “Loud” (YSR104) (Bet = 1.69), “Teases a lot” (YSR94) (Bet = 1.36), and “Argues a lot” (YSR3) (Bet = 1.69, Clo = 1.26), which are relevant for their high mediation. The last of these is the only one with high proximity, which is why it tends to quickly activate the behaviors that are connected to it. The behaviors with the greatest impact on network connectivity (GSI > 1.00) are: “Argues a lot” (YSR3) and “Suspicious” (YSR89).

Figure 2. Network Analysis Measures of Externalizing Problems. 

In relation to Rule-Breaking Behavior in Panel B, the behaviors most outstanding for having the strongest connections, showing the best intermediaries, and quickly activating the network are: “Breaks rules” (YSR28) (St = 1.75, EI = 1.12, Bet = 2.52, Clo = 1.46) and “Steals outside home” (YSR82) (St = 1.56, EI = 2.13, Bet = 1.14, Clo = 1.41). Regarding the impact of behaviors on the strength of connections (GSI > 1.00), the most relevant are: “Swearing” (YSR90), “Lying” (YSR43), “Lacks guilt” (YSR26), and “Prefers to be accompanied by older kids” (YSR63).

Personal and Contextual Problems

The findings on Attention Problems, Thought Problems, and Social Problems are presented in Figure 3. As can be seen in Panel A, the symptoms that have strong connections, act as intermediaries, and more rapidly activate this syndrome are: “Confused” (YSR13) (St = 1.13, EI = 1.13, Bet = 2.02, Clo = 1.16), “Inattentive” (YSR78) (St = 1.15, EI = 1.15, Bet = 1.36, Clo = 1.41), and “Can't concentrate” (YSR8) (St = 1.29, EI = 1.29, Bet = 0.04, Clo = 1.09). At the same time, “Impulsive” (YSR41) has a greater impact on connectivity (GSI > 1.00), and “Can't sit still” (YSR10) and “Inattentive” (YSR78) have a greater impact on the network structure (NSI > 1.00).

Figure 3. Network Analysis Measures of Mixed Personal-Contextual Problems. 

While the most prominent symptoms distinguished in Panel B are the ones with a high activation, such as: “Sees things” (YSR70) (St = 1.39, EI = 1.39) and “Strange behavior” (YSR84) (St = 1.23, EI = 1.23, Bet = 1.54, Clo = 0.81), the latter is also a good intermediary. Others that are good intermediaries and activate the network quickly are: “Can't get mind off thoughts” (YSR9) (Bet = 1.21, Clo = 1.61), “Strange ideas” (YSR85) (Bet = 1.54, Clo = 1.12), and “Repeats acts” (YSR66) (Clo = 1.05).

In Panel C, the symptoms that stand out for their connections and their role as intermediaries and quick activators are: “Others out to get him/her” (YSR34) (St = 1.39, EI = 1.18, Bet = 1.00, Clo = 1.11), “Not liked by peers” (YSR48) (St = 1.19, EI = 1.73, Bet = 1.54, Clo = 0.89), and “Gets teased” (YSR38) (St = 1.03, Bet = 1.54, Clo = 0.92). Standing out as only a fast activator is “Lonely” (YSR12) (Clo= 1.04). Those with the greatest impact (GSI and NSI > 1.00) are: “Clumsy” (YSR62) and “Speech problems” (YSR79).

Discussion

In this study, the central symptoms that facilitate the activation of others within syndromes were identified-specifically, symptoms with the role of intermediaries, symptoms that allow rapid activation of the syndrome, and symptoms with the greatest impact on the connectivity or structure of each psychological network. The particular benefit of this for the study of psychological phenomena is that the network analysis could improve understanding of two aspects of the syndromes: which variables are relevant and which relationships sustain structures that might be working in a dysfunctional way for the subject. Once the fundamental variables or nodes are detected, together with how these nodes are related to others, a psychologist can use this information to promote changes in the subject's psychological network, attenuating the nodes and relations that are malfunctioning. From an exploratory perspective, this network analysis report could help change the understanding of psychological phenomena because it offers alternative ways to operationalize how the variables are measured and how are they related (Fonseca-Pedrero, 2017).

Taking an overview of the results, it can be noted that the most relevant symptoms have an intra- and interpersonal nature. This is consistent with psychopathological theories on both the maintenance and the etiology of mental disorders and their modification through effective psychological interventions that are based on or refer to the role of irrational thoughts or cognitive biases and contextual interactions or influences (Maddux & Winstead, 2016; Riso et al., 2007).

As we expected, in relation to Internalizing Problems, it was shown that symptoms with the highest levels of centrality are those related to Negative Affect (depressive mood, worry, and anhedonia). This especially stands out for depressive symptoms (the three relevant ones are: “Feels lonely” (CES14), “Perceive life has been a failure” (CES9), and “Feels sad” (CES18)) and for anxiety (“Anxious” (YSR50), “Fears school” (YSR30), and “Worries” (YSR112)-even more so because a central role for these symptoms is supported by the evidence of many other empirical studies (Eccles et al., 2020; Figueras, 2006; Martínez-Hernáez & Muñoz García, 2010a, 2010b; McElroy et al., 2018; Nolen-Hoeksema & Hilt, 2009). These results are also consistent with the tripartite model, suggesting a common component of high negative affectivity or general distress for internalizing problems (Clark & Watson, 1991; De Bolle et al., 2011).

The feeling of loneliness refers to dissatisfaction arising from the discrepancy between the personal desire for social relationships and those that actually exist, with a feeling of physical or emotional disconnection from others (Eccles et al., 2020). This feeling of loneliness can be understood to have a relevant and broad effect on the lives of children and adolescents, particularly because of the essential role that relationships with parents and peers play in providing security and support figures in children's growth (Franco Nerín et al., 2014; Kostelnik et al., 2009).

Likewise, sadness is a basic emotional reaction that, when it becomes dysfunctional, manifests itself transversally in several disorders. It should be noted that this symptom is considered an essential criterion (in addition to irritability) for the clinical diagnosis of mood disorders in both the child and adolescent populations as well as in adults (American Psychiatric Association, 2013) and is highly related to feelings of loneliness (Eccles et al., 2020).

The perception of life as a failure can be understood as an automatic, negative cognitive bias that is difficult to control and affects the interpretation and perception of personal experiences (Riso et al., 2007). Hence the recommendation to address such biases with cognitive therapy and consequently to refer children and adolescents to mental health services (Hatherill, 2007).

As for the dynamic of anxiety, excessive worry (with great impact and strong interconnectivity) together with fear played a basic role in the appearance of anxiety syndrome. This emphasizes the interpersonal nature of the symptom “fear of school” (YSR30), which may be based on difficult relationships with peers in the school context, and its possible connection to social problems and withdrawal behaviors, related to selective mutism or ineffective communication with others. These results are consistent with the findings of McElroy and Patalay (2019) that the fears of going to school, going to bed at night, and what others think are the most central. Taken together, all this suggests the importance of fears in childhood, especially those linked to socialization contexts. Along these lines, being socially accepted and having friends is associated with good adjustment, personal well-being, increased school performance, high self-esteem, and a positive feeling of belonging to the group (Piqueras et al., 2019). Thus, high prevalence rates of school problems such as bullying or peer rejection situations in the classroom have been shown to be a risk factor for the development of psychosocial adjustment problems in childhood (Lara-Ros et al., 2017; Piqueras et al., 2019).

Concerning Somatic Complaints, the central symptoms found were related to gastrointestinal symptoms (“Nausea” (YSR56c) and “Vomiting” (YSR56g)). Many studies have consistently shown that somatic symptoms are common manifestations of various psychological problems, such as generalized depression and anxiety, personal maladjustment, and even personality disorders (Bekhuis et al., 2016; de la Barrera et al., 2019; Ordóñez et al., 2015). Although on a symptomatic level, fatigue and lack of rest were the internalizing complaints that stood out the most among adolescents, these are not identified as relevant. This is not consistent with the study by McElroy and Patalay (2019), who found that feelings of fatigue were higher in expected influence in the oldest age groups (15-18 years) as compared to the youngest group (8-11 years), indicating the way symptom expression can change across development and the relevance of studying the dynamics of the items by age groups.

As far as Externalizing Problems are concerned, the most prominent symptomatology in Aggressive Behavior (e.g., “Threatens others” (YSR97), “Argues a lot” (YSR3), “Attacks people” (YSR57), “Teases a lot” (YSR94)) reflects particularities related to students' own developmental characteristics, such as the search for their own identity and autonomy, conflict with parents regarding communication problems, and behaviors showing opposition to authority (Kostelnik et al., 2009; Papalia et al., 2007). Meanwhile, the symptoms with the greatest impact on Rule-Breaking, such as “Breaks rules” (YSR28) and “Steals outside home” (YSR82), are consistent with the central symptoms of adolescent psychopathology found by Hukkelberg (2019). Hence, prevention or general intervention programs that include components such as assertive communication, trust in significant figures, the assumption of responsibilities, and the adequate development of autonomy should be key recommendations and priorities for the promotion of mental health in the child-adolescent populations.

Regarding the problems of a personal and contextual nature, specific symptoms also emerged. Thus, with respect to thought problems, difficulties in cognitive management were revealed in some symptoms such as “Confused” (YSR13), “Can't concentrate” (YSR8), and “Sees things” (YSR70) (which may refer at this age to maladaptive daydreaming). All these symptoms seem related to beliefs about what others think and the cognitive-emotional perception of the effects that the behaviors of others could have on the children and adolescents themselves (Maddux & Winstead, 2016; Piqueras et al., 2019).

In contrast, the symptoms of the more prominent Social Problems (i.e., “Not liked by peers” (YSR48), “Others out to get him/her” (YSR34), and “Gets teased” (YSR38)) highlight those who have a character trait of interpersonal sensitivity, suspicion, or self-referentiality. This suggests guidelines for the design of interventions in both the school and the family context whereby the identification, reflection, and management of referential attributions, as well as positive thoughts and beliefs about others (attributions of intention, alternative thoughts, etc.), could serve as protective resources or coping strategies to deal with this symptomatology (Graham & Reynolds, 2013; Sukhodolsky et al., 2004).

In summary, the symptoms identified in this study reveal specific indicators that can be detected in daily interactions with a child or adolescent through their verbal communication or their attitudes in the various socialization contexts, indicators that go beyond the global manifestation of a disruptive or aggressive nature typical of a general diagnostic category (Solmi et al., 2022). Considering the possible practical implications, it is worth highlighting that the various central symptoms identified in this study can be used as signs, clues, or alarm signals pointing to several mental health problems and can serve as targets for preventive and intervention programs, especially taking into account current proposals for evidence-based psychological treatment in children and adolescents (Fonseca-Pedrero et al., 2021).

This study could contribute to the accumulation of empirical evidence regarding psychological problems during childhood and adolescence. However, the validity of these conclusions has yet to be tested to determine whether these results are robust and replicable. In general terms, for this issue, the scientific method suggests three methodological criteria to be examined: a) model quality (has the technique discovered the “true” model?); b) precision (how many errors are present in the estimated parameters?); and c) replicability: once any theoretical conclusion is proposed based on the results of the network analysis, the question is whether the same phenomenon can be reproduced in other samples (Borsboom et al., 2018; Epskamp, Borsboom et al., 2018). In keeping with the recommendations of Borsboom et al. (2018), it is our view that much more empirical evidence needs to be collected to confirm the conclusion that the results obtained are robust and replicable. Nevertheless, the first step has been taken in this direction.

Future studies applying network analysis should overcome some of the limitations of this study. For instance, the structural dynamics, hierarchy, and roles that apply to the constructs require exploration; at the symptom level, the activation trajectories of specific phenomena call for further study. To improve the assessment of comorbidity, it would be possible to better detect symptoms that act as a bridge in the concurrent presence of disorders in addition to detecting those symptoms whose change or modification in intensity or frequency generate an impact on the global symptomatological picture presented (Bringmann et al., 2013; Jones et al., 2021; Letina et al., 2019). There is also a need to investigate differences by sex and age groups (Epskamp, van Borkulo, et al., 2018; Howe et al., 2020; van Borkulo et al., 2022). Further limitations can also be highlighted, such as the non-random sampling for the selection of participants, the absence of control scales (e.g., measures of infrequency, lying, defensiveness, faking good, and faking bad), and the use of self-reports, which consider only the child's perspective. Future studies will have to overcome all these limitations.

Acknowledgements

The authors thank all the participants and their parents.

References

Achenbach, T. M. (1991). Manual for Youth Self-Report 1991 YSR profile. University of Vermont. [ Links ]

Achenbach, T. M., Ivanova, M. Y., & Rescorla, L. A. (2017). Empirically based assessment and taxonomy of psychopathology for ages 1½-90+ years: Developmental, multi-informant, and multicultural findings. Comprehensive Psychiatry, 79, 4-18. https://doi.org/10.1016/j.comppsych.2017.03.006Links ]

Achenbach, T. M., & Rescorla, L. A. (2001). The manual for the AsEBA school-age forms & profiles. University of Vermont, Research Center for Children, Youth, and Families. [ Links ]

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders: DSM-5 (5th ed.). American Psychiatric Association. https://search.library.wisc.edu/catalog/9910187853902121Links ]

Bekhuis, E., Schoevers, R. A., van Borkulo, C. D., Rosmalen, J. G. M., & Boschloo, L. (2016). The network structure of major depressive disorder, generalized anxiety disorder and somatic symptomatology. Psychological Medicine, 46(14), 2989-2998. https://doi.org/10.1017/S0033291716001550Links ]

Bono, C., Ried, L. D., Kimberlin, C., & Vogel, B. (2007). Missing data on the center for epidemiologic studies depression scale: A comparison of 4 imputation techniques. Research in Social and Administrative Pharmacy, 3(1), 1-27. https://doi.org/10.1016/j.sapharm.2006.04.001Links ]

Borsboom, D. (2017). A network theory of mental disorders. World Psychiatry, 16(1), 5-13. https://doi.org/10.1002/wps.20375Links ]

Borsboom, D., & Cramer, A. O. J. (2013). Network analysis: An integrative approach to the structure of psychopathology. Annual Review of Clinical Psychology, 9, 91-121. https://doi.org/10.1146/annurev-clinpsy-050212-185608Links ]

Borsboom, D., Cramer, A. O. J., Schmittmann, V. D., Epskamp, S., & Waldorp, L. J. (2011). The small world of psychopathology. PLoS One, 6(11), Article e27407. https://doi.org/10.1371/journal.pone.0027407Links ]

Borsboom, D., Robinaugh, D. J., The Psychosystems Group, Rhemtulla, M., & Cramer, A. O. J. (2018). Robustness and replicability of psychopathology networks. World Psychiatry, 17(2), 143-144. https://doi.org/10.1002/wps.20515Links ]

Bringmann, L. F., Vissers, N., Wichers, M., Geschwind, N., Kuppens, P., Borsboom, D., & Tuerlinckx, F. (2013). A network approach to psychopathology: New insights into clinical longitudinal data. PLoS One, 8(4), Article e60188. https://doi.org/10.1371/journal.pone.0060188Links ]

Brown, T. A. (2015). Confirmatory factor analysis for applied research. The Guilford Press. [ Links ]

Clark, L. A., & Watson, D. (1991). Tripartite model of anxiety and depression: Psychometric evidence and taxonomic implications. Journal of Abnormal Psychology, 100(3), 316-336. https://doi.org/10.1037//0021-843x.100.3.316Links ]

Conway, C. C., Forbes, M. K., Forbush, K. T., Fried, E., Hallquist, M. N., Kotov, R., Mullins-Sweatt, S. N., Shackman, A. J., Skodol, A. E., South, S. C., Sunderland, M., Waszczuk, M. A., Zald, D. H., Afzali, M. H., Bornovalova, M. A., Carragher, N., Docherty, A. R., Jonas, K. G., Krueger, R. F., Eaton, N. R. (2019). A hierarchical taxonomy of psychopathology can transform mental health research. Perspectives on Psychological Science, 14(3), 419-436. https://doi.org/10.1177/1745691618810696Links ]

Costantini, G., Epskamp, S., Borsboom, D., Perugini, M., Mõttus, R., Waldorp, L. J., & Cramer, A. O. J. (2015). State of the aRt personality research: A tutorial on network analysis of personality data in R. Journal of Research in Personality, 54, 13-29. https://doi.org/10.1016/j.jrp.2014.07.003Links ]

De Bolle, M., De Clercq, B., Decuyper, M., & De Fruyt, F. (2011). Affective determinants of anxiety and depression development in children and adolescents: An individual growth curve analysis. Child Psychiatry & Human Development, 42(6), 694-711. https://doi.org/10.1007/s10578-011-0241-6Links ]

de la Barrera, U., Villanueva, L., & Prado-Gascó, V. (2019). Emotional and personality predictors that influence the appearance of somatic complaints in children and adults. Psicothema, 31(4), 407-413. https://doi.org/10.7334/psicothema2019.69Links ]

DeYoung, C. G., Chmielewski, M., Clark, L. A., Condon, D. M., Kotov, R., Krueger, R. F., Lynam, D. R., Markon, K. E., Miller, J. D., Mullins-Sweatt, S. N., Samuel, D. B., Sellbom, M., South, S. C., Thomas, K. M., Watson, D., Watts, A. L., Widiger, T. A., & Wright, A. G. C. (2022). The distinction between symptoms and traits in the hierarchical taxonomy of psychopathology (HiTOP). Journal of Personality, 90(1), 20-33. https://doi.org/10.1111/jopy.12593Links ]

Dozois, D. J. A. (2019). Abnormal psychology: Perspectives (6th ed.). Pearson Canada Inc. [ Links ]

Eccles, A. M., Qualter, P., Panayiotou, M., Hurley, R., Boivin, M., & Tremblay, R. E. (2020). Trajectories of early adolescent loneliness: Implications for physical health and sleep. Journal of Child and Family Studies, 29(12), 3398-3407. https://doi.org/10.1007/s10826-020-01804-3Links ]

Enders, C. K. (2010). Applied missing data analysis. The Guilford Press. [ Links ]

Epskamp, S. (2017). Network psychometrics [Doctoral dissertation, University of Amsterdam]. http://sachaepskamp.com/dissertation/EpskampDissertation.pdfLinks ]

Epskamp, S., Borsboom, D., & Fried, E. (2018). Estimating psychological networks and their accuracy: A tutorial paper. Behavior Research Methods, 50(1), 195-212. https://doi.org/10.3758/s13428-017-0862-1Links ]

Epskamp, S., Cramer, A. O. J., Waldorp, L. J., Schmittmann, V. D., & Borsboom, D. (2012). qgraph: Network visualizations of relationships in psychometric data. Journal of Statistical Software, 48(4), 1-18. https://doi.org/10.18637/jss.v048.i04Links ]

Epskamp, S., van Borkulo, C. D., van der Veen, D. C., Servaas, M. N., Isvoranu, A. M., Riese, H., & Cramer, A. O. J. (2018). Personalized network modeling in psychopathology: The importance of contemporaneous and temporal connections. Clinical Psychological Science, 6(3), 416-427. https://doi.org/10.1177/2167702617744325Links ]

Ezpeleta, L., de la Osa, N., & Doménech, J. M. (2014). Prevalence of DSM-IV disorders, comorbidity and impairment in 3-year-old Spanish preschoolers. Social Psychiatry and Psychiatric Epidemiology, 49(1), 145-155. https://doi.org/10.1007/s00127-013-0683-1Links ]

Figueras, A. (2006). Evaluación multimétodo y multiinformante de la sintomatología depresiva en niños y adolescentes [Multi-method and multi-informant evaluation of depressive symptomatology in children and adolescents] [Doctoral dissertation, Universitat de Barcelona, UB]. UB repository https://www.tdx.cat/handle/10803/2534Links ]

Fonseca-Pedrero, E. (2017). Network analysis: A new way of understanding psychopathology? Revista de Psiquiatría y Salud Mental (English Edition), 10(4), 206-215. https://doi.org/10.1016/j.rpsm.2017.06.004Links ]

Fonseca-Pedrero, E. (2018). Análisis de redes en Psicología [Network Analysis in Psychology]. Papeles Del Psicólogo, 39(1), 1-12. https://doi.org/10.23923/pap.psicol2018.2852Links ]

Fonseca-Pedrero, E., Pérez-Álvarez, M., Al-Halabí, S., Inchausti, F., López-Navarro, E. R., Muñiz, J., Lucas-Molina, B., Pérez-Albéniz, A., Baños Rivera, R., Cano-Vindel, A., Gimeno-Peón, A., Prado-Abril, J., González-Menéndez, A., Valero, A. V., Priede, A., González-Blanch, C., Ruiz-Rodríguez, P., Moriana, J. A., Gómez, L. E., Montoya-Castilla, I. (2021). Tratamientos Psicológicos Empíricamente Apoyados Para la Infancia y Adolescencia: Estado de la Cuestión [Empirically Supported Psychological Treatments for Children and Adolescents: State of the Art]. Psicothema, 33(3), 386-398. https://doi.org/10/gp8pxdLinks ]

Forbes, M. K., Sunderland, M., Rapee, R. M., Batterham, P. J., Calear, A. L., Carragher, N., Ruggero, C., Zimmerman, M., Baillie, A. J., Lynch, S. J., Mewton, L., Slade, T., & Krueger, R. F. (2021). A detailed hierarchical model of psychopathology: From individual symptoms up to the general factor of psychopathology. Clinical Psychological Science, 9(2), 139-168. https://doi.org/10.1177/2167702620954799Links ]

Franco Nerín, N., Pérez Nieto, M., & De Dios Pérez, M.-J. (2014). Relación entre los estilos de crianza parental y el desarrollo de ansiedad y conductas disruptivas en niños de 3 a 6 años [Relationship between parenting styles and the development of anxiety and disruptive behaviors in children aged 3 to 6 years]. Revista de Psicología Clínica con Niños y Adolescentes, 1(2), 149-156. https://www.revistapcna.com/sites/default/files/6-rpcna_vol.2.pdfLinks ]

Fried, E. (2017). What are psychological constructs? On the nature and statistical modelling of emotions, intelligence, personality traits and mental disorders. Health Psychology Review, 11(2), 130-134. https://doi.org/10.1080/17437199.2017.1306718Links ]

Fried, E., van Borkulo, C. D., Cramer, A. O. J., Boschloo, L., Schoevers, R. A., & Borsboom, D. (2017). Mental disorders as networks of problems: A review of recent insights. Social Psychiatry and Psychiatric Epidemiology, 52, 1-10. https://doi.org/10.1007/s00127-016-1319-zLinks ]

Funkhouser, C. J., Chacko, A. A., Correa, K. A., Kaiser, A. J. E., & Shankman, S. A. (2021). Unique longitudinal relationships between symptoms of psychopathology in youth: A cross-lagged panel network analysis in the ABCD study. Journal of Child Psychology and Psychiatry, and Allied Disciplines, 62(2), 184-194. https://doi.org/10.1111/jcpp.13256Links ]

González, R. (2000). Psicopatología del niño y del adolescente [Child and adolescent psychopathology]. Pirámide. [ Links ]

Graham, P., & Reynolds, S. (Eds.). (2013). Cognitive behavior therapy for children and families. Cambridge University Press. [ Links ]

Guyon, H., Falissard, B., & Kop, J. L. (2017). Modeling psychological attributes in psychology-An epistemological discussion: Network analysis vs. Latent variables. Frontiers in Psychology, 8, Article 798. https://doi.org/10.3389/fpsyg.2017.00798Links ]

Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2014). Multivariate data analysis (7a ed.). Pearson. [ Links ]

Hatherill, S. (2007). Child and adolescent therapy: Cognitive behavioral procedures (third edition): Edited by philip C kendall. Journal of Child and Adolescent Mental Health, 19(1), 85-86. https://doi.org/10/b2956vLinks ]

Howe, E., Bosley, H. G., & Fisher, A. J. (2020). Idiographic network analysis of discrete mood states prior to treatment. Counselling and Psychotherapy Research, 20(3), 470-478. https://doi.org/10.1002/capr.12295Links ]

Hukkelberg, S. (2019). The Quintessence of child conduct problems: Identifying central behaviors through network analysis. Journal of Psychopathology and Behavioral Assessment, 41(2), 175-184. https://doi.org/10.1007/s10862-018-9713-3Links ]

Jones, P. J. (2017). Impact: A new statistic for network analysis. R Package Vignette. Repository CRANhttps://Cran.r-Project.Org/Web/Packages/Networktools/Vignettes/Impact.Pdf. [ Links ]

Jones, P. J. (2020). networktools: Tools for identifying important nodes in networks. Repository CRAN https://CRAN.R-project.org/package=networktoolsLinks ]

Jones, P. J., Ma, R., & McNally, R. J. (2021). Bridge centrality: A network approach to understanding comorbidity. Multivariate Behavioral Research, 56(2), 353-367. https://doi.org/10.1080/00273171.2019.1614898Links ]

Kokla, M., Virtanen, J., Kolehmainen, M., Paananen, J., & Hanhineva, K. (2019). Random forest-based imputation outperforms other methods for imputing LC-MS metabolomics data: A comparative study. BMC Bioinformatics, 20(1), Article 492. https://doi.org/10.1186/s12859-019-3110-0Links ]

Kostelnik, M. J., Phipps, A. W., Soderman, A. K., & Gregory, K. M. (2009). Guiding Children's Social Development & Learning (6th ed.). Cengage Learning. [ Links ]

Kotov, R., Krueger, R. F., Watson, D., Cicero, D. C., Conway, C. C., DeYoung, C. G., Eaton, N. R., Forbes, M. K., Hallquist, M. N., Latzman, R. D., Mullins-Sweatt, S. N., Ruggero, C. J., Simms, L. J., Waldman, I. D., Waszczuk, M. A., & Wright, A. G. C. (2021). The hierarchical taxonomy of psychopathology (HiTOP): A quantitative nosology based on consensus of evidence. Annual Review of Clinical Psychology, 17(1), 83-108. https://doi.org/10.1146/annurev-clinpsy-081219-093304Links ]

Krueger, R. F., Kotov, R., Watson, D., Forbes, M. K., Eaton, N. R., Ruggero, C. J., Simms, L. J., Widiger, T. A., Achenbach, T. M., Bach, B., Bagby, R. M., Bornovalova, M. A., Carpenter, W. T., Chmielewski, M., Cicero, D. C., Clark, L. A., Conway, C., DeClercq, B., DeYoung, C. G., Zimmermann, J. (2018). Progress in achieving quantitative classification of psychopathology. World Psychiatry, 17(3), 282-293. https://doi.org/10.1002/wps.20566Links ]

Lara-Ros, M. R., Rodríguez-Jiménez, T., Martínez-González, A. E., & Piqueras Rodríguez, J. A. (2017). Relación entre el bullying y el estado emocional y social en niños de educación primaria [Relationship between bullying and emotional and social status among primary scholars]. Revista de Psicología Clínica con Niños y Adolescentes, 4(1), 59-64. https://www.redalyc.org/articulo.oa?id=477152555007Links ]

Letina, S., Blanken, T. F., Deserno, M. K., & Borsboom, D. (2019). Expanding network analysis tools in psychological networks: Minimal spanning trees, participation coefficients, and motif analysis applied to a network of 26 psychological attributes. Complexity, 2019, Article 9424605. https://doi.org/10.1155/2019/9424605Links ]

Maddux, J. E., & Winstead, B. A. (Eds.). (2016). Psychopathology: foundations for a contemporary understanding (4th ed.). Routledge. [ Links ]

Martínez-Hernáez, Á., & Muñoz García, A. (2010a). «Un infinito que no acaba». Modelos explicativos sobre la depresión y el malestar emocional entre los adolescentes barceloneses (España). Primera parte ["An infinity that does not end." Explanatory models on depression and emotional distress among adolescents from Barcelona (Spain). First part]. Salud Mental, 33(2), 145-152. [ Links ]

Martínez-Hernáez, Á., & Muñoz García, A. (2010b). «Un infinito que no acaba». Modelos explicativos sobre la depresión y el malestar emocional entre los adolescentes barceloneses (España). Segunda parte ["An infinity that does not end." Explanatory models on depression and emotional distress among adolescents from Barcelona (Spain). Second part]. Salud Mental, 33(3), 229-236. [ Links ]

McElroy, E., Fearon, P., Belsky, J., Fonagy, P., & Patalay, P. (2018). Networks of depression and anxiety symptoms across development. Journal of the American Academy of Child and Adolescent Psychiatry, 57(12), 964-973. https://doi.org/10.1016/j.jaac.2018.05.027Links ]

McElroy, E., & Patalay, P. (2019). In search of disorders: Internalizing symptom networks in a large clinical sample. Journal of Child Psychology and Psychiatry, 60(8), 897-906. https://doi.org/10.1111/jcpp.13044Links ]

Nolen-Hoeksema, S., & Hilt, L. M. (Eds.). (2009). Handbook of depression in adolescents. Taylor & Francis. [ Links ]

Ordóñez, A., Maganto, C., & González, R. (2015). Somatic complaints, emotional awareness and maladjustment in schoolchildren. Anales de Pediatría (English Edition), 82(5), 308-315. https://doi.org/10.1016/j.anpede.2015.04.004Links ]

Papalia, D. E., Olds, S. W., & Feldman, R. D. (2007). Human development (10th ed.). McGraw-Hill. [ Links ]

Piqueras, J. A., Mateu-Martínez, O., Cejudo, J., & Pérez-González, J.-C. (2019). Pathways into psychosocial adjustment in children: Modeling the effects of trait emotional intelligence, social-emotional problems, and gender. Frontiers in Psychology, 10, Article 507. https://doi.org/10.3389/fpsyg.2019.00507Links ]

Polanczyk, G. V., Salum, G. A., Sugaya, L. S., Caye, A., & Rohde, L. A. (2015). Annual research review: A meta-analysis of the worldwide prevalence of mental disorders in children and adolescents. Journal of Child Psychology and Psychiatry, 56(3), 345-365. https://doi.org/10.1111/jcpp.12381Links ]

R Core Team. (2020). R: a language and environment for statistical computing. R Foundation for Statistical Computing. [ Links ]

Radloff, L. S. (1977). The CES-D Scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 1, 385-401. https://doi.org/10.1177/014662167700100306Links ]

Radloff, L. S. (1991). The Use of the center for epidemiologic studies depression scale in adolescents and young adults. Journal of Youth and Adolescence, 20(2), 149-166. https://doi.org/10.1007/BF01537606. [ Links ]

Riso, L. P., du Toit, P. L., Stein, D. J., & Young, J. E. (Eds.). (2007). Cognitive schemas and core beliefs in psychological problems: A scientist-practitioner guide. American Psychological Association. https://doi.org/10.1037/11561-000Links ]

Ruggero, C. J., Kotov, R., Hopwood, C. J., First, M., Clark, L. A., Skodol, A. E., Mullins-Sweatt, S. N., Patrick, C. J., Bach, B., Cicero, D. C., Docherty, A., Simms, L. J., Bagby, R. M., Krueger, R. F., Callahan, J. L., Chmielewski, M., Conway, C. C., De Clercq, B., Dornbach-Bender, A., Zimmermann, J. (2019). Integrating the hierarchical taxonomy of psychopathology (HiTOP) into clinical practice. Journal of Consulting and Clinical Psychology, 87(12), 1069-1084. https://doi.org/10.1037/ccp0000452Links ]

Sánchez-Hernández, M. O., Delgado, B., Carrasco, M. A., & Holgado Tello, F. P. (2018). Facetas de la “Escala de depresión del Centro de Estudios Epidemiológicos para niños y adolescentes” (CES-DC) en españoles: Validación empírica [Facets of the “Center for Epidemiological Studies Depression Scale for Children and Adolescents” (CES-DC) in Spanish: Empirical validation]. Behavioral Psychology, 26(3), 495-512. [ Links ]

Shah, A., Bartlett, J., Carpenter, J., Nicholas, O., & Hemingway, H. (2014). Comparison of random forest and parametric imputation models for imputing missing data using MICE: a CALIBER study. American Journal of Epidemiology, 179(6), 764-774. https://doi.org/10.1093/aje/kwt312Links ]

Solmi, M., Radua, J., Olivola, M., Croce, E., Soardo, L., Salazar de Pablo, G., Il Shin, J., Kirkbride, J. B., Jones, P., Kim, J. H., Kim, J. Y., Carvalho, A. F., Seeman, M. V., Correll, C. U., & Fusar-Poli, P. (2022). Age at onset of mental disorders worldwide: Large-scale meta-analysis of 192 epidemiological studies. Molecular Psychiatry, 27(1), 281-295. https://doi.org/10.1038/s41380-021-01161-7Links ]

Sukhodolsky, D. G., Kassinove, H., & Gorman, B. S. (2004). Cognitive-behavioral therapy for anger in children and adolescents: A meta-analysis. Aggression and Violent Behavior, 9(3), 247-269. https://doi.org/10.1016/j.avb.2003.08.005Links ]

Tang, F., & Ishwaran, H. (2017). Random forest missing data algorithms. Statistical Analysis and Data Mining, 10(6), 363-377. https://doi.org/10.1002/sam.11348Links ]

Unitat d'Epidemiologia i de Diagnòstic en Psicopatologia del Desenvolupament. (2001). Autoinforme YSR del comportamiento de jóvenes 11-18 años [Youth Self-Report /11-18]. Universitat Autonoma de Barcelona, Departament de Psicologia Clínica i de la Salut. https://www.ued.uab.cat/aseba.htmlLinks ]

van Bork, R. (2019). Interpreting psychometric models [Doctoral dissertation, University of Amsterdam]. https://doi.org/10.31237/osf.io/x6a7sLinks ]

van Borkulo, C. D., van Bork, R., Boschloo, L., Kossakowski, J. J., Tio, P., Schoevers, R. A., Borsboom, D., & Waldorp, L. J. (2022). Comparing network structures on three aspects: A permutation test. Psychological Methods. Advance online publication. https://doi.org/10.1037/met0000476Links ]

van Buuren, S., & Groothuis-Oudshoorn, K. (2011). mice: Multivariate imputation by chained equations in R. Journal of Statistical Software, 45(3), 1-67. https://doi.org/10.18637/jss.v045.i03Links ]

Weissman, M. M., Orvaschel, H., & Padian, N. (1980). Children´s symptom and social functioning self-report scales: Comparison of mothers´ and children´s reports. The Journal of Nervous and Mental Disease, 168(12), 736-740. https://doi.org/10.1097/00005053-198012000-00005Links ]

FundingThis research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors

Cite as:Sánchez-Hernández, M. O., Holgado-Tello, F. P., & Carrasco, M. Á. (2023). Network Analysis of Internalizing and Externalizing Symptoms in Children and Adolescents. Psicothema, 35(1), 66-76. https://doi.org/10.7334/psicothema2022.17.

Received: January 10, 2022; Accepted: July 28, 2022

Autor y e-mail de correspondencia: Milagros Ocalin Sánchez Hernández, Department of Psychology, National Autonomous University of Nicaragua-León, Nicaragua 21000 León Nicaragua. milaocalin92@gmail.com

Conflict of interests

The authors declare that they have no conflict of interest.

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License