SciELO - Scientific Electronic Library Online

 
vol.15 número1Menores con medidas judiciales por violencia filio-parental (especialistas vs. generalistas): el papel de la victimización directa en el hogarLa interacción entre el trastorno por déficit de atención e hiperactividad y los déficits neuropsicológicos para explicar el abandono prematuro de la intervención y la reincidencia de los maltratadores índice de autoresíndice de materiabúsqueda de artículos
Home Pagelista alfabética de revistas  

Servicios Personalizados

Revista

Articulo

Indicadores

Links relacionados

  • En proceso de indezaciónCitado por Google
  • No hay articulos similaresSimilares en SciELO
  • En proceso de indezaciónSimilares en Google

Compartir


The European Journal of Psychology Applied to Legal Context

versión On-line ISSN 1989-4007versión impresa ISSN 1889-1861

The European Journal of Psychology Applied to Legal Context vol.15 no.1 Madrid ene./jun. 2023  Epub 26-Jun-2023

https://dx.doi.org/10.5093/ejpalc2023a3 

Articles

Network analysis of emotional symptoms and their relationship with different types of cybervictimization

Análisis de red de síntomas emocionales y su relación con distintos tipos de cibervictimización

María M Moleroa  , María C Pérez-Fuentesa  , África Martosa  , Rosa M Pinoa  , José J Gázquezb 

aUniversity of Almería, Spain

bUniversidad Autónoma de Chile, Providencia, Chile

ABSTRACT

Background:

Cyberbullying is a highly prevalent problem in our society with important implications for adolescent psychological wellbeing. The objective of the study was to examine the network structure of the Depression, Anxiety, and Stress Scale in a sample of youths, and find out the relationships between different types of cybervictimization and the presence of negative emotional states.

Method:

This was a descriptive cross-sectional study. The sample was made up of 2,171 high school students with a mean age of 13.84 (with 50.53% males and 49.47% females). The Cybervictimization Questionnaire (CYVIC) and the Spanish version of the Depression, Anxiety, and Stress Scale (DASS-21) were administered.

Results:

Positive correlations were found between all the dimensions of the DASS-21 and the types of cybervictimization. The network structure showed that the different nodes of three emotional states were positively related to each other (although some relationships were stronger than others). Furthermore, girls had significantly higher means in depression, anxiety, and stress. In analyzing the network, the strongest associations in both sexes were found to be between anxiety and written-verbal cybervictimization and exclusion.

Conclusions:

Negative emotional states and types of cybervictimization were related in a complex network where efforts to approach reduction of emotional symptoms associated with cybervictimization could produce lasting benefits for the emotional wellbeing of youths.

Keywords: Anxiety; Cyberbullying; Cybervictimization; Depression; Stress

RESUMEN

Antecedentes:

El ciberbullying es una problemática con una alta prevalencia en nuestra sociedad y que tiene importantes implicaciones para el bienestar psicológico de los adolescentes. El objetivo del trabajo fue examinar la estructura de red de la Escala de Depresión, Ansiedad y Estrés en una muestra de jóvenes, así como comprobar las relaciones que se establecen entre diferentes tipos de cibervictimización y la presencia de estados emocionales negativos.

Método:

Se realizó un estudio descriptivo transversal. La muestra estuvo formada por 2,171 estudiantes de Educación Secundaria, con una media de edad de 13.84 años (donde el 50.53% fueron hombres y el 49.47% mujeres). Se aplicó el Cuestionario de Cibervictimización (CYVIC) y la versión española de Depression, Anxiety and Stress Scale (DASS-21).

Resultados:

Se encontraron correlaciones positivas entre todas las dimensiones del DASS-21 y los tipos de cibervictimización. Atendiendo a la estructura de redes, se halló que los diferentes nodos de los tres estados emocionales se relacionaban positivamente entre sí (aunque algunas relaciones eran más fuertes que otras). Por otro lado, en relación al sexo, las mujeres mostraron medias significativamente más elevadas en depresión, ansiedad y estrés. Al analizar la red, las asociaciones más estrechas se dieron entre la ansiedad y la cibervictimización de tipo escrita-verbal y la exclusión en ambos sexos.

Conclusiones:

Los estados emocionales negativos y los tipos de cibervictimización se relacionaban en una compleja red donde los esfuerzos por abordar la reducción de los síntomas emocionales asociados a la cibervictimización podrían producir beneficios duraderos en el bienestar emocional de los jóvenes.

Palabras clave: Ansiedad; Cyberbullying; Cibervictimización; Depresión; Estrés

Introduction

Almost five decades have passed since Olweus defined bullying for the first time as a type of aggressive behavior repeated over time with the intention to harm the victim with whom there is an imbalance of power or strength (Olweus, 1978). However, it is still current. Continuous technological development has generated new online formats and platforms facilitating social interaction, learning, and recreation, especially among the young (Livingstone et al., 2017; Novo et al., 2016). But it has also given rise to a new scenario where severe problems (Gámez-Guadix et al., 2022; Hidalgo-Fuentes, 2022; Oksanen et al., 2021), such as bullying (Gázquez et al., 2008, 2010), become easier and more accessible (Steer et al., 2021).

Even though cyberbullying may in some way be considered a form of traditional harassment using electronic media (Olweus & Limber, 2018), it is different in some respects. Specifically, the repeated execution of cyberbullying does not have as much to do with the bully repeatedly behaving aggressively as it does a single action being shared repeatedly, generating prolonged exposure of the victim. Furthermore, while the imbalance of power in the traditional context refers to strength or status, in the scope of cybernetics it is related to the anonymity provided by networks or the bully's ability to use the Information and Communication Technologies (ICT), which provide an imbalance of real or perceived power (Dooley et al., 2009; Smith, 2015; Steer et al., 2021; Vandebosch & Van Cleemput, 2008).

These characteristics, along with their effects, make cyberbullying a problem requiring special attention (Álvarez-García, Núñez, et al., 2017), more so when studies, such as the one by Montiel et al. (2016), have shown that the prevalence of cybervictimization among Spanish adolescents is as high as 60%. A recent survey by Save the Children (2019) of youths 18 to 20 years old also showed that 75% of those surveyed had been the victim of online violence during their childhood or adolescence. It is therefore not surprising that more and more efforts are being made by the scientific community to study it (Barragán et al., 2021). This study concentrates on an analysis of the psychological symptoms of Spanish youths and their relationship to online victimization, which is essential to be able to detect and improve the wellbeing of young people who experience such situations.

Cybervictimization and Emotional Symptoms in Adolescence

As mentioned above, cyberbullying is defined as an aggressive and intentional act or behavior reiterated and/or maintained over time in electronic forms of contact by one or several individuals against a victim who cannot easily defend her/himself (Smith et al., 2008). There are different forms of cyberbullying. Written-verbal cyberbullying (insults or threats in messages, wounding comments through Internet, or intimidating anonymous calls), visual cyberbullying (recording and spreading compromising images or “happy slapping”, that is, aggression or humiliation that is recorded and spread), exclusion (deliberate omission from an online group), and impersonation are types of aggressive behavior presented on digital devices. And among these, verbal cyberbullying and exclusion seem to be the most common (Álvarez-García, Barreiro-Collazo, et al., 2017). However, other studies have shown verbal and visual cyberbullying with humiliating images as the most prevalent (Cuadrado-Gordillo & Fernández-Antelo, 2016).

The psychoemotional adjustment of adolescents is intimately related to victimization by internet (Evangelio et al., 2022; Quintana-Orts et al., 2021) and other types of exposure to violence (Vilariño et al., 2022). Some emotional characteristics have been related to higher risk of cybervictimization of adolescents, such as low esteem, feeling afraid or shame of revealing to others what they feel or what happens to them, high sensation-seeking (Save the Children, 2019), along with feeling lonely (Sahín, 2012; Save the Children, 2019), seem to be factors present in cyberbullying victims. Low emotional control (Hempehill & Heerde, 2014) has also been related to cybervictimization. In this regard, specific moods, such as anger, confusion and tension/anxiety are related to higher risk of being a cyberbullying victim or aggressor, which highlights the importance of emotional management in this issue (De Pasquale et al., 2021).

Moreover, cybervictimization has been related to a series of negative results in terms of the mental wellbeing of youths (González-Cabrera et al., 2020). Specifically, cybervictimization has been pointed out as a factor highly linked to psychological harm among adolescents (Montes et al., 2022). Victims of cyberbullying show a significantly higher prevalence of major depressive disorder than those who are not (Mallik & Radwan, 2020; Thai et al., 2022). Previous studies have shown cyberbullying to be a risk factor in increased depressive and anxiety symptoms in adolescents (Evangelio et al., 2022; Molero et al., 2022). This could in turn lead to feelings of isolation and loneliness, and less wellbeing. Similarly, a longitudinal study found cybervictimization to be a risk factor for future development of depressive and social anxiety symptoms, and diminishing wellbeing in adolescence (Fahy et al., 2016). Emotional self-efficacy and maladaptive emotional regulation, such as rumination, have an important role in this as mediators between cybervictimization and wellbeing. Thus, the capacity of youths to manage their negative emotions is in a way responsible for the adverse psychological consequences of cyberbullying (Schunk et al., 2022). The search for social support has also been shown to be a relevant variable in results derived from cyberbullying, as it moderates depressive symptoms. This coincides with the results found in other groups exposed to violence (Pérez-Fuentes et al., 2021), while other strategies, such as assertiveness or helplessness, are less effective (Machmutow et al, 2012). In this regard, adolescents who are more likely to employ unproductive strategies in facing cybervictimization are also more likely to develop depression, anxiety, and stress (McLoughlin, 2021).

McLoughlin et al. (2019) showed that face-to-face social connections protect against the negative results of mental health linked to cybervictimization. This could be because the connection with others through digital media (for example, social networks) seems to increase feelings of loss and loneliness, both when they do not use them (preventing communication) and when they do (since they feel excluded when they see what others are doing) (Twenge et al., 2021).

Cybervictimization also leads to other negative results such as the appearance of feelings of isolation and self-guilt, and even suicidal thinking and behavior (Dorol-Beauroy-Eustache & Mishara, 2021; Save the Children, 2019).

Psychological Effects of Cyberbullying: Gender Differences

Research has shown differences in cybervictimization between boys and girls. Cybervictimization by girls seems to be more influenced by online gossip, that is, evaluative comments about third persons. Meanwhile, boys seem to be especially influenced by a problematic use of the internet, which is in turn linked to low self-esteem (Cebollero-Salinas et al., 2022). However, studies such as the one by Álvarez-García, Barreiro-Collazo, et al. (2017) on Spanish adolescents showed that there are no significant differences in the type of cyberbullying received between boys and girls, although there is a generalized trend in which girls are victims more than their male classmates, which coincides with other studies (Carvalho et al., 2021; Evangelio et al., 2022; González-Cabrera et al., 2020). This could be especially problematic considering that women who experience cyberbullying and have unstable family relationships and a problematic Internet use pattern are at a higher risk of becoming future cyberbullies. These adolescents, who show a dual pattern (online victims and bullies), are especially disposed to psychological alterations, such as depression, anxiety, and emotional problems (Lozano-Blasco et al., 2020). Women who are victims of cyberbullying and have a problematic use of internet also have emotional regulation problems (Arrivillaga et al., 2022).

Moreover, girls have been found to have a stronger tendency to choose coping strategies for dealing with cybervictimization focused on emotions than their male counterparts. And in turn, this type of strategy is related to higher levels of depression, anxiety, and stress (McLoughlin, 2021). Girls' problems with emotional management have also been found to be related to victimization, but not boys' (Rodríguez-Álvarez et al., 2021). It has also been shown that depression, and especially anxiety, may be caused by cybervictimization, particularly in women (Molero et al., 2022). All the above suggests that gender may be related to possible negative results of cyberbullying.

The Present Study

Cybervictimization has been related to poor mental health and internalizing symptoms (Beaudequin et al., 2020; Fahy et al., 2016; Mallik & Radwan, 2020). This study attempts to take one step further by relating specific emotional states to the concrete type of cybervictimization. This will provide us with more precise knowledge about whether certain internalizing behaviors are more closely related to types of cyberbullying.

Therefore, this study posed two objectives. First, it was intended to examine the network structure of items and dimensions in the Depression, Anxiety and Stress Scale (DASS-21) in a sample of Spanish adolescents. A network graph was created, where the components of the dimensions and their associations (edge weight and centrality), as well as the robustness and stability of the network, were evaluated.

The second objective was to test how the different modalities of cybervictimization (CYVIC) relate to the presence of emotional states (DASS-21), in this case, by means of network analysis of the dimensions (depression, anxiety, and stress).

Method

Participants

The original sample had 2,241 participants who had agreed to participate and gave their consent, but 70 cases were removed from the database because they did not complete the whole battery of questionnaires. The final study sample was therefore comprised of 2,171 adolescents aged 11 to 18, with a mean age of 13.84 (SD = 1.46). Gender distribution revealed equitable representation with 50.53% (n = 1,097) males and 49.47% (n = 1,074) females with a mean age of 13.88 (SD = 1.45) and 13.81 (SD = 1.46), respectively. The courses they were studying at the time data were collected were distributed as follows: 25.51% (n = 554) 1st year of compulsory education (ESO), 22.98% (n = 499) 2nd year of compulsory education, 23.35% (n = 507) 3rd year of compulsory education, 19.94 (n = 433) 4th year of compulsory education, 4.33% (n = 94) 1st year high school, 3.27% (n = 71) 2nd year high school, and 0.59% (n = 13) vocational training.

Instruments

Cuestionario de Cibervictimización para Adolescentes [Cybervictimization Questionnaire for Adolescents] (CYVIC; Álvarez-García, Núñez, et al., 2017)

This questionnaire was designed to evaluate to extent the informant has been the victim of aggression by cellphone or Internet in the last three months. It is made up of 19 items, with four answer choices rated on a 4-point Likert-type scale, ranging from (1) never to (4) always, distributed in four factors: impersonation (refers to others simulating the profile of the person in online media; e.g., “Se han hecho pasar por mí en Internet publicando comentarios en mi nombre, como si fuese yo” [“Someone has impersonated me on the Internet, posting comments under my name, as if they were me”]), visual-sexual cybervictimization (related to compromising or humiliating videos or photos and spreading them online; e.g.: “Me han hecho fotos o grabaciones de vídeo sin mi consentimiento con un contenido sexual o sugerente – e.g., en la playa, en un vestuario – y las han difundido a través del móvil o Internet” [“Someone has taken pictures or video recordings of me with a sexual or suggestive content – e.g., on the beach, in a locker room, ... – without my consent and they have disseminated them over the mobile phone or the Internet”]), verbal-written cybervictimization (reference to receiving harmful and frightening or insulting comments on the internet; also includes threatening anonymous or distressing calls; e.g., “He recibido llamadas a mi móvil, que no contestan, supongo que para fastidiar” [“I have received calls on my mobile that are not answered, I guess to annoy me”]), and online exclusion (refers to being deliberately left out of an online group; e.g., “Se ponen de acuerdo para hacerme el vacío – ignorarme – en las redes sociales” [“They agree to ignore me on the social networks”]). The reliability of each of the scales was: identity impersonation, α = .662, ω = .663; visual sexual cybervictimization, α = .662, ω = .663; written-verbal cybervictimization, α = .812, ω = .812; online exclusion, α = .704, ω = .710.

Depression Anxiety and Stress Scale, Spanish version (DASS-21; Ruiz et al., 2017)

This instrument consists of 21 items that describe negative emotional states. Participants responded on a 4-point Likert-type scale (from 0 = did not apply to me at all to 3 = applicable to me very much or most of the time). The DASS-21 enables emotional symptoms to be measured on three scales: Depression (e.g., “No podía experimentar ningún sentimiento positivo” [“I couldn't seem to experience any positive feeling at all”]) (α = .884, ω = .887); Anxiety (e.g., “Sentí que mis manos temblaban” [“I felt my hands were trembling”]) (α = .832, ω = .836); and Stress (e.g., “Me ha costado mucho descargar la tensión” “I found it hard to wind down”) (α = .786, ω = .788).

Procedure

This was a descriptive cross-sectional study. Before collecting the information, the school directors were contacted to inform them of the objectives of the study and guarantee confidential data processing. Two members of the research team went to the schools to administer the questionnaires. First, they gave the students the pertinent instructions and guaranteed them anonymity of their answers. The students filled in the tests individually in 25-30 minutes. In all cases, ethical research standards were met and all the participants voluntarily agreed to participate and had the written consent of their parents/guardians for their participation. The study was approved by the Bioethics Committee of the University of Almería (Ref: UALBIO2021/022).

Data Analysis

First, a descriptive correlational analysis was carried out with the study variables. Mean scores and standard deviations were calculated, and the bivariate correlation matrix was estimated using Pearson's correlation coefficient. Then any statistically significant gender differences were examined with a comparative analysis of the mean scores of all the study variables. Welch's t-test (1947) and d (pooled, weighted, and unbiased formula) were performed to estimate mean differences and the effect size (0.20, 0.50, and 0.80 were interpreted as small, medium, or large effect sizes, respectively). Complementarily, the statistical model error, i.e., the probability of error of the statistical model in cases' classification was estimated with the probability of inferiority score (Gancedo et al., 2021).

Instrument reliability was estimated using Cronbach's (1951) alpha coefficient and McDonald's (1999) omega (Ventura-León & Caycho, 2017).

Then, in view of the study objectives, two network models were estimated: Network 1 of emotional symptoms with all the DASS-21 items, and Network 2 combining the emotional symptoms (scales/dimensions) and the different types of cybervictimization (CYVIC). Networks were also estimated separately by gender for this model.

In network analysis, the variables correspond to nodes and connections between nodes are called edges. The strength of the relationship between the nodes was measured in terms of edge weights (the minimum is .30; Isvoranu et al. 2017). In this case, networks were estimated using JASP ver. 0.16.3 (JASP Team, 2022). Missing data were managed using pairwise deletion with the extended Bayesian information criterion (EBICglasso), with hyperparameter set at 0.5 (Epskamp & Fried, 2018). In the graphic representation of the network, edge weights are expressed in terms of edge thickness and color density, so thicker, brighter lines suggest stronger connections. Another aspect to consider is the distance between nodes, such that the nodes closest to each other would be the most closely related. Fruchterman and Reingold's (1991) algorithm, which places the nodes with the strongest correlations in the center of the network, leaving those with weaker correlations farther out, was used for this.

In addition, centrality indices (betweenness, closeness, degree, and expected influence) were calculated, although in this study we focused on degrees or strength, which reflect the direct influence that a certain node has in the network.

Finally, for Network 1, edge accuracy was also examined using bootstrap 95% non-parametric confidence intervals (CIs), and stability of centrality estimates using the case-dropping bootstrap procedure. In both cases, 1,000 bootstraps were estimated.

Results

Preliminary Analyses: Descriptives and Correlations

Table 1 shows mean scores and standard deviations of the study variables, and correlation matrix. As shown, positive associations were found (in all cases with a significance of p < .001) between the modalities of cybervictimization (impersonation, visual sexual cybervictimization, written-verbal cybervictimization, and online exclusion) and the dimensions of the DASS-21 (depression, anxiety, and stress) as emotional symptoms.

Table 1. Descriptive Statistics and Correlation Analysis of the Study Variables. 

Note.All associations were significant p < .001.

In addition, a comparative analysis was conducted to test for the existence of statistically significant gender differences in the study variables. Levene's test was significant (p < .05), suggesting a violation of the assumption of homogeneity of variance, and therefore, Welch's t-test was applied to estimate gender differences. As shown in Table 2, mean scores were significantly higher in impersonation, t = 2.32, p < .05, d = 0.10, and visual sexual cybervictimization, t = 2.76, p < .01, d = 0.12, for boys. On the contrary, 46.0% (PIS = .460) of the males had scores under the mean of the females' group (error of the statistical model) in impersonation and in visual sexual cybervictimization, respectively.

Table 2. Cybervictimization and Emotional Symptoms by Sex. Descriptive and Welch's t-test. 

Concerning the presence of emotional symptoms (see Table 2), statistically significant differences were observed in the three DASS-21 dimensions: depression, t = -9.93, p < .001, d = -0.43, anxiety, t = -10.16, p < .001, d = -0.44, and stress, t = -7.77, p < .001, d =- 0.33, where girls had higher mean scores in all cases. Conversely, the probability of girls with a score under the mean of boys (error of the statistical model) was 33.4%, 32.9%, and 37.1% (PIS = .334, .320, and .371) in depression, anxiety, and stress, respectively.

Network Analysis 1: Network Structure DASS-21 Emotional Symptoms

With 21 nodes, the maximum number of edges in this network was 210. However, EBICglasso estimation used in the analysis reduced the estimated number of edges to 147. Sparsity is a value between 0 and 1, where the higher the sparsity, the more weakly connected the network. In this case, the sparsity index was .30. As shown in Figure 1, all the nodes were positively associated with each other. Furthermore, the stronger the association between nodes, the thicker and brighter the network edge.

Figure 1. DASS-21 Variables Network. 

Table 3 shows the indices of centrality (betweenness, closeness, strength, and expected influence) for the items on the DASS-21 (nodes). Graphs were created of these measures to facilitate data interpretation (Figure 2).

Table 3. Network Analysis Centrality Measures of DASS-21 Variables. 

Note. DASS1 = hard to wind down; DASS2 = dryness of mouth; DASS3 = no positive feeling; DASS4 = breathing difficulty; DASS5 = lack of motivation; DASS6 = overreaction to situations; DASS7 = trembling; DASS8 = nervousness; DASS9 = worried about panicking; DASS10 = nothing to live for; DASS11 = agitation; DASS12 = difficulty relaxing; DASS13 = downhearted and blue; DASS14 = intolerance of interruptions; DASS15 = close to panic; DASS16 = unable to get enthusiastic; DASS17 = self-depreciation; DASS18 = touchy; DASS19 = sense of action of heart in absence of physical exertion; DASS20 = feel scared without any reason; DASS21 = meaninglessness of life.

Figure 2. Centrality Plots for Association in Network 1 of Each Node (standardized values). 

As observed in Table 3 and Figure 2, the strongest nodes with a relatively high number of connections were: “close to panic” (DASS15), “close to panic” (DASS15), “difficult to relax” (DASS12) and “meaninglessness of life” (DASS21). Furthermore, the nodes with the lowest centrality of strength were “dryness of mouth” (DASS2), “intolerance of interruptions” (DASS14), and “nervousness” (DASS8). We focused on strength as the main indicator of centrality because it shows reasonably accurate estimations for network analysis in psychology (Santos et al., 2018).

Finally, the accuracy and stability of the network were evaluated. Confidence intervals around some of the edges estimated were large, which suggests that many of them probably did differ significantly from each other, and this could prevent interpretation of the order of the network edges.

Figure 2 shows graphically the stability of the centrality indices examined. Case-dropping bootstrap, which resamples with different data subsets, was used. The correlation stability coefficient of the data subset represents different percentages of the general sample. Associations between estimations decreased from the original sample to the subsample from 95% to 25%. The correlations for all the indices of centrality showed a certain stability, as they were above .50 (Epskamp et al., 2018), with strength above .70 (traditionally interpreted as an indicator of very large effect in behavior sciences; Cohen, 1988) (Figure 3).

Figure 3. Stability of centrality indices in the DASS-21 emotional symptoms network. 

Network Analysis 2: Emotional Symptoms (DASS-21 dimensions) and Different Types of Cybervictimization (CYVIC)

Figure 4 shows the combined network of the DASS-21 emotional symptom subscales (depression, anxiety, and stress) and the CYVIC dimensions, which represent different types of cybervictimization. This network had seven nodes, and the maximum number of edges was 21, with 16 remaining after EBICglasso estimation. In this case, the sparsity index was .23. Connectivity between cybervictimization nodes was stronger than with the emotional symptom scales.

Figure 4. DASS-21 and Cybervictimization Type (CYVIC) Network. 

Of the three DASS-21 scales, anxiety (2) had the most visible associations with the written-verbal (6) and online exclusion (7) cybervictimization modalities, with edge weights of .080 and .058, respectively. There was no association at all with other types of cybervictimization, such as impersonation or visual sexual.

All the connections with the different types of cybervictimization were positive, but with stronger edge weights between written-verbal (6) and online exclusion (7) with .350, followed by connections between impersonation (4) and written-verbal (6) and visual sexual cybervictimization (5), with weights of .316 and .308, respectively.

Other connections between CYVIC nodes showed associations between online exclusion (7) and impersonation (4) and visual sexual cybervictimization (5), and this one with written verbal (6), with edge weights of .165, .229, and .183, respectively.

Centrality indices of strength for impersonation (4), visual sexual cybervictimization (5), written-verbal (6), and online exclusion (7) were -0.684, -1.152, 1.196, and -0.299, respectively. Thus, written-verbal victimization may be considered the center node of the cybervictimization modalities in the combined network of emotional symptoms-cybervictimization.

With the estimation of Network 1 above, it was confirmed that the strongest nodes were DASS15, DASS12, and DASS21, represented by an element of each subscale: anxiety, stress, and depression, respectively. In this case, with the estimation of the combined network with different types of cybervictimization, the anxiety node was the strongest (1.552).

Finally, the same combined network was estimated by gender. Figure 5a shows the network for males and Figure 5b for females. In both cases, the network has seven nodes, with 14 edges other than 0 after estimating with EBICglasso, and a dispersion index of 0.33.

Figure 5. DASS-21 and Cybervictimization type (CYVIC) Network by Sex (Fig. 5a male, Fig. 5b female). 

Of the DASS-21 subscales, anxiety (2) had associations with the written-verbal (6) and online exclusion (7) cybervictimization modalities, with edge weights of .077 and .057 for males and .080 and .074 for females, respectively. Depression (1) also was associated, although weaker, with written-verbal (6) and online exclusion (7), with weights of .044 and .033 for males, and .053 and .020 for females, respectively. Differences on the Stress (3) scale were in the edge weights of both networks, with no association with type of cybervictimization, except in the network estimated for females, where stress was associated with online exclusion (7) with a weight of .031.

In the different types of cybervictimization in the network estimated for males, the edge weights were stronger (.364) between impersonation (4) and written-verbal (6), followed by the connection between written-verbal (6) and online exclusion (7) with .346. Moreover, looking at the network estimated for females, the connection between the written-verbal (6) and online exclusion (7) stands out, followed by impersonation (4) with visual sexual cybervictimization (5) with .285.

Table 4 shows the centrality indices in the network estimated for both genders. Both networks show stronger centrality indices for written-verbal cybervictimization, and the DASS-21 anxiety subscale, with values of 1.150 and 1.235 for males, and 1.191 and 1.419 for females, respectively.

Table 4. DASS-21 and Cybervictimization Type (CYVIC) Centrality Measurements from the Network Analysis, by Gender. 

Gender differences observed between the networks emphasized the impersonation and stress nodes. Even though the strength of the impersonation node has low-strength centrality indices in both networks, it is weaker for females (-1.079) than males (-0.092). In the network estimated for males, the stress node also has a weaker centrality index (-1.214) than the same node in the female network (0.169). The contrary occurs with the depression node, where it is the network estimated for males which has a stronger centrality index (0.108) than females (-0.142).

Thus, observing the data presented in Table 4, it may be said that in the gender networks estimated, anxiety was the strongest node in both cases. However, differences were observed in the centrality of depression and stress nodes: the first one (depression) was stronger in the male network estimated and the second one (stress) was stronger in the female network.

Discussion

This study posed two objectives, to examine the negative emotional states in a sample of adolescents and to analyze their relationship with cybervictimization. For the first objective, to observe specific emotional symptoms, the results of the network structure showed that the different nodes of the three emotional states (anxiety, stress, and depression) were positively related to each other. Nevertheless, some of the relationships were stronger than others. This is of interest, because even though the DASS-21 is a useful questionnaire for constructing a general mental health index, its items cluster on factors that ignore the structure connecting them. Therefore, they do not approach the real complexity of the relationship between psychoemotional wellbeing and the symptoms that are observed in those who show their alteration. The most influential emotional symptoms were “close to panic”, “difficulty relaxing”, and “meaninglessness of life”. The relationship between these elements could indicate possible causal effects between these symptoms, or at least potential conditional relationships (Kossakowski et al., 2016). It should also be recalled that each of the symptoms mentioned above pertains to a different negative emotional state (that is, depression, anxiety, or stress). The high comorbidity between these conditions is therefore not surprising (Panamerican Health Organization, 2017; Romero & Méndez, 2021). The existence of common factors within these disorders that share etiological processes and factors has even been postulated (Barlow et al., 2004; Carlucci et al., 2021).

Furthermore, taking the dimensions instead of the symptoms, middle-size gender differences were found. Specifically, women showed higher scores in depression, anxiety, and stress. This agrees with studies which mention gender differences in adolescent mental health, where girls show stronger prevalence of emotional disorders (Campbell et al., 2021; Mar et al., 2022). First descriptive results for the second objective indicated positive correlations between cybervictimization types and negative emotional states. The strongest associations were between anxiety and written-verbal and exclusion cybervictimization. Both types of cybervictimization have been identified as of the highest incidence in Spanish adolescents (Álvarez-García, Núñez, et al., 2017).

Examining the network analysis of emotional states and types of cybervictimization, written-verbal victimization was the central node in the various types of cyberbullying and this, in turn, showed the strongest link to the anxiety node. Previous studies have reported that victims of cyberbullying have worse quality of life in their physical, social, and mental wellbeing (González-Cabrera et al., 2018). In this regard, cyberbullying has been linked to increased child depression and anxiety (Evangelio et al., 2022). Our results emphasize mainly anxiety as the negative emotional state most closely related to cybervictimization.

Nonetheless, there were some gender differences in the network analysis between emotional states and cybervictimization. In particular, anxiety was the emotional state that had the strongest link to written-verbal and online exclusion modalities for both sexes. However, for boys, there was also a relationship, although weaker, of depression with the abovementioned modalities, while for girls an association was found between depression and written-verbal cyberbullying (but not online exclusion). And furthermore, a relationship between the stress scale and online exclusion was identified. These findings are along the line of Álvarez-García, Barreiro-Collazo, et al., (2017), who showed that written-verbal and online exclusion were the most frequent, or at least the most important types of cyberbullying, undifferentiated between boys and girls. What our results add is that there is a gender difference in the relationship of these types of cybervictimization with certain mental states. We should also add that in girls there was a higher tendency to connection between the DASS-21 nodes and the CYVIC (that is, the three negative emotional states were related to a cybervictimization type, compared to two in boys). In turn, the networks estimated between the different manifestations of cybervictimization show their complex interaction. Finally, we could suggest that, as previously established, women have a stronger tendency to emotional problems from online bullying and how they cope with it (McLoughlin, 2021).

This study had some limitations, including the accuracy of the edges. The estimates of network accuracy, with large confidence intervals around most of the edge weights, suggest a problematic interpretation of the order of many of the network edges, which should be taken with caution. However, differences in centrality indices may be accurate even when there are large ICs for edge weights (Epskamp et al., 2018). In addition, as cutoff points were previously established by the authors (Álvarez et al., 2017) for cybervictimization, it was not possible to differentiate between youths who had not undergone online bullying, or had been at some time, from those who were attacked more frequently.

Practical Applications and Future Lines of Research

This study enabled the most important nodes in the structure of emotional states to be identified and, therefore, assisted in elucidating the specific symptoms of greatest importance to the emotional wellbeing of adolescents. This could be used to set up specific programs to curtail the psychoemotional symptoms that could develop into mental health problems. In particular, feelings of being about to have a panic attack, difficulties relaxing, or thinking that life is meaningless are major symptoms affecting their psychoemotional wellbeing and could trigger negative circular structural emotional thinking. Therefore, schools could work on emotional intelligence to palliate these symptoms in adolescents. This in turn would enable work with youths who show comorbid symptoms affecting their psychoemotional wellbeing, but not meeting diagnostic criteria for a specific category of affective disorders. Another possible application of the findings of this study would be in promoting intervention addressing anxiety in adolescents who are cyberbullying victims.

Future lines of research could find out whether the emotional symptom network structure differs between populational groups (e.g., at-risk adolescents, preadolescents, and emerging adults). Secondly, in line with the limitations mentioned, measures enabling the identification of specific manifestations of difficulties experienced by adolescents who have been the object of cybervictimization should be continued. Thus, finding out whether the emotional symptom network of youths who experience cyberbullying is similar to the rest of adolescents could help understand its effects.

Conclusions

The new technologies have meant unprecedented progress for society, but they also pose new problems. Cyberbullying is highly prevalent among youths and, therefore, attention must necessarily be given to its consequences. The results of this study show that negative emotional states and types of cybervictimization are related in a complex network where the efforts to approach reduction of emotional symptoms associated with it could be of lasting benefit to the emotional wellbeing of youths. Thus, focusing attention on the central nodes (such as anxiety) in the network could be essential to preventing a cascade of negative emotional symptoms in young people who suffer from cyberbullying. This could put an end to early forms of cybervictimization or provide adolescents with strategies for coping with them to slow down or head off the appearance of other forms of cyberbullying.

Cite this article as:Molero, M. M., Pérez-Fuentes, M. C., Martos, A., Pino, R. M., and Gázquez, J. J. (2023). Network analysis of emotional symptoms and their relationship with different types of cybervictimization. European Journal of Psychology Applied to Legal Context, 15(1), 23-32. https://doi.org/10.5093/ejpalc2023a3

Funding:This research has been carried out thanks to the project “Análisis de habilidades emocionales y desarrollo de un programa para el entrenamiento emocional de los jóvenes de Almería: Cuidemos la Salud Mental”: EMOTRAIN-ALMERIA (TRFE-SI-2021/008), with funding from the UALtransferE-2021 Program of the University of Almería.

References

Álvarez-García, D., Barreiro-Collazo, A., & Núñez, J. C. (2017). Cyberbullying among adolescents: Prevalence and gender differences. Comunicar, 50(25), 89-97. https://doi.org/10.3916/C50-2017-08 [ Links ]

Álvarez-García, D., Núñez, J. C., Barreiro-Collazo, A., & García, T. (2017). Validation of the Cybervictimization Questionnaire (CYVIC) for adolescents. Computers in Human Behavior, 70(2017), 270-281. https://doi.org/10.1016/j.chb.2017.01.007 [ Links ]

Arrivillaga, C., Rey, L., & Extremera, L. (2022). Psychological distress, rumination and problematic smartphone use among Spanish adolescents: An emotional intelligence-based conditional process analysis. Journal of Affective Disorders, 296(1), 1-8. https://doi.org/10.1016/j.jad.2021.09.021 [ Links ]

Barlow, D. H., Allen, L. B., & Choate, M. L. (2004). Toward a unified treatment for emotional disorders. Behaviour Therapy, 35(2), 205-230. https://doi.org/10.1016/j.beth.2016.11.005 [ Links ]

Barragán, A. B., Molero, M. M., Pérez-Fuentes, M. C., Simón, M. M., Martos, Á., Sisto, M., & Gázquez, J. J. (2021). Study of cyberbullying among adolescents in recent years: A bibliometric analysis. International Journal of Environmental Research and Public Health, 18(6), 3016. https://doi.org/10.3390/ijerph18063016 [ Links ]

Beaudequin, D., Schwenn, P., McLoughlin, L. T., Parker, M., Broadhouse, K., Smcock, G., Boyes, A., Kannis-Dymand, L., Wood, A., Lagopoulos, J., & Hermens, D. F. (2020). Using measures of intrinsic homeostasis and extrinsic modulation to evaluate mental health in adolescents: Preliminary results from the longitudinal adolescent brain study (LABS). Psychiatry Research, 285, Article 112848. https://doi.org/10.1016/j.psychres.2020.112848 [ Links ]

Campbell, O. L. K., Bann, D., & Patalay, P. (2021). The gender gap in adolescent mental health: A cross-national investigation of 566,829 adolescents across 73 countries. SSM-Population Health, 13, Article 100742. https://doi.org/10.1016/j.ssmph.2021.100742 [ Links ]

Carlucci, L., Saggino, A., & Balsamo, M. (2021). On the efficacy of the unified protocol for transdiagnostic treatment of emotional disorders: A systematic review and meta-analysis. Clinical Psychology Review, 87, Article 101999. https://doi.org/10.1016/j.cpr.2021.101999 [ Links ]

Carvalho, M., Branquinho, C., & Gaspar de Matos, M. (2021). Cyberbullying and bullying: Impact on psychological symptoms and well-being. The International Journal of Child Indicators Research, 14(1), 435-452. https://doi.org/10.1007/s12187-020-09756-2 [ Links ]

Cebollero-Salinas, A., Orejudo, S., Cano-Escoriza, J., & Íñiguez-Berrozpe, T. (2022). Cybergossip and problematic internet use in cyberbullying and cybervictimisation among adolescents. Computers in Human Behavior, 131, Article 107230. https://doi.org/10.1016/j.chb.2022.107230 [ Links ]

Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Erlbaum. [ Links ]

Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297-334. https://doi.org/10.1007/BF02310555 [ Links ]

Cuadrado-Gordillo, I., & Fernández-Antelo, I. (2016). Adolescents' perception of the characterizing dimensions of cyberbullying: Differentiation between bullies' and victims' perceptions. Computers in Human Behavior, 55(part B) 653-663. https://doi.org/10.1016/j.chb.2015.10.005 [ Links ]

De Pasquale, C., Martinelli, V., Sciacca, F., Mazzone, M., Chiappedi, M., Dinaro, C., & Hichy, Z. (2021). The role of mood states in cyberbullying and cybervictimization behaviors in adolescents. Psychiatry Research, 300, Article 113908. https://doi.org/10.1016/j.psychres.2021.113908 [ Links ]

Dooley, J. J., Pyalski, J., & Cross, D. (2009). Cyberbullying versus face-to-face bullying: A theoretical and conceptual review. Zeitschrift für Psychologie/Journal of Psychology, 217(4), 182-188. https://psycnet.apa.org/doi/10.1027/0044-3409.217.4.182 [ Links ]

Dorol-Beauroy-Eustache, O., & Mishara, B. L. (2021). Systematic review of risk and protective factors for suicidal and self-harm behaviors among children and adolescents involved with cyberbullying. Preventive Medicine, 152(1), Article 106684. https://doi.org/10.1016/j.ypmed.2021.106684 [ Links ]

Epskamp, S., Borsboom, D., & Fried, E. I. (2018). Estimating psychological networks and their accuracy: A tutorial paper. Behavior Research Methods, 50(1), 195-212. https://doi.org/10.3758/s13428-017-0862-1 [ Links ]

Epskamp, S., & Fried, E. I. (2018). A tutorial on regularized partial correlation networks. Psychological Methods, 23(4), 617-634. https://doi.org/10.1037/met0000167 [ Links ]

Evangelio, C., Rodríguez-González, P., Fernández-Río, J., & González-Villora, S. (2022). Cyberbullying in elementary and middle school students: A systematic review. Computers & Education, 176, Article 104356. https://doi.org/10.1016/j.compedu.2021.104356 [ Links ]

Fahy, A. E., Stansfeld, S. A., Smuk, M., Smith, N. R., Cummins, S., & Clark, C. (2016). Longitudinal associations between cyberbullying involvement and adolescent mental health. Journal of Adolescent Health, 59(5), 502-509. https://doi.org/10.1016/j.jadohealth.2016.06.006 [ Links ]

Fruchterman, T. M., & Reingold, E. M. (1991). Graph drawing by force-directed placement. Software: Practice and Experience, 21(11), 1129-1164. https://doi.org/10.1002/spe.4380211102 [ Links ]

Gámez-Guadix, M., Mateos, E., Wachs, S., & Blanco, M. (2022). Self-harm on the internet among adolescents: Prevalence and association with depression, anxiety, family cohesion, and social resources. Psicothema, 34(2), 233-239. https://doi.org/10.7334/psicothema2021.328 [ Links ]

Gancedo, Y., Fariña, F., Seijo, D., Vilariño, M., & Arce, R. (2021). Reality Monitoring: A meta-analytical review for forensic practice. European Journal of Psychology Applied to Legal Context, 13(2), 99-110. https://doi.org/10.5093/ejpalc2021a10 [ Links ]

Gázquez, J. J., Cangas, A. J., Pérez-Fuentes, M. C., & Lucas, F. (2008). Comparative analysis of the perception of school violence in teachers, pupils, and families. Spanish Journal of Psychology, 11(2), 443-452. https://doi.org/10.1017/S1138741600004455 [ Links ]

Gázquez, J. J., Pérez-Fuentes, M. C., Carrión, J. J., & Santiuste, V. (2010). Estudio y análisis de conductas violentas en educación secundaria en España [Study and analysis of violent behaviour in secondary education in Spain]. Universitas Psychologica, 9(2), 371-380. https://revistas.javeriana.edu.co/index.php/revPsycho/article/view/304/457Links ]

González-Cabrera, J., Leon-Mejías, A., Beranuy, M., Gutiérrez-Ortega, M., Álvarez-Bardón, A., & Machimbarrena, J. M. (2018). Relationship between cyberbullying and health-related quality of life in a sample of children and adolescents. Quality of Life Research, 27(10), 2609-2618. https://doi.org/10.1007/s11136-018-1901-9 [ Links ]

González-Cabrera, J., Machimbarrena, J. M., Ortega-Barón, J., & Álvarez-Bardón, A. (2020). Joint association of bullying and cyberbullying in health-related quality of life in a sample of adolescents. Quality of Life Research, 29(4), 941-952. https://doi.org/10.1007/s11136-019-02353-z [ Links ]

Hempehill, S. A., & Heerde, J. A. (2014). Adolescent predictors of young adult cyberbullying perpetration and victimization among Australian youth. Journal of Adolescent Health, 55(4), 580-587. https://doi.org/10.1016/j.jadohealth.2014.04.014 [ Links ]

Hidalgo-Fuentes, S. (2022). Problematic internet use and procrastination in students: a meta-analysis: Internet use and procrastination. European Journal of Education and Psychology, 15(1), 1-18. https://doi.org/10.32457/ejep.v15i1.1815 [ Links ]

Isvoranu, A. M., Boyette, L. L., Guloksuz, S., & Borsboom, D. (2017). Chapter G1. Symptom network models of psychosis. In C. A. Tamminga, E. I. Ivleva, U. Reininghaus, & J. van Os (Eds.). Psychotic disorders: Comprehensive conceptualization and treatments (pp.70-78). Oxford University Press. [ Links ]

JASP Team. (2022). JASP (Version 0.16.3) [Computer software]. [ Links ]

Kossakowski, J. J., Eppskamp, S., Kieffer, J. M., van Borkulo, C. D., Rhemtulla, M., & Borsboom, D. (2016). The application of a network approach to Health-Related Quality of Life (HRQoL): Introducing a new method for assessing HRQoL in healthy adults and cancer patients. Quality of Life Research, 25(4), 781-792. https://doi.org/10.1007%2Fs11136-015-1127-z [ Links ]

Livingstone, S., Ólafsson, K., Helsper, E. J., Lupiáñez-Villanueva, F., Veltri, G. A., & Folkvord, F. (2017). Maximising opportunities and minimizing risks for children online: The role of digital skills in emerging strategies of parental mediation. Journal of Communication, 67(1), 82-105. https://doi.org/10.1111/jcom.12277 [ Links ]

Lozano-Blasco, R., Cortés-Pascual, A., & Latorre-Martínez, M. P. (2020). Being a cybervictim and a cyberbully – the duality of cyberbullying: A meta-analysis. Computers in Human Behavior, 111, Article 106444. https://doi.org/10.1016/j.chb.2020.106444 [ Links ]

Machmutow, K., Perren, S., Sticca, F., & Alsaker, F. D. (2012). Peer victimisation and depressive symptoms: Can specific coping strategies buffer the negative impact of cybervictimisation? Emotional and Behavioural Difficulties, 17(3-4), 403-420. https://doi.org/10.1080/13632752.2012.704310 [ Links ]

Mallik, C. I., & Radwan, R. B. (2020). Adolescent victims of cyberbullying in Bangladesh- prevalence and relationship with psychiatric disorders. Asian Journal of Psychiatry, 48, Article 101893. https://doi.org/10.1016/j.ajp.2019.101893 [ Links ]

Mar, J., Larrañaga, I., Ibarrondo, O., González-Pinto, A., las Hayas, C., Fullaondo, A., Izko-Basurko, I., Alonso, J., Mateo-Abad, M., & de Manuel, E. (2022). Socioeconomic and gender inequalities in mental disorders among adolescents and young adults. Revista de Psiquiatría y Salud Mental. Advance online publication. https://doi.org/10.1016/j.rpsm.2022.07.001 [ Links ]

McDonald, R. P. (1999). Test theory: A unified approach. Lawrence Erlbaum Associates. [ Links ]

McLoughlin, L. T. (2021). Understanding and measuring coping with cyberbullying in adolescents: Exploratory factor analysis of the brief coping orientation to problems experienced inventory. Current Psychology, 40(2), 4300-4310. https://doi.org/10.1007/s12144-019-00378-8 [ Links ]

McLoughlin, L. T., Spears, B. A., Taddeo, C. M., & Hermens, D. F. (2019). Remaining connected in the face of cyberbullying: Why social connectedness is important for mental health. Psychology in the Schools, 56(6), 945-958. https://doi.org/10.1002/pits.22232 [ Links ]

Molero, M. M., Martos, Á., Barragán, A. B., Pérez-Fuentes, M. C., & Gázquez, J. J. (2022). Anxiety and depression from cybervictimization in adolescents: A meta-analysis and meta-regression study. European Journal of Psychology Applied to Legal Context, 14(1), 42-50. https://doi.org/10.5093/ejpalc2022a5 [ Links ]

Montes, Á., Sanmarco, J., Novo, M., Cea, B., & Arce, R. (2022). Estimating the Psychological harm consequence of bullying victimization: A meta-analytic review for forensic evaluation. International Journal of Environmental Research and Public Health, 19(21), Article 13852. https://doi.org/10.3390/ijerph192113852 [ Links ]

Montiel, I., Carbonell, E., & Pereda, N. (2016). Multiple online victimization of Spanish adolescents: Results from a community sample. Child Abuse & Neglect, 52, 123-134. https://doi.org/10.1016/j.chiabu.2015.12.005 [ Links ]

Novo, M., Redondo, L., Seijo, D., & Arce, R. (2016). Design and validation of a scale for the evaluation of the sense of community in virtual academic groups [Diseño y validación de una escala para la evaluación del sentido de comunidad en grupos académicos virtuales]. Revista de Investigación en Educación, 14(2), 126-140. https://revistas.uvigo.es/index.php/reined/article/view/2080/2056Links ]

Oksanen, A., Miller, B. L., Savolainen, I., Sirola, A., Demant, J., Kaakinen, M., & Zych, I. (2021). Social media and access to drugs online: A nationwide study in the United States and Spain among adolescents and young adults. European Journal of Psychology Applied to Legal Context, 13(1), 29-36. https://doi.org/10.5093/ejpalc2021a5 [ Links ]

Olweus, D. (1978). Aggression in the schools: Bullies and whipping boys. Hemisphere. [ Links ]

Panamerican Health Organization. (2017). Depression and other common mental disorders. Global health estimates. World Health Organization. [ Links ]

Pérez-Fuentes, M. C., Gázquez, J. J., Molero, M. M., Oropesa, N. F., & Martos, Á. (2021). Violence and job satisfaction of nurses: Importance of a support network in healthcare. European Journal of Psychology Applied to Legal Context, 13(1), 21-28. https://doi.org/10.5093/ejpalc2021a3 [ Links ]

Quintana-Orts, C., Mérida-López, S., Rey, L., & Extremera, N. (2021). A closer look at the emotional intelligence construct: How do emotional intelligence facets relate to life satisfaction in students involved in bullying and cyberbullying? European Journal of Investigation in Health, Psychology and Education, 11(3), 711-725. https://doi.org/10.3390/ejihpe11030051 [ Links ]

Rodríguez-Álvarez, J. M., Yubero, S., Navarro, R., & Larrañaga, E. (2021). Relationship between socio-emotional competencies and the overlap of bullying and cyberbullying behaviors in primary school students. European Journal of Investigation in Health, Psychology and Education, 11(3), 686-696. https://doi.org/10.3390/ejihpe11030049 [ Links ]

Romero, S., & Méndez, I. (2021). Changing mood? Depression and affective disorders. In A. Tarbal (Ed.), A look at adolescent mental health. Keys to understand and accompany them (pp. 143-157). Faros Sant Joan de Déu. [ Links ]

Ruiz, F. J., García, M. B., Suárez, J. C., & Odriozola, P. (2017). The hierarchical factor structure of the Spanish version of Depression Anxiety and Stress Scale. International Journal of Psychology and Psychological Therapy, 17(1), 97-105. https://www.ijpsy.com/volumen17/num1/460/the-hierarchical-factor-structure-of-the-EN.pdfLinks ]

Sahín, M. (2012). The relationship between the cyberbullying/cybervictmization and loneliness among adolescents. Children and Youth Services Review, 34(4), 834-837. https://doi.org/10.1016/j.childyouth.2012.01.010 [ Links ]

Santos, H. P. J., Kossakowski, J. J., Schwartz, T. A., Beeber, L., & Fried, E. I. (2018). Longitudinal network structure of depression symptoms and self-efficacy in low-income mothers. PLoS ONE, 13(1), Article e0191675. https://doi.org/10.1371/journal.pone.0191675 [ Links ]

Save the Children. (2019). Viral violence: Executive summary [Violencia viral: resumen ejecutivo]. https://www.savethechildren.es/sites/default/files/imce/docs/violenciaviral_resumenejecutivo.pdfLinks ]

Schunk, F., Zeh, F., & Trommsdorff, G. (2022). Cybervictimization and well-being among adolescents during the COVID-19 pandemic: The mediating roles of emotional self-efficacy and emotion regulation. Computers in Human Behavior, 126, Article 107035. https://doi.org/10.1016/j.chb.2021.107035 [ Links ]

Smith, P. K. (2015). The nature of cyberbullying and what we can do about it. Journal of Research in Special Educational Needs, 15(3), 176-184. https://doi.org/10.1111/1471-3802.12114 [ Links ]

Smith, P. K., Mahdavi, J., Carvalho, M., Fisher, S., Russel, S., & Tippett, N. (2008). Cyberbullying: Its nature and impact in secondary school pupils. Journal of Child Psychology and Psychiatry and Allied Disciplines, 49(4), 376-385. https://doi.org/10.1111/j.1469-7610.2007.01846.x [ Links ]

Steer, O. L., Macaulay, P. J. R., & Betts, L. R. (2021). Understanding child and adolescent cyberbullying. Child and adolescent online risk exposure. An ecological perspective. In M. F. Wright & L. B. Schiamberg (Eds.), Child and adolescent online risk exposure: An ecological perspective (pp. 69-96). Academic Press. [ Links ]

Thai, T. T., Duong, M. H. T., Vo, D. K., Dang, N. T. T., Huynh, Q. N. H., & Tran, H. G. N. (2022). Cyber-victimization and its association with depression among Vietnamese adolescents. PeerJ, 10, Article e12907. https://doi.org/10.7717/peerj.12907 [ Links ]

Twenge, J. M., Haidt, J., Blake, A. B., McAllister, C., Lemon, H., & Le Roy, A. (2021). Worldwide increases in adolescent loneliness. Journal of Adolescence, 93(1), 257-269. https://doi.org/10.1016/j.adolescence.2021.06.006 [ Links ]

Vandebosch, H., & Van Cleemput, K. (2008). Defining cyberbullying: A qualitative research into the perceptions of youngsters. CyberPsychology & Behavior, 11(4), 499-503. https://doi.org/10.1089/cpb.2007.0042 [ Links ]

Ventura-León, J. L., & Caycho, T. (2017). El coeficiente omega: un método alternativo para la estimación de la confiabilidad. Revista Latinoamericana de Ciencias Sociales, Niñez y Juventud, 15(1), 625-627. https://www.redalyc.org/pdf/773/77349627039.pdfLinks ]

Vilariño, M., Amado, B. G., Seijo, D., Selaya, A., & Arce, R. (2022). Consequences of child maltreatment victimisation in internalising and externalising mental health problems. Legal and Criminological Psychology, 27(2), 182-193. https://doi.org/10.1111/lcrp.12212 [ Links ]

Welch, B. L. (1947). The generalization of “Student's” problem when several different population variances are involved. Biometrika. 34(1-2), 28-35. https://doi.org/10.1093/biomet/34.1-2.28 [ Links ]

Received: October 13, 2022; Accepted: November 16, 2022

Correspondence: amm521@ual.es (A. Martos).

Conflict of Interest

The authors of this article declare no conflict of interest.

Creative Commons License This is an Open Access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.