SciELO - Scientific Electronic Library Online

 
vol.14 issue1Assessing risk perception over recidivist traffic offenders from a multi-group approach: how gendered could it be? author indexsubject indexarticles search
Home Pagealphabetic serial listing  

My SciELO

Services on Demand

Journal

Article

Indicators

Related links

  • On index processCited by Google
  • Have no similar articlesSimilars in SciELO
  • On index processSimilars in Google

Share


The European Journal of Psychology Applied to Legal Context

On-line version ISSN 1989-4007Print version ISSN 1889-1861

The European Journal of Psychology Applied to Legal Context vol.14 n.1 Madrid Jan./Jun. 2022  Epub Jan 31, 2022

https://dx.doi.org/10.5093/ejpalc2022a5 

Research Articles

Anxiety and depression from cybervictimization in adolescents: a metaanalysis and meta-regression study

Ansiedad y depresión por cibervictimización en adolescentes: un meta-análisis y un estudio de meta-regresión

María M Moleroa  , África Martosa  , Ana B Barragána  , María C Pérez-Fuentesa  , José J Gázqueza  b 

aUniversity of Almería, Spain

bUniversidad Autónoma de Chile, Chile

ABSTRACT

Background/Objective:

Cyberbullying is one of the social problems of most concern in educational spheres, especially in adolescence, where victimization experiences have been associated with episodes of anxiety and depression. The aim of this work was to analyze the relationship between cybervictimization, anxiety and depression in adolescence in a meta-analysis and identify the moderating variables that could help to explain the various correlations.

Method:

A search for cross-sectional studies was conducted in the Web of Science, Scopus, and PsycINFO databases. Of the 156 studies identified, finally 13 met inclusion criteria, with a total of 7,348 participants.

Results:

The results show statistically significant correlations between cybervictimization and anxiety (r = .31) and cybervictimization and depression (r = .28), with moderate-to-large effect sizes. The meta-regression analysis showed that the percentage of women and continent are moderating variables in the relationship between cybervictimization with depression and anxiety.

Conclusions:

In conclusion, misuse of the new information and communication technologies can lead to psychological and social maladjustment of individuals, with negative repercussions on their development.

Keywords Adolescents; Anxiety; Cybervictimization; Depression; Meta-analysis

RESUMEN

Antecedentes/Objetivo:

El ciberacoso es uno de los problemas sociales de mayor preocupación en los ámbitos educativos, especialmente en la adolescencia, en la que las experiencias de victimización se han asociado a episodios de ansiedad y depresión. Se diseñó un estudio con el objetivo de analizar la relación entre cibervictimización, ansiedad y depresión en la adolescencia mediante un meta-análisis e identificar las variables moderadoras que podrían ayudar a explicar las distintas correlaciones.

Método:

Se realizó una búsqueda de estudios transversales en las bases de datos Web of Science, Scopus y PsycINFO. De los 156 estudios identificados, finalmente 13, con un total de 7,348 participantes, cumplieron con los criterios de inclusión.

Resultados:

Los resultados sugieren correlaciones estadísticamente significativas entre cibervictimización y ansiedad (r = .31) y cibervictimización y depresión (r = .28). El análisis de meta-regresión mostró que el porcentaje de mujeres y continente son variables moderadoras en la relación de cibervictimización con depresión y ansiedad.

Conclusiones:

En conclusión, el mal uso de las nuevas tecnologías de la información y la comunicación puede provocar un desajuste psicológico y social de las personas, con repercusiones negativas en su desarrollo.

Palabras clave Adolescentes; Ansiedad; Cibervictimización; Depresión; Metaanálisis

Introduction

School violence and cyberbullying are two of the social and public health problems of most worldwide concern in education, organizations, and interpersonal relations (Bjärehed et al., 2019; Dennehy et al., 2020; Doumas & Midgett, 2020; Ng, 2019; Ruiz-Hernández et al., 2020; Viejo et al., 2020) along with substance use (Fernández-Artamendi et al., 2021; Pérez-Fuentes et al., 2021; Pérez-Fuentes et al., 2020). Violence on electronic devices and social networks has become one of the phenomena most studied in recent years (Barragán et al., 2021; Carvalho et al., 2021; Nasaescu et al., 2020). Cyberbullying consists of harm caused to another person through the repeated use of information and communication technologies (texting, social networks, calls, emails, etc.) by a person or group of persons (Kowalski et al., 2014; Nixon, 2014). In addition, its most outstanding characteristics are the possibility of carrying out such aggression at any time, anonymously, with a higher probability of an audience, and the physical distance separating victim and aggressor (Field, 2018; Wright et al., 2019). All these characteristics, along with the intentionality and power imbalance contribute to the growing prevalence of this phenomenon (Buelga et al., 2020; Kowalski et al., 2014), in which aggressors, victims, and observers are all involved.

Cyber-aggressors use the technology as a way to relieve their frustrations and generally have low self-esteem, problems expressing their emotions appropriately, and problems at school (Livazovic & Ham, 2019). The victims of cyberbullying intentionally harmed by the aggressor are usually introverted and timid, lacking social skills and social adaptation (Rodríguez-Álvarez et al., 2021). The lack of physical contact and unknown identity of the aggressor generate a feeling of desperation and helplessness in the victim that is worsened by the ease with which the harmful content quickly goes viral (Dong, 2020). Spectators are usually silent or defend the victim, although their opportunities for intervention in preventing cybervictimization are reduced, since most of the interactions are unsupervised and isolated, or they may even encourage the cyber-aggressor (Gardella et al., 2017). This type of behavior has become expected and accepted by youths as a relational and group process instead of considering individual differences (Menin et al., 2021). This study therefore focuses on the role of cyberbullying victims.

Studies to date have varied both in their conception of the phenomenon and how it is measured, although most have found that from 20% to 50% of youths have had at least one cyberbullying experience, increasing the number of cyber-victims (Garaigordobil, 2011; Garaigordobil, 2015; González-Calatayud & Prendes, 2021; Lee & Shin, 2017; Ortega-Barón et al., 2016). Victimization experiences are associated with adolescent wellbeing and behavior at school (Gardella et al., 2017). Factors such as age and gender have been evaluated in cybervictimization, although the results on the role of gender are not conclusive (Livazovic & Ham, 2019; Rodríguez-Domínguez et al., 2020). Kowalski and Limber (2007) emphasize that females are more prone to cybervictimization. Among the personality factors, cybervictimization is related positively to neuroticism (Alonso & Romero, 2017). Social intelligence acts as a protective factor against cybervictimization (Kowalski et al., 2014) and low cognitive empathy is a risk factor in cyberbullying behavior (Livazovic & Ham, 2019). Furthermore, emotional intelligence (Guerra et al., 2021; Quintana-Orts et al., 2021) and communication skills and parental control are protective factors (Feijóo et al., 2021), as is adolescent school adjustment (Rodríguez-Fernández et al., 2020).

Various studies have emphasized the negative consequences to adolescents who experience cybervictimization (Bauman et al., 2013; Fisher et al., 2016), especially psychological, behavioral, and educational problems (Brown et al., 2014), which differ from face-to-face victimization due to the role of technology in the adolescent's immediate environment (Bronfenbrenner, 1992). Thus, cyber-victimization is linked to more somatic complaints, and victims of cyberbullying tend to blame themselves (Rey et al., 2020), and say they feel anger, shame, and indifference. They also suffer from episodes of depression and anxiety, as there is a significant relationship between high levels of depression and stress and being the cyber-victim or aggressor (Martínez-Monteagudo et al., 2020). A meta-analysis of longitudinal studies on perpetration and victimization by cyberbullying found that the use of the internet along with anxiety and depression are predictors of cybervictimization (Marciano et al., 2020). Another study done on university students who had undergone cyberbullying in high school showed high levels of anxiety and depression (Jenaro et al., 2017). Similar results have been found in children and adolescents, where there is a significant relationship between cybervictimization, depression, and anxiety (Audrin & Blaya, 2020; Martínez-Monteagudo et al., 2020).

The main objective of this study was to analyze the relationship between cybervictimization, anxiety, and depression in an adolescent population through a meta-analysis, evaluate the heterogeneity and bias in publications, and identify the moderating variables that could help explain the various correlations.

Method

A review was made following the guidelines on preferred reporting items for systematic reviews and meta-analysis (PRISMA) (Moher et al., 2015).

Data Sources and Searches

The search for publications was made in the Web of Science, Scopus, and PsycINFO databases on March 25, 2021. In all cases, the results were filtered by Open Access “journal articles” as the type of document, and the time period was limited from 2011 to 2021. Different specifications were made depending on the characteristics and coverage of the databases. In Web of Science, the search was limited to the term “theme” to refer to the title, abstract, and keywords. In Scopus and PsycINFO, the search was limited to title or abstract.

The search strategy consisted of combining Boolean operators with the following descriptors: “cybervictimization”, “cybervictimization”, “anxiety”, “self-esteem”, as shown in Table 1.

Table 1.  Databases, Descriptors, Search Formulas and Number of References 

Study Selection

The bibliographic search was made separately by several researchers, and discrepancies were resolved by consensus or by consulting with another researcher. First, abstracts were examined to verify the articles that were relevant to the review, and then the complete text was evaluated to check that the articles met the following criteria: a) cross-sectional studies, b) studies with samples of adolescents aged 12 to 18, c) studies that provided empirical data on the cybervictimization, anxiety, and depression constructs, and d) studies published in English or in Spanish in scientific journals.

The exclusion criteria were: a) longitudinal studies, b) experimental studies, case studies, and controls or controlled trials, systematic reviews and meta-analyses, d) studies about variables other than anxiety and depression in the victims.

Data Extraction and Quality Assessment

The following data were extracted from the articles selected for review: 1) basic study characteristics (authors, year and country), 2) sample characteristics (type of design sample size, age), and 3) correlation between the study variables (cybervictimization, anxiety and depression).

Quality was evaluated separately by two researchers using the STROBE checklist for evaluating the quality of reports on cross-sectional observational studies (Vandenbroucke et al., 2007).

Data Analysis

The meta-analysis was conducted using comprehensive meta-analysis (CMA) (ver. 3.0; Biostat, Englewood, New Jersey, USA) with the correlation coefficient.

To calculate the summary or combined r, and the 95% confidence interval, the test hypothesis was used to judge whether the correlation was statistically significant. In view of the differences in sample size, random effect models were used to calculate the correlation coefficient.

The heterogeneity between studies was evaluated using the Q-statistic (Cochran, 1954) and I2 was used to test the coherence between studies, because it does not depend on the number of articles. An I2 of 25% was interpreted as low inconsistency, 50% as moderate, and 75% as high (Higgins et al., 2003).

A forest plot was used to show the effect size and was interpreted in terms of the probability of superiority of the effect size and the effect incremental index, considering Cohen's (1988) effect size criteria: r ≈ .10 (small effect), r ≈ .30 (moderate effect), r ≈ .50 (large size). Nevertheless, the interpretation of the effect size in line with the Cohen's criteria suppose only a qualitative approach. Then, Cohen's categories were complemented with quantitative operationalizations: the probability of superiority of the effect size (PSES; Gancedo et al., 2021), consisting of the transformation of the effect size to a percentile, and the effect incremental index, an estimation of the effect due to the association between the variables over a trivial effect, .05 (EII; Fandiño et al., 2021). As for the significance of the observed mean correlation, with large samples (> 7,000) even trivial correlations result statistically significant. Hence, statistical significance was complemented with the met of the two following criteria (Arce et al., 2020): the confidence interval has no 0 and the lower limit of the true correlation (95% CI lower limit) should explain more than 1% of the variance (less than 1% is a trivial explanation).

Funnel graphs (Egger & Smith, 1995), Egger's regression intercept, the classic sail-safe N and Duval and Tweedie's trim and fill were used to evaluate bias in the publication. Meta-regression analyses were performed to examine the moderator variables such as mean age, standard deviation, percentage of females, year of publication, and continent.

Results

Search Results and Study Selection

The bibliographic search identified a total of 156 articles. Figure 1 shows the study selection process for the review. First, 44 duplicate studies were eliminated. Then, inclusion and exclusion criteria were set for the review of abstracts and later analysis of complete texts. This left 13 studies that met the selection criteria for the meta-analysis.

Figure 1.  Flow Diagram 

Characteristics of Studies Included

The articles selected were cross-sectional studies published from 2013 to 2020. Table 2 shows the detailed information for the review. The study population was mainly preadolescent and adolescents aged 8 to 19, except three, in which the sample included youth and adults.

Table 2.  Publications Included in the Meta-analysis 

The instruments used to measure cybervictimization were mainly the Cyber Peer Experiences Questionnaire (C-PEQ) (Landoll et al., 2013; Landoll et al., 2015), the Cyber-Bullying/Victimization Experiences Questionnaire (CBVEQ) (Kokkinos et al., 2013), the European Cyberbullying Intervention Project Questionnaire (ECIPQ) (Brighi et al., 2012; Del Rey et al., 2015), and other questionnaires on cyberbullying that evaluate cybervictimization, such as the Cyberbullying Screening of Peer Harassment (Garaigordobil, 2013, 2017), the Cyberbullying and Online Aggression Instrument (COAI; Hinduja & Patchin, 2008). The main instruments used to evaluate anxiety were the Social Anxiety Scale for Adolescents (SAS-A; La Greca & Lopez, 1998) and the Multidimensional Anxiety Scale for Children (March et al., 1997). The State-Trait Anxiety Inventory (STAI; Spielberger, 1983), the Social Interaction Anxiety Scale (SIAS; Mattick & Clarke, 1998) and the 21-item scale that evaluates depression, anxiety, and stress (DASS-21; Lovibond & Lovibond, 1995; Daza et al., 2002). The main instrument for measuring depression was the Center for Epidemiological Studies - Depression Scale (CES-D; Radloff, 1977), although other studies used the Children's Depression Inventory (Kovacs, 1985), the Beck Depression Inventory-II (BDI II; Beck and Steer, 1984), or subscales of other instruments that measure this construct.

Of the 13 studies compiled for their analysis, about 54% were done in the United States, 15.4% in Spain and Greece, and the remaining 15.2% in Romania and Canada.

Correlation between Cybervictimization, Anxiety, and Depression

Figure 2 shows the forest plot of the relationships between cybervictimization and anxiety. A total of 13 studies with a total sample of 7, 348 were included in the analysis. The results of the meta-analysis showed a significant (p < .001, the 95% CI has no 0, and the lower limit of the CI explains 4% of the variance), positive and moderate magnitude (r ≈ .30) mean correlation between cybervictimization and anxiety, r = .31, 95% CI .20, .42]. The observed mean effect is higher than 74.2% (PSES = .742) of all possible effect sizes, implying an increase in the effect of 83.9% (EII = .839) over trivial. The Q-test showed heterogeneity (Q = 309.65, p < .001) with a high level of inconsistency (I2 = 96.12) between studies.

Figure 2.  Forest Plot of the Correlation between Cybervictimization and Anxiety 

The meta-analysis of the 13 studies in the correlation analysis between cybervictimization and depression (Figure 3) revealed a significant (p < .001, the confidence interval has no 0, and the lower limit of the confidence interval explains 3.6% of the variance), positive, and of moderate magnitude (r ≈ .30) mean correlation coefficient of r = .28, 95% CI [.19, .36] for a total sample of 7,348. The observed mean effect is higher than 71.9% (PSES = .710) of all possible effect sizes, implying an increase in the effect of 82.8% (EII = .828) over trivial. In the Q-test, the results showed that there was heterogeneity (Q = 181.593, p < .001) with high inconsistency (I2 = 93.39) between studies.

Figure 3.  Forest Plot of the Correlation between Cybervictimization and Depression. 

Publication Bias

Figure 4 shows the funnel graph, where it may be observed there was no evidence of publication bias in the studies that evaluated the relationship of cybervictimization with anxiety and depression. Neither did the Egger's regression test (t = 0.02, p = .491) reveal any bias in publications. According to the results of the classic fail-safe N test, 8,036 studies would have to be included with a mean effect size of zero to cancel the effect size, demonstrating the total reliability of the effect size. According to the Duval and Tweedie's trim and fill test, both the fixed effects and the random effects models would have to add nine studies on the right-hand side to make the funnel graph symmetric.

Figure 4.  Funnel Graph. 

Analysis of Moderator Variables

Given the heterogeneity of the studies, Table 3 examines mean age, standard deviation of age, year of publication, percentage of females, and the continent where the study was done as moderator variables.

Table 3.  Meta-regression Analysis: Model of Individual Covariates 

In the meta-regression analysis, the test of individual variables showed that in the relationship between cybervictimization and anxiety, the percentage of females (Q = 19.58, df = 4, p < .001) and continent (Qb = 26.70, df = 5, p < .001) were significant moderators. The year of publication was tendential (Q = 7.19, df = 4, p = .0660) and the rest of the moderators were not significant. However, in the relationship with depression, all the moderators were significant: mean age (Q = 9.60, df = 1, p < .01), standard deviation of age (Q = 13.79, df = 2, p < .01), year of publication (Q = 11.68, df = 3, p <.01), percentage of females (Q = 13.08, df = 4, p < .01), and the place where the study was done (Q = 17.20, df = 5, p < .01) (see Table 3).

Table 4 shows the combined impact of all the covariates in the model with the Q statistic, where all the moderators of the sample characteristics were zero. In this case, with a Q = 26.70, df = 5, p = .000, the null hypothesis was rejected and we concluded that at least one of the covariates was related to the effect size. All the moderators were significant except year of publication and continent. This means that for each increase of one unit in mean age, the effect size would increase by .0856 (p = .0523) and other moderators were excluded. Likewise, for each increase in one unit in the percentage of females, the effect size would increase by -.0353 (p = .0219). The proportion of variance explained by this model was R2 = .78, which means that it was able to explain about 78% of the variance in the real effects.

Table 4.  Moderator Variables in the Correlation between Cybervictimization and Anxiety 

Table 5 shows the moderator variables in the correlation between cybervictimization and depression. In this case, the null hypothesis was also rejected and it was concluded that at least one of the covariates was related to the effect size (Q = 17.20, df = 5, p = .004). In this sense, the significant moderators were the standard deviation of age, the percentage of females, and the continent where the study was done. Thus, each increase in one unit of the percentage of females and the standard deviation of age would increase the effect size by -.0273 (p = .097) and -.3961 (p = .029). Similarly, for each increase in the categorical variable continent, the effect size would increase by .5000 (p = .055).

Table 5.  Moderator Variables in the Correlation between Cybervictimization and Depression 

Thus, the proportion of explained variance in this model was R2 = .50, which means that this model was able to explain around 50% of the variance in the real effects.

Discussion

The systematic review and meta-analysis of cross-sectional studies found in a search in three different databases (Web of Science, Scopus, and PsycINFO) provided findings on cybervictimization, which studies to date had only identified as consequences associated with this phenomenon in all environments (Brown et al., 2014). Therefore, the objective this study pursued was to find out the effect of the relation between cybervictimization with anxiety and depression disorders in an adolescent population, since some studies have shown the negative consequences to victims of cyberbullying (Bauman et al., 2013; Brown et al., 2014). Adolescent victims of cyberbullying have a high risk of psychological distress through negative emotions and feelings of guilt (Rey et al., 2020) and, moreover, these situations generate feelings of helplessness and desperation because they cannot intervene (Dong, 2020).

The results of this meta-analysis, showed that adolescent victims of cyberbullying have a greater likelihood of anxiety and depression (Martínez-Monteagudo et al., 2020), as both disorders are predictors of cybervictimization (Marciano et al., 2020). In addition, their stage of development is also a predictor of this type of phenomenon (Audrin & Blaya, 2020; Martínez-Monteagudo et al., 2020).

The relationship to cybervictimization with anxiety had significant (when the confidence interval has no zero, indicating the effect size was significant), positive, and medium magnitude (r ≈ .30), a mean effect size of r = .31 (CI of 95% = .20 to .42), and with depression of r = .28 (CI of 95% = .19 a .36), explaining 9.6% and 7.8% of the variance, respectively. There did not seem to be any impact of publication bias in the studies selected, and the rest of the tests done demonstrated the total reliability of the effect size. These results are in line with other studies which show high levels of anxiety and depression disorders in adolescent victims of cyberbullying (Audrín & Blaya, 2020; Jenaro et al., 2017).

Our results suggest that the moderately strong relationship between cybervictimization and depression and anxiety would benefit from a larger number of more detailed studies of the association between these two disorders and the factors that moderate their relationship with cybervictimization. The results of the meta-regression analysis showed that the mean age and percentage of females are influential covariates in the relationship between cybervictimization and anxiety. In turn, these two moderators, along with the place where the study was done, are influential factors in the association of cybervictimization and the depression disorder. However, more research analyzing the effect of these covariates on the relationship between cybervictimization and these two disorders would still be necessary in view of the few studies analyzed.

As in any study, this meta-analysis also had some limitations that should be taken into account. In the first place, the number of studies selected is not very large, and so it would be a good idea to widen the search to other databases to be able to check the effects and the confidence interval. In the second place, the selection of studies only considered those in English and Spanish, which could be considered a bias in the study selection. Nonetheless, we believe that this did not affect the results, as English is the language most used in scientific literature. In the third place, there was diversity in gender and nationality, but not in age, as the age range of the sample was restricted to adolescents.

Future studies should widen the search to other databases and selection criteria. A comparison by gender could be made, as well as a study of other moderators between cybervictimization and the two disorders, such as gender and educational stage or educational level of the participants. We could also analyze whether this relationship also exists between the rest of the agents involved in cyberbullying, and whether it also occurs at other levels of education, such as primary and university, where the prevalence of cyberbullying is lower.

Conclusions

The results of this study, in spite of the limitations, show a statistically significant relationship between cybervictimization and depression and anxiety disorders. That is, the poor management of use of the new information and communication technologies may lead to psychological and social maladjustment of individuals with negative repercussions on their development.

Given the relationship of this phenomenon with both disorders, the importance of creating and implementing prevention and intervention programs is evident. Such programs should take into consideration the attitudes and behaviors acting as risk factors of cybervictimization, which can lead to psychological, behavioral, and educational problems, as well as protective factors that could help palliate such adverse situations.

Therefore, the findings show a series of practical implications for health and education that must be considered in the study and design of future interventions. Throughout this study, the relationship between anxiety and depression of adolescent victims of cyberbullying has been demonstrated. This could be behind the significant increase in mental health problems, and therefore, intervention in both those aspects would have a positive impact on adolescent wellbeing.

Cite this article as: Molero, M. M., Martos, A., Barragán, A. B., Pérez-Fuentes, M. C., & Gázquez., J. J. (2022). Anxiety and depression from cybervictimization in adolescents: A metaanalysis and meta-regression study. The European Journal of Psychology Applied to Legal Context, 14(1), 42-50. https://doi.org/10.5093/ejpalc2022a5

References

Alonso, C., & Romero, E. (2017). Aggressors and victims in bullying and cyberbullying: A study of personality profiles using the five-factor model. The Spanish Journal of Psychology, 20, e76. https://doi.org/10.1017/sip.2007.73 [ Links ]

Arce, R., Arias, E., Novo, M., & Fariña, F. (2020). Are interventions with batterers effective? A meta-analytical review. Psychosocial Intervention, 29(3), 153-164. https://doi.org/10.5093/pi2020a11 [ Links ]

Audrin, C., & Blaya, C. (2020). Psychological well-being in a connected world: The impact of cybervictimization in children's and young people's life in France. Frontiers in Psychology, 11, 1427. https://doi.org/10.3389/fpsyg.2020.01427 [ Links ]

Barragán, A. B., Molero, M. M., Pérez-Fuentes, M. C., Simón, M. M., Martos, Á., Sisto, M., & Gázquez, J. J. (2021). Study of cyberbullying among adolescents in recent years: A Bibliometric analysis. International Journal of Environmental Research and Public Health, 18(6), 3016. https://doi.org/10.3390/ijerph18063016 [ Links ]

Bauman, S., Toomey, R. B., & Walker, J. L. (2013). Associations among bullying, cyberbullying, and suicide in high school students. Journal of Adolescence, 36(2), 341-350. https://doi.org/10.1016/j.adolescence.2012.12.001 [ Links ]

Beck, A. T., & Steer, R. A. (1984). Internal consistencies of the original and revised Beck Depression Inventory. Journal of Clinical Psychology, 40(6), 1365-1367. https://doi.org/10.1002/1097-4679(198411)40:6<1365::AID-JCLP2270400615>3.0.CO;2-D [ Links ]

Bjärehed, M., Thornberg, R., Wänström, L., & Gini, G. (2019). Individual moral disengagement and bullying among Swedish fifth graders: The role of collective moral disengagement and pro-bullying behavior within classrooms. Journal of Interpersonal Violence, 36(17-18), NP9576-NP9600. https://doi.org/10.1177/0886260519860889 [ Links ]

Brighi, A., Guarini, A., Melotti, G., Galli, S., & Genta, M. L. (2012). Predictors of victimization across direct bullying, indirect bullying and cyberbullying. Emotional and Behavioural Difficulties, 17(3-4), 375-388. https://doi.org/10.1080/13632752.2012.704684 [ Links ]

Bronfenbrenner, U. (1992). Ecological systems theory. Jessica Kingsley. [ Links ]

Brown, C. F., Demaray, M. K., & Secord, S. M. (2014). Cyber victimization in middle school and relations to social emotional outcomes. Computers in Human Behavior, 35(6), 12-21. https://doi.org/10.1016/j.chb.2014.02.014 [ Links ]

Buelga, S., Postigo, J., Martínez-Ferrer, B., Cava, M. J., & Ortega-Barón, J. (2020). Cyberbullying among adolescents: Psychometric properties of the CYB-AGS Cyber-Aggressor Scale. International Journal of Environmental Research and Public Health, 17(9), 3090-2020. https://doi.org/10.3390/ijerph17093090 [ Links ]

Cañas, E., Estévez, E., Marzo, J. C., & Piqueras, J. A. (2019). Psychological adjustment in cybervictims and cyberbullies in secondary education. Anales de Psicología/Annals of Psychology, 35(3), 434-443. https://doi.org/10.6018/analesps.35.3.323151 [ Links ]

Carvalho, M., Branquinho, C., & de Matos, M. G. (2021). Cyberbullying and bullying: Impact on psychological symptoms and well-being. Child Indicators Research, 14(1), 435-452. https://doi.org/10.1007/s12187-020-09756-2 [ Links ]

Cochran, W. G. (1954). The combination of estimates from different experiments. Biometrics, 10(1), 101-129. https://doi.org/10.2307/3001666 [ Links ]

Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences. Routledge. https://doi.org/10.4324/9780203771587 [ Links ]

Daza, D.M., Novy, M.A., & Stanley, P. Averill (2002). The depression anxiety stress scale-21: Spanish translation and validation with a Hispanic sample. Journal of Psychopathology and Behavioral Assessment, 24, 195-205. https://doi.org/10.1023/A:1016014818163 [ Links ]

Del Rey, R., Casas, J. A., Ortega-Ruiz, R., Schultze-Krumbholz, A., Scheithauer, H., Smith, P., Thompson, F., Barkoukis, V., Tsorbatzoudis, H., Brighi, A., Guarini, A., Pyżalski, J., & Plichta, P. (2015). Structural validation and cross-cultural robustness of the European Cyberbullying Intervention Project Questionnaire. Computers in Human Behavior, 50, 141-147. https://doi.org/10.1016/j.chb.2015.03.065 [ Links ]

Dennehy, R., Meaney, S., Walsh, K. A., Sinnott, C., Cronin, M., & Arensman, E. (2020). Young people's conceptualizations of the nature of cyberbullying: A systematic review and synthesis of qualitative research. Aggression and Violent Behavior, 51, 101379. https://doi.org/10.1016/j.avb.2020.101379 [ Links ]

Dong, Y. (2020). The effect of traditional bullying-victimization on behaviour cyberbullying among college students: Based on the structural equation mode. International Journal of Social Psychology, 35(1), 175-199. https://doi.org/10.1080/02134748.2019.1687969 [ Links ]

Doumas, D. M., & Midgett, A. (2020). Witnessing cyberbullying and internalizing symptoms among middle school students. European Journal Investigation in Health, Psychology and Education, 10(4), 957-966. https://doi.org/10.3390/ejihpe10040068 [ Links ]

Egger, M., & Smith, G.D. (1995). Misleading meta-analysis. BMJ, 311(7007), 753-754. https://doi.org/10.1136/bmj.311.7007.753c [ Links ]

Fandiño, R., Basanta, J., Sanmarco, J., Arce, R., & Fariña, F. (2021). Evaluation of the executive functioning and psychological adjustment of child to parent offenders: Epidemiology and quantification of harm. Frontiers in Psychology, 12, 616855. https://doi.org/10.3389/2Ffpsyg.2021.616855 [ Links ]

Feijóo, S., Foody, M., O´Higgins, J., Pichel, R., & Rial, A. (2021). Cyberbullies, the cyberbullied, and problematic internet use: Some reasonable similarities. Psicothema, 33(2), 198-205. https://doi.org/10.7334/psicothema2020.209 [ Links ]

Fernández-Artamendi, S., Martínez-Loredo, V., & López-Núñez, C. (2021). Sex differences in comorbidity between substance use and mental health in adolescents: Two sides of the same coin. Psicothema, 33(1), 36-43. https://doi.org/10.7334/psicothema2020.297 [ Links ]

Field, T. (2018). Cyberbullying: A narrative review. Journal of Addiction Therapy and Research, 2, 10-27. https://doi.org/10.29328/journal.jatr.1001007 [ Links ]

Fisher, B. W., Gardella, J. H., & Teurbe-Tolon, A. (2016). Peer cybervictimization among adolescents and the associated internalizing and externalizing problems: A meta-analysis. Journal of Youth and Adolescence, 45(9), 1727-1743. https://doi.org/10.1007/s10964-016-0541-z [ Links ]

Gancedo, Y., Fariña, F., Seijo, D., Vilariño, M., & Arce, R. (2021). Reality monitoring: A meta-analytical review for forensic practice. European Journal of Psychology Applied to Legal Context, 13(2), 99-110. https://doi.org/10.5093/ejpalc2021a10 [ Links ]

Garaigordobil, M. (2011). Prevalencia y consecuencias del cyberbullying: una revisión. International Journal of Psychology and Psychological Therapy, 11(2), 233-254. https://www.ijpsy.com/volumen11/num2/295.htmlLinks ]

Garaigordobil, M. (2013). Cyberbullying. Screening de acoso entre iguales [Cyberbullying. Screening of peer harassment]. TEA. [ Links ]

Garaigordobil, M. (2015). Cyberbullying in adolescents and youth in the Basque Country: Prevalence of cybervictims, cyberaggressors, and cyberobservers, Journal of Youth Studies, 18(5), 569-582. https://doi.org/10.1080/13676261.2014.992324 [ Links ]

Garaigordobil, M. (2017). Psychometric properties of the Cyberbullying Test, a screening instrument to measure cybervictimization, cyberaggression, and cyberobservation. Journal of Interpersonal Violence, 32(23), 3556-3576. https://doi.org/10.1177/0886260515600165 [ Links ]

Gardella, J. H., Fisher, B. W., & Teurbe-Tolon, A. R. (2017). A systematic review and meta-analysis of cyber-victimization and educational outcomes for adolescents. Review of Educational Research, 87(2), 283-308. https://doi.org/10.3102/0034654316689136 [ Links ]

González-Cabrera, J., Tourón, J., Machimbarrena, J. M., Gutiérrez-Ortega, M., Álvarez-Bardón, A., & Garaigordobil, M. (2019). Cyberbullying in gifted students: Prevalence and psychological well-being in a Spanish simple. International Journal of Environmental Research and Public Health, 16(12), 2173. https://doi.org/10.3390/ijerph16122173 [ Links ]

González-Calatayud, V., & Prendes, M. P. (2021). Role-based cyberbullying situations: Cybervictims, cyberaggressors and cyberbystanders. International Journal of Environmental Research and Public Health, 18(16), 8669. https://doi.org/10.3390/ijerph18168669 [ Links ]

Grigore, A., & Maftei, A. (2020). Exploring the mediating roles of state and trait anxiety on the relationship between middle adolescents’ cyberbullying and depression. Children, 7(11), 240. https://doi.org/10.3390/children7110240 [ Links ]

Guerra, J., Yuste, R., López, V., & Mendo, S. (2021). The modelling effect of emotional competence on cyberbullying profiles. Anales de Psicología/Annals of Psychology, 37(2), 202-209. https://doi.org/10.6018/analesps.338071 [ Links ]

Herge, W. M., La Greca, A. M., & Chan, S. F. (2016). Adolescent peer victimization and physical health problems. Journal of Pediatric Psychology, 41(1), 15-27. https://doi.org/10.1093/jpepsy/jsv050 [ Links ]

Higgins, J. P., Thompson, S. G., Dekks, J. J., & Altman, D. G. (2003). Measuring inconsistency in meta-analyses. BMJ, 327(7414), 557-560. https://doi.org/10.1136/bmj.327.7414.557 [ Links ]

Hinduja, S., & Patchin, J. W. (2008). Cyberbullying: An exploratory analysis of factors related to offending and victimization. Deviant Behavior, 29(2), 129-156. https://doi.org/10.1080/01639620701457816 [ Links ]

Holfeld, B., Stoesz, B., & Montgomery, J. (2019). Traditional and cyber bullying and victimization among youth with autism spectrum disorder: An investigation of the frequency, characteristics, and psychosocial correlates. Journal on Developmental Disabilities, 24(2), 61-76. https://www.proquest.com/scholarly-journals/traditional-cyber-bullying-victimization-among/docview/2356778150/se-2?accountid=14477Links ]

Jenaro, C., Flores, N., & Frías, P. (2017). Anxiety and depression in cyberbullied college students: A retrospective study. Journal of Interpersonal Violence, 36(1-2), 579-602. https://doi.org/10.1177/0886260517730030 [ Links ]

Kokkinos, C. M., & Antoniadou, N. (2019). Cyber-bullying and cyber-victimization among undergraduate student teachers through the lens of the General Aggression Model. Computers in Human Behavior, 98, 59-68. https://doi.org/10.1016/j.chb.2019.04.007 [ Links ]

Kokkinos, C. M, Antoniadou, N., Dalara, E., Koufogazou, A., & Papatziki, A. (2013). Cyberbullying, personality, and coping among pre-adolescents. International Journal of Cyber Behavior, Psychology and Learning, 3(4), 55-69. https://doi.org/10.4018/ijcbpl.2013100104 [ Links ]

Kokkinos, C. M., Antoniadou, N., & Markos, A. (2014). Cyber-bullying: An investigation of the psychological profile of university student participants. Journal of Applied Developmental Psychology, 35(3), 204-214. https://doi.org/10.1016/j.appdev.2014.04.001 [ Links ]

Kovacs, M. (1985). The Children's Depression Inventory. Psychopharmacology Bulletin, 21(4), 995-998. https://pubmed.ncbi.nlm.nih.gov/4089116/Links ]

Kowalski, R. M., Giumetti, G. W., Schroeder, A. N., & Lattanner, M. R. (2014). Bullying in the digital age: A critical review and meta-analysis of cyberbullying research among youth. Psychological Bulletin, 140(4), 1073-1137. https://doi.org/10.1037/a0035618 [ Links ]

Kowalski, R. M., & Limber, S. P. (2007). Electronic bullying among middle school students. Journal of Adolescent Health, 41(6), 22-30. https://doi.org/10.1016/j.jadohealth.2007.08.017 [ Links ]

La Greca, A. M., & Lopez, N. (1998). Social anxiety among adolescents: Linkages with peer relations and friendships. Journal of Abnormal Child Psychology, 26, 83-94. http://doi.org/10.1023/a:1022684520514 [ Links ]

Landoll, R. R., La Greca, A. M., & Lai, B. S. (2013). Aversive peer experiences on social networking sites: Development of the Social Networking-Peer Experiences Questionnaire (SN-PEQ). Journal for Research on Adolescence, 23(4), 695-705. http://doi.org/10.1111/jora.12022 [ Links ]

Landoll, R. R., La Greca, A. M., Lai, B. S., Chan, S. F., & Herge, W. M. (2015). Cyber victimization: Prospective associations with adolescent social anxiety and depressive symptoms. Journal of Adolescence, 42, 77-86. https://doi.org/10.1016/j.adolescence.2015.04.002 [ Links ]

Lee, C., & Shin, N. (2017). Prevalence of cyberbullying and predictors of cyberbullying perpetration among Korean adolescents. Computers in Human Behavior, 68, 352-358. https://doi.org/10.1016/j.chb.2016.11.047 [ Links ]

Livazovic, G., & Ham, E. (2019). Cyberbullying and emotional distress in adolescents: The importance of family, peers and school. Heliyon, 5(6), e01992. https://doi.org/10.1016/j.heliyon.2019.e01992 [ Links ]

Lovibond, S. H., & Lovibond, P. F. (1995). Manual for the depression anxiety & stress scales (2nd ed.). Psychology Foundation. [ Links ]

March, J. S., Parker, J. D., Sullivan, K., Stallings, P., & Conners, C. K. (1997). The Multidimensional Anxiety Scale for Children (MASC): Factor structure, reliability, and validity. Journal of American Academy of Child and Adolescent Psychiatry, 36(4), 554-565. https://doi.org/10.1097/00004583-199704000-00019 [ Links ]

Marciano, L., Schulz, P. J., & Camerini, A. L. (2020). Cyberbullying perpetration and victimization in youth: A meta-analysis of longitudinal studies. Journal of Computer-Mediated Communication, 25(2), 163-181. https://doi.org/10.1093/jcmc/zmz031 [ Links ]

Martínez-Monteagudo, M. C., Delgado, B., Díaz-Herrero, A., & García-Fernández, J. M. (2020). Relationship between suicidal thinking, anxiety, depression and stress in university students who are victims of cyberbullying. Psychiatry Research, 286, 112856. https://doi.org/10.1016/j.psychres.2020.112856 [ Links ]

Martínez-Monteagudo, M. C., Delgado, B., García-Fernández, M., & Ruiz-Esteban, C. (2020). Cyberbullying in the university setting. Relationship with emotional problems and adaptation to the university. Frontiers in Psychology, 10, 3074. https://doi.org/10.3389/fpsyg.2019.03074 [ Links ]

Mattick, R. P., & Clarke, C. (1998). Development and validation of measures of social phobia scrutiny fear and social interaction anxiety. Behaviour Research and Therapy, 36(4), 455-470. https://doi.org/10.1016/s0005-7967(97)10031-6 [ Links ]

Menin, D., Guarini, A., Mameli, C., Skrzypiec, G., & Brighi, A. (2021). Was that (cyber)bullying? Investigating the operational definitions of bullying and cyberbullying from adolescents’ perspective. International Journal of Clinical and Health Psychology, 21(2), 100221. https://doi.org/10.1016/j.ijchp.2021.100221 [ Links ]

Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., Stewart, L. A., & PRISMA Group (2015). Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Systematic Reviews, 4, 1-9. https://doi.org/10.1186/2046-4053-4-1 [ Links ]

Nasaescu, E., Zych, I., Ortega-Ruiz, R., Farrington, D. P., & Llorent, V. J. (2020). Longitudinal patterns of antisocial behaviors in early adolescence: A latent class and latent transition analysis. European Journal of Psychology Applied to Legal Context, 12(2), 85-92. https://doi.org/10.5093/ejpalc2020a10 [ Links ]

Ng, C. S. M. (2019). Effects of workplace bullying on Chinese children's health, behaviours and school adjustment via parenting: study protocol for a longitudinal study. BMC Public Health, 19, e129. https://doi.org/10.1186/s12889-019-6458-1 [ Links ]

Nixon, C. L. (2014). Current perspectives: The impact of cyberbullying on adolescent health. Adolescent Health, Medicine and Therapeutics, 5, 143-158. https://doi.org/10.2147/AHMT.S36456 [ Links ]

Ortega-Barón, J., Buelga-Vazquez, S., & Cava-Caballero, M. J. (2016). Influencia del clima escolar y familiar en adolescentes, víctimas de ciberacoso. Comunicar, 24(46), 57-65. https://doi.org/10.3916/C46-2016-06 [ Links ]

Pérez-Fuentes, M. C., Gázquez, J. J., Molero, M. M., Martos, Á., Barragán, A. B., & Simón, M. M. (2021). Student burnout and engagement: Relationship with adolescent use of alcohol and attitudes towards authority. International Journal of Clinical and Health Psychology, 21(2), 100225. https://doi.org/10.1016/j.ijchp.2021.100225 [ Links ]

Pérez-Fuentes, M. C., Molero, M. M., Gázquez, J. J., Simón, M. M., Martos, Á., Barragán, A. B., & Mercader, I. (2020). Análisis de las redes sociales en el consumo de alcohol. European Journal of Education and Psychology, 13(2), 143-159. https://doi.org/10.30552/ejep.v13i2.357 [ Links ]

Quintana-Orts, C., Mérida-López, S., Rey, L., & Extremera, N. (2021). A closer look at the emotional intelligence construct: How do emotional intelligence facets relate to life satisfaction in students involved in bullying and cyberbullying? European Journal Investigation in Health, Psychology and Education, 11(3), 711-725. https://doi.org/10.3390/ejihpe11030051 [ Links ]

Radloff, L. S. (1977). The CES-D Scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 1(3), 385-401. http://doi.org/10.1177/014662167700100306 [ Links ]

Rey, L., Neto, F., & Extremera, N. (2020). Cyberbullying victimization and somatic complaints: A prospective examination of cognitive emotion regulation strategies as mediators. International Journal of Clinical and Health Psychology, 20(2), 135-139. https://doi.org/10.1016/j.ijchp.2020.03.003 [ Links ]

Rodríguez-Álvarez, J. M., Yubero, S., Navarro, R., & Larrañaga, E. (2021). Relationship between socio-emotional competencies and the overlap of bullying and cyberbullying behaviors in primary school students. European Journal Investigation in Health, Psychology and Education, 11(3), 686-696. https://doi.org/10.3390/ejihpe11030049 [ Links ]

Rodríguez-Domínguez, C., Pérez-Moreno, P. J., & Durán, M. (2020). Cyber dating violence: A review of its research methodology. Anales de Psicología/Annals of Psychology, 36(2), 200-209. https://doi.org/10.6018/analesps.370451 [ Links ]

Rodríguez-Fernández, A., Antonio-Agirre, I., Ramos-Díaz, E., & Revuelta-Revuelta, E. (2020). The role of affect-communication and rule setting in perceived family support and school adjustment. European Journal of Education and Psychology, 13(1), 5-18. https://doi.org/10.30552/ejep.v13i1.288 [ Links ]

Ruiz-Hernández, J. A., Pina, D., Puente-López, E., Luna-Maldonado, A., & Llor-Esteban, B. (2020). Attitudes towards School Violence Questionnaire, revised version: CAHV-28. European Journal of Psychology Applied to Legal Context, 12(2), 61-68. https://doi.org/10.5093/ejpalc2020a8 [ Links ]

Spielberger, C. D., Gorsuch, R. L., Lushene, R., Vagg, P. R., & Jacobs, G. A. (1983). Manual for the State-Trait Anxiety Inventory. Consulting Psychologists Press. [ Links ]

Vandenbroucke, J. P., Von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., & STROBE Initiative (2007). Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and elaboration. PLos Medicine, 4, e297. https://doi.org/10.1371/journal.pmed.0040297 [ Links ]

Varghese, M. E., & Pistole, M. C. (2017). College student cyberbullying: Self-esteem, depression, loneliness, and attachment. Journal of College Counseling, 20(1), 7-21. https://doi.org/10.1002/jocc.12055 [ Links ]

Viejo, C., Leva, B., Paredes, J., & Ortega-Ruiz, R. (2020). Bullying and psychological dating violence: The relation between two aggressive peer-behaviours. Psicothema, 32(4), 533-540. https://doi.org/10.7334/psicothema2019.223 [ Links ]

Wigderson, S., & Lynch, M. (2013). Cyber- and traditional peer victimization: Unique relationships with adolescent well-being. Psychology of Violence, 3(4), 297-309. https://doi.org/10.1037/a0033657 [ Links ]

Williford, A., Orsi, R., Depaolis, K. J., & Isen, D. (2018). Cyber and traditional peer victimization: Examining unique associations with children's internalizing difficulties. Children and Youth Services Review, 93, 51-59. https://doi.org/10.1016/j.childyouth.2018.07.001 [ Links ]

Wright, M. F. (2015). Cyber victimization and adjustment difficulties: The mediation of Chinese and American adolescents’ digital technology usage. Cyberpsychology: Journal of Psychosocial Research on Cyberspace, 9(1), e7. https://doi.org/10.5817/CP2015-1-7 [ Links ]

Wright, M. F. (2017). Parental mediation, cyber victimization, adjustment difficulties, and adolescents with autism spectrum disorder. Cyberpsychology: Journal of Psychosocial Research on Cyberspace, 11(1), E6. https://doi.org/10.5817/CP2017-1-6 [ Links ]

Wright, M. F., Harper, B. D., & Wachs, S. (2019). The associations between cyberbullying and callous-unemotional traits among adolescents: The moderating effect of online disinhibition. Personality and Individual Differences, 140, 41-45. https://doi.org/10.1016/j.paid.2018.04.001 [ Links ]

Received: November 24, 2021; Accepted: December 23, 2021

Correspondence: abm410@ual.es (A. B. Barragán Martín)

Conflict of Interest

The authors of this article declare no conflict of interest.

Creative Commons License This is an Open Access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.