SciELO - Scientific Electronic Library Online

 
vol.25 número1Comprensiones sobre el perdón y la reconciliación en el contexto del conflicto armado colombianoAdaptación al castellano de la Escala de Comportamiento Participativo (PBS) índice de autoresíndice de materiabúsqueda de artículos
Home Pagelista alfabética de revistas  

Servicios Personalizados

Revista

Articulo

Indicadores

Links relacionados

  • En proceso de indezaciónCitado por Google
  • No hay articulos similaresSimilares en SciELO
  • En proceso de indezaciónSimilares en Google

Compartir


Psychosocial Intervention

versión On-line ISSN 2173-4712versión impresa ISSN 1132-0559

Psychosocial Intervention vol.25 no.1 Madrid abr. 2016

https://dx.doi.org/10.1016/j.psi.2015.10.003 

 

 

Universal violence and child maltreatment prevention programs for parents: A systematic review

Programas de Educación Parental de Prevención Universal de la Violencia y el Maltrato: Una Revisión Sistemática

 

 

Elisa Rachel Pisani Altafim y Maria Beatriz Martins Linhares

University of São Paulo, Ribeirão Preto Medical School, Department of Neurosciences and Behavior, Brazil

The Foundation for Support of Research in the State of São Paulo, Brazil (FAPESP; grant #2012/25293-8) for ERP Altafim and the National Council of Science and Technology Development (CNPq) for MBM Linhares.

Correspondence

 

 


ABSTRACT

The present study aimed to review recent literature on universal violence and child maltreatment prevention programs for parents. The following databases were used: Web of Science, PsycINFO, PsycARTICLES, PubMed, LILACS, and SciELO. The keywords included the following: (Parenting Program or Parent Training or Parent Intervention) and (Maltreatment or Violence or Violence Prevention). For inclusion in this review, the programs had to be structured, working in groups of parents aiming to improve parenting practices. Twenty-three studies were included, and 16 different types of parenting programs were identified. Ninety-one percent of the studies were conducted in developed countries. All the programs focused on the prevention of violence and maltreatment by promoting positive parenting practices. Only seven studies were randomized controlled trials. All studies that evaluated parenting strategies (n = 18), reported after the interventions. The programs also effectively improved child behavior in 90% of the studies that assessed this outcome. In conclusion, parenting educational programs appear to be an important strategy for the universal prevention of violence and maltreatment against children. Future studies should assess the applicability and effectiveness of parenting programs for the prevention of violence against children in developing countries. Further randomized control trials are also required.

Key words: Parent education. Parenting programs. Violence prevention. Child maltreatment. Systematic review.


RESUMEN

El presente artículo pretende revisar la literatura actualizada acerca de los programas universales de educación parental de prevención de la violencia y el maltrato contra los niños. Las bases de datos utilizadas fueron Web of Science, PsycINFO, PsycARTICLES, PubMed, LILACS y SciELO, con las palabras clave: parenting program or parent training or parent intervention and maltreatment or violence or violence prevention. Los programas eran estructurados, trabajando en grupos de padres para mejorar las prácticas educativas. Se incluyeron 23 estudios. La mayoría se llevó a cabo en los países desarrollados (91%). Se identificaron 16 diferentes programas de promoción de las prácticas educativas para prevenir la violencia y el maltrato infantil. Sólo siete estudios eran ensayos controlados aleatorios. Todos los estudios que evaluaron las prácticas educativas demostraron una mejoría después de la intervención (n = 18). Los programas demostraron una mejora en el comportamiento de los niños en el 90% de los estudios que evaluaron este resultado. En conclusión, los programas educativos para padres demostraron ser una estrategia importante para la prevención universal de la violencia y el maltrato infantil. Se enfatiza la importancia de la implementación y evaluación de programas de educación parental en los países en desarrollo y más ensayos controlados aleatorios.

Palabras clave: Educación parental. Programas de educación de padres. Prevención de la violencia. Maltrato infantil. Revisión sistemática.


 

Violence threatens adaptive child development and can lead to mental and physical health problems, representing a high cost to society (Christian & Schwarz, 2011). Child maltreatment refers to the physical and emotional mistreatment, sexual abuse, neglect, and negligent treatment of children and their commercial or other exploitation (Butchart, Harvey, Mian, & Furniss, 2006). Violence against children is a substantial problem in both developed countries that have high-income economies and developing countries that have low- to middle-income economies, according to the classification of the World Bank (2015).

Children are negatively affected by experiences of maltreatment, abuse, and neglect (Cicchetti & Blender, 2006). These violent experiences during childhood have significant negative consequences on children's self-regulatory development (McCoy, 2013) and later mental health disorders (Jonson-Reid, Kohl, & Drake, 2012). Early negative experiences can impact genetic predisposition, brain architecture, and health in the long-term (Shonkoff & Garner, 2012).

Violence against children by adults within the family is one of the least visible forms of child maltreatment, but it is nonetheless widely prevalent in all societies (Butchart et al., 2006). In 2011, 80.8% of children were victims of maltreatment by parents (Centers for Disease Control and Prevention, 2013). Compared with other health problems, the economic burden of child maltreatment is substantial, indicating the relevance of prevention efforts to address the high prevalence of this problem (Fang, Brown, Florence, & Mercy, 2012). However, there are particular difficulties when designing strategies for prevention in the family context because the perpetrators of maltreatment are also the source of nurturing for children (Butchart et al., 2006).

Intervention programs for children and families should begin as early as possible to reduce or avoid the need of most costly and less effective remediation programs (Arruabarrena & De Paúl, 2012). Interventions can be classified as the following: universal (which addresses the general public or an entire population group that has not been identified on the basis of individual risk), selective (which is directed toward at-risk groups or individuals), and indicated (which targets individuals with biological markers, early symptoms, or problematic behaviors that predict a high level of risk; O'Connell, Boat, & Warner, 2009). Considering the difficulty in identifying child maltreatment within families, universal prevention programs can provide a great opportunity to prevent violence and maltreatment because they could be available to community-based populations. Additionally, undertaking universal prevention efforts that address all families avoids the risk of stigmatization (Byrne, Rodrigo, & Maiquez, 2014; Heinrichs, Kliem, & Hahlweg, 2014).

The main strategies to prevent child maltreatment include parenting programs that promote safe, stable, and nurturing relationships between caregivers and children at early ages (Centers for Disease Control and Prevention, 2014; World Health Organization, 2009). These prevention strategies provide experiences and opportunities to parents so they can learn to develop effective parenting practices (Trivette & Dunst, 2009). Parenting educational programs can effectively prevent child maltreatment, abuse, and neglect by increasing parents' knowledge of child development, improving parents' child-rearing skills, and encouraging positive child management strategies (Mikton & Butchhart, 2009). The goals of a large portion of these programs do not focus specifically on violent behavior; they are instead designed to encourage healthy relationships and increase parental skills (World Health Organization, 2009). Therefore, in many evaluation studies, risk factors for child maltreatment (e.g., measures of child abuse potential, parental stress, or changes in parental attitudes toward disciplinary behavior) are used to assess the programs rather than direct measures (e.g., reports of child protective services; World Health Organization, 2009).

Previous reviews on parenting programs reported significant findings that are related to the effectiveness of these programs across parental and child outcomes, such as changing parenting behavior and preventing child behavior problems (Kaminski, Valle, Filene, & Boyle, 2008; Rios & Williams, 2008), modifying disruptive child behavior (Lundahl, Risser, & Lovejoy, 2006), improving emotional and behavioral adjustment of children under three years of age (Barlow, Smailagic, Ferriter, Bennett, & Jones, 2010), and increasing parents' psychosocial wellbeing in the short-term (Barlow, Smailagic, Huband, Roloff, & Bennett, 2012). However, these programs cited above did not specifically focus on the prevention of violence and maltreatment.

Some reviews have focused specifically on violence and maltreatment prevention interventions, including parenting programs and other types of interventions (Holzer, Higgins, Bromfield, & Higgins, 2006; MacMillan et al., 2009). Nonetheless, these reviews did not follow a formal systematic review process that utilizes an explicit and auditable protocol, including the mechanisms that were used to search, select, and retrieve reports (Sandelowski, 2008). Most recently, MacMillan et al. (2009) included articles up to only 2008; therefore, an updated systematic review on the relevant literature is needed. Notably, there is one relatively recent systematic review on the effectiveness of universal and selective child maltreatment prevention programs, but it was a review of review studies that were published up to July 2008, and it also did not focus exclusively on parental education programs (Mikton & Butchhart, 2009). Two other reviews focused on parenting programs but specifically focused on low- and middle-income economies (Knerr, Gardner, & Cluver, 2013; Mejia, Calam, & Sanders, 2012).

Therefore, there are still gaps in the literature with regard to recent systematic reviews that focus on parenting intervention programs that are related to the universal prevention of violence and maltreatment. The present systematic review seeks to add to previous reviews on child maltreatment prevention, with a specific focus on universal prevention interventions through parenting educational programs in both developed and developing countries. The overall aim of this study was to critically examine recent empirical studies on universal violence and child maltreatment prevention programs for parents that were published between 2008 and 2014. The questions that guided this review were the following: (i) What is the geographical distribution of the studies? (ii) Which parenting educational programs have been conducted for the universal prevention of violence and maltreatment with parents or other caregivers of children? (iii) What are the experimental designs and methodologies used to assess the efficacy/effectiveness of these programs? (iv) What are the main findings after implementation of these parenting educational programs?

 

Methods

A systematic review of universal violence and child maltreatment prevention programs for parents was conducted based on principles of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA; Moher, Liberati, Tetzlaff, & Altman, 2009). The review was conducted by searching the following databases: Web of Science, PsycINFO, PsycARTICLES, PubMed, LILACS, and SciELO. The keywords that were used in the searches included the following: (Parenting Program or Parent Training or Parent Intervention) and (Maltreatment or Violence or Violence Prevention).

The filters that were used to refine the search results were the following: Web of Science (document type = article, timespan = 2008-2014), PsycINFO and PsycARTICLES (document type = journal article, year = 2008-2014), PubMed (publication date = 2008-2014, species = humans, article type = clinical trial). All of the references and abstracts were included in an EndNote program for analysis.

Different types of parenting programs exist, along with a range of definitions. Therefore, the present review used the same definition of parenting educational programs that was used in another prior review (Kane, Wood, & Barlow, 2007), namely "interventions that utilize a structured format, working with parents in groups aimed at improving parenting practices and family functioning." A "structured format" refers to programs that included a manual for implementation of the program, which explicitly explains what users need to provide in the program sessions. The structured format enhances the chances that the program will be adequately replicated in the future.

The inclusion criteria for the studies were the following: (i) empirical studies, (ii) universal prevention, including general populations, (iii) parenting educational programs for violence and maltreatment prevention, which directly or indirectly prevent violence and maltreatment through effective parenting practices, (iv) face-to-face programs, (v) parenting programs for parents of children, (vi) studies published from January 2008 to December 2014, and (vii) studies that were written in English, Portuguese, or Spanish.

Importantly, the inclusion criteria did not limit the studies according to their research design. A previous review by Mikton and Butchhart (2009) showed that many studies in this area did not use rigorous methodologies. Therefore, this could have excluded many studies in the present review. However, the present analysis considered whether the study was a randomized controlled trial (RCT), which is a rigorous empirical design that evaluates treatment efficacy (APA Presidential Task Force on Evidence-Based Practice, 2006). In contrast, non-randomized trials analyze the effectiveness of a program under conditions that are likely to occur in the real world, with less control of confounding variables compared with RCTs (O'Connell et al., 2009).

The exclusion criteria were the following: reviews, meta-analyses, editorials, letters, case studies, empirical studies that did not address universal prevention, intervention programs of identified cases (e.g., children and adults who were exposed to family violence, mothers with a history of multiple forms of abuse, parents who received treatment for the use of substances like alcohol and drugs, and studies that had as an inclusion criterion risk assessment), intervention programs for specific populations (e.g., parents of adopted children, fathers who were not living together with their sons, and children with attention-deficit/hyperactivity disorder), parenting programs that were specific to parents of adolescents, empirical studies of parenting educational programs that used only books, videos, multimedia, or the Internet (i.e., were not face-to-face), and home-visitation programs.

The initial searches yielded 1202 articles in the databases using the keywords above. First, duplicate articles that were indexed in more than one database were excluded (n = 284). Second, the inclusion and exclusion criteria were applied to the remaining 918 abstracts, which excluded 658 articles. Third, the full text of the remaining 50 empirical studies on interventions for parents of children were read. After reading these articles, 27 were excluded for the following reasons: (i) intervention programs that addressed risk or specific samples, (ii) parenting educational programs with no face-to-face interactions with the facilitators of the groups, (iii) non-structured interventions, and (iv) home-visiting programs. The final sample included 23 articles.

The flowchart of the entire article selection process is presented in Fig. 1.

 



Fig. 1 - Flowchart of the search.

 

Results

Parenting educational programs to prevent violence and maltreatment

Geographical distribution of the studies

Twenty-one studies (91%) were conducted in developed countries. Most of these studies were performed in the United States (n = 12; 52%), and the others (n = 9; 39%) were performed in seven countries, including two in Japan, two in Spain, and one each in Australia, Portugal, Switzerland, Germany, and Canada. Only two studies (9%) were conducted in low- to middle-income countries. One study was conducted in Iran, and the other analyzed the results from nine countries, including Panama, Honduras, Guatemala, Serbia, Kazakhstan, Kyrgyzstan, Turkmenistan, Tajikistan, and Uzbekistan.

Types of parenting educational programs

The 23 studies reported 16 different types of parenting educational programs to prevent violence and maltreatment against children that were developed using group-based interventions (Table 1). The programs focused on the prevention of violence and maltreatment by promoting positive parenting practices and skills.

 

Table 1 - Parenting educational programs to prevent child violence and maltreatment:
types and aims of the programs.


a Source of information from the references.
b Source of information from Abreu-Lima et al. (2010).

 

The programs that were most frequently identified in the studies were the Adults and Children Together (ACT)-Raising Safe Kids program (n = 7) and Positive Parenting Program (Triple P; n = 4). Only one study analyzed the effectiveness of more than one parenting educational program together (Almeida et al., 2012). This study evaluated 56 parental education interventions, including programs with a flexible and structured format. The structured interventions included six programs: Incredible Years, Strengthening Families, Personal and Family Support Program, More Family, In Search of the Treasure of Families, and Mission C.

Table 2 shows that in 11 studies the participants were parents, including mothers and fathers (Begle & Dumas, 2011; Byrne et al., 2014; Byrne, Salmela-Aro, Read, & Rodrigo, 2012; Durrant et al., 2014; Fetsch, Yang, & Pettit, 2008; Heinrichs et al., 2014; Maalouf & Campello, 2014; Malti, Ribeaud, & Eisner, 2011; Portwood, Lambert, Abrams, & Nelson, 2011; Renzaho & Vignjevic, 2011; Weymouth & Howe, 2011). The parenting program was conducted with caregivers, including mothers, fathers, and other family members, in nine studies (Almeida et al., 2012; Burkhart, Knox, & Brockmyer, 2013; Conner & Fraser, 2011; Knox, Burkhart, & Cromly, 2013; Knox, Burkhart, & Howe, 2011; Knox, Burkhart, & Hunter, 2010; Knox & Burkhart, 2014; Marcynyszyn, Maher, & Corwin, 2011; Prinz, Sanders, Shapiro, Whitaker, & Lutzker, 2009). Three of the preventive parenting programs focused only on mothers (Fujiwara, Kato, & Sanders, 2011; Kendall, Bloomfield, Appleton, & Kitaoka, 2013; Oveisi et al., 2010).

 

Table 2 - Parenting educational programs to prevent child violence and maltreatment:
types, samples, and locations of implementation/recruitment.


CG, caregiver (parents and other family members); PA, parents; MO, mothers; n, number of participants in the study;
CH, the article did not specify the age and only mentioned that the participants were parents of children.
a Study conducted in 18 counties, with an estimated sample size of 8883-13,560 families.
b Participants divided into groups according to their countries (nine countries).

 

The participants were recruited in different places, including community centers, schools, health centers, mental health agencies, daycare centers, social service agencies, child welfare agencies, prisons, common pleas courts, churches, job training sites, clergy offices, guidance counselor offices, attorney offices, family service organizations, and non-governmental organizations (Table 2).

Designs and methodologies of the studies

The sample sizes presented a broad range in the studies reviewed herein (Table 2). Twenty-two articles had samples that ranged from 39 to 1235 participants (median = 309). One study was conducted in 18 counties, and the estimated sample size was between 8883 and 13,560 families whose parents participated in the Triple P program (Prinz et al., 2009).

With regard to study design, only seven studies assessed the efficacy of the parenting educational programs (Table 3). Of these studies, six employed an RCT design (Conner & Fraser, 2011; Heinrichs et al., 2014; Knox et al., 2013; Malti et al., 2011; Oveisi et al., 2010; Portwood et al., 2011) with within- and between-group comparisons, and three included follow-up assessment (Heinrichs et al., 2014; Malti et al., 2011; Portwood et al., 2011). Only one study used a stratified random assignment of counties with within- and between-group comparisons (Prinz et al., 2009); this study was the first to randomize geographical areas.

The designs of 15 studies enabled evaluation of the effectiveness of the parenting educational programs. Of these studies, four used a clinical trial design with no randomization but with within- and between-group comparisons (Burkhart et al., 2013; Fujiwara et al., 2011; Knox et al., 2010, 2011). Additionally, 11 studies used only within-group comparisons with no control group (Almeida et al., 2012; Byrne et al., 2012, 2014; Durrant et al., 2014; Fetsch et al., 2008; Kendall et al., 2013; Knox & Burkhart, 2014; Maalouf & Campello, 2014; Marcynyszyn et al., 2011; Renzaho & Vignjevic, 2011; Weymouth & Howe, 2011). Three of these studies included follow-up assessment (Byrne et al., 2014; Fetsch et al., 2008; Kendall et al., 2013). Finally, only one study used a correlational design with pre- and post-intervention and follow-up (Begle & Dumas, 2011).

Main findings of the studies

The efficacy/effectiveness of the parenting educational programs was evaluated through the following parent and child outcomes: (i) parent outcomes: parenting (e.g., parenting practices, parenting stress, parenting beliefs, and behaviors), parent anger management, parental mental health (e.g., depression and anxiety), perception of social support, and family conflict; (ii) child outcomes: child behavior. One study evaluated the program through population indicators of child maltreatment. The main findings of the studies were organized according to outcomes that were assessed both pre- and post-intervention (Table 3).

Parent outcomes

Parenting strategies. Parenting strategies were the outcome that was assessed in most of the studies (n = 18 [78%]). These studies found improvements in several areas that are related to effective parenting after participation in the parenting educational programs, such as the ACT program (Knox & Burkhart, 2014; Knox et al., 2010, 2013; Portwood et al., 2011; Weymouth & Howe, 2011), Triple P program (Fujiwara et al., 2011; Heinrichs et al., 2014), Incredible Years program (Marcynyszyn et al., 2011), African Migrant Parenting program (Renzaho & Vignjevic, 2011), APF-Personal and Family Support (Byrne et al., 2012, 2014), SOS (Oveisi et al., 2010), Strong Families (Conner & Fraser, 2011), PACE (Begle & Dumas, 2011), the set of interventions assessed by Almeida et al. (2012), 123Magic (Kendall et al., 2013), Positive Discipline in Everyday Parenting program (Durrant et al., 2014), Strengthening the Families and Families (SFP), and Families and Schools Together (FAST; Maalouf & Campello, 2014).

The ACT program presented positive results in educating caregivers about non-violent parenting behavior and child development. These improvements included reductions of the use of harsh words, physical discipline (Portwood et al., 2011), spanking, and the rate of hitting children with objects (Knox et al., 2010), lower rates of psychologically and physically aggressive behavior toward children (Knox et al., 2013), and a decrease in harsh parenting and negative discipline (Knox & Burkhart, 2014). The results also showed improvements in knowledge of child development (Knox et al., 2010; Weymouth & Howe, 2011), behaviors and beliefs related to violence prevention (Knox et al., 2010), media violence literacy, anger management, pro-social problem solving (Weymouth & Howe, 2011), positive parenting behaviors (Knox et al., 2013), and nurturing behavior (Knox et al., 2013; Knox & Burkhart, 2014; Portwood et al., 2011). However, parents who participated in the ACT program reported an increase in parenting stress across time, perhaps because of being more attentive to the challenges associated with parenting (Portwood et al., 2011).

After participation in the Triple P program, the mothers effectively improved their parenting style and parental adjustment (Fujiwara et al., 2011). The Triple P intervention group reported significant reductions of dysfunctional parenting behavior and significant improvements in warm parenting from pre- to post-intervention, which was successfully maintained 4 years later (Heinrichs et al., 2014).

Participation in the Incredible Years program was associated with less parental distress, less defensive responding, less dysfunctional parent-child interactions, less child difficulty, less total stress, and greater empathy (Marcynyszyn et al., 2011). Exposure of the parents to the African Migrant Parenting Program was related to positive changes in parental expectations of the children, parental empathy toward the needs of children, and awareness and knowledge of alternatives to corporal punishment (Renzaho & Vignjevic, 2011).

After the APF-Personal and Family Support program, inductive parenting increased, and coercive and permissive-neglecting parenting decreased (Byrne et al., 2012). Parents after this intervention program also endorsed fewer negative and simplistic views about child development and education, reported that they had increased their utilization of reasoning and explanations to the child (i.e., inductive practice), were less likely to report physical punishment and verbal threats (i.e., coercive practice), and were less likely to disregard the child's needs or avoid correcting the child's misdeeds (i.e., permissive-neglectful practice; Byrne et al., 2014).

Parents who completed the SOS program exhibited significant reductions of physical and emotional abusive behavior and dysfunctional parenting practices from pre- to post-intervention, and these effects were maintained at 8-week follow-up (Oveisi et al., 2010). After the Strong Families program, the parents exhibited significantly greater improvements in bonding, supervision, communication with children, and developmental expectations than the comparison group.

The parents who actively participated in the PACE program exhibited an improvement in parental satisfaction and a decrease in parental stress (Begle & Dumas, 2011). Attendance in the program also predicted a decrease in potential child abuse at follow-up. The results for a subsample of parents at high-risk for child maltreatment were even stronger, in which engagement in the PACE program significantly improved almost all of the parental outcomes at post-intervention and follow-up (Begle & Dumas, 2011). The study that evaluated the set of interventions reported a reduction of parental stress and an improvement in parenting practices (i.e., empathic responding, a decrease in the use of punitive discipline, and the endorsement of parental roles) from pre- to post-intervention (Almeida et al., 2012). The participants in the 123Magic program also presented significant improvements in parenting stress and self-efficacy (Kendall et al., 2013). Parents who completed the Positive Discipline in Everyday Parenting Program were less supportive of physical punishment, less likely to attribute typical child behaviors to "misbehavior" on the part of the child (e.g., defiance and disrespect), and more likely to believe that they have the skills that are necessary to be good parents from pre- to post-intervention (Durrant et al., 2014).

Significant changes in indicators of violence (reported by the children) from pre- to post-intervention were noted across all parental groups in the Strengthening the Families Program (Maalouf & Campello, 2014). These indicators were at different levels (e.g., feeling that parents really love and respect me, sitting with parents to solve problems together without shouting or getting angry, and feeling that parents are calm when they discipline the child). The post-intervention results of parents who completed the FAST program indicated a significant reduction of scores on the conflict subscales (Maalouf & Campello, 2014).

Qualitative data were also collected through focus groups (Kendall et al., 2013; Portwood et al., 2011). The parents perceived several benefits of the ACT program, such as controlling their anger, learning and implementing better parenting and discipline strategies, and recognizing when their child's behavior is developmentally appropriate (Portwood et al., 2011). The participants in the 123Magic program recognized changes in the way they behaved toward their child, felt they were now able to control their emotions, and also commented on the benefits of having the opportunity to listen to and share experiences with other parents (Kendall et al., 2013).

Other parent outcomes. Other parent outcomes were a focus of the studies, such as the following: anger management, internal control, mental health, parents' perception of social support, and family conflict. The RETHINK program focused on parents' anger management, showing that parents controlled and managed their anger better at follow-up (an average of 2.5 months after the program) compared with the post-intervention phase (Fetsch et al., 2008). Parents who completed the Strengthening the Families Program reported that they were controlling and managing their own anger while dealing with the child better at the post-intervention assessment than at the pre-intervention assessment (Maalouf & Campello, 2014). After the APF intervention, the parents reported that they were more able to take control of their lives (i.e., internal control) by acting on everyday events with the potential goal of changing or keeping things the same (Byrne et al., 2014). The Triple P program effectively decreased parents' mental health problems, including depression, anxiety, and stress, assessed by the Depression-Anxiety-Stress Scales (Fujiwara et al., 2011).

Social support improved after the Incredible Years parenting educational program (Marcynyszyn et al., 2011) and after the set of parenting programs that were assessed by Almeida et al. (2012). Providing transportation for parents, supervision by practitioners, and structured interventions increased the parents' perceptions of a social support network (Almeida et al., 2012). Furthermore, after the ACT program, both the intervention and comparison groups of parents exhibited a slight increase in social support from friends over time, with no change in social support from family (Portwood et al., 2011).

The RETHINK program effectively reduced family conflict at the 2.5-month follow-up (Fetsch et al., 2008). The ACT program produced no changes in family conflict that was perceived by parents; however, the program content did not focus on this variable (Portwood et al., 2011).

Child outcomes

The studies also evaluated the effectiveness/efficacy of the parenting educational programs with regard to changing child behavior (Almeida et al., 2012; Begle & Dumas, 2011; Burkhart et al., 2013; Conner & Fraser, 2011; Fujiwara et al., 2011; Heinrichs et al., 2014; Knox et al., 2011; Knox & Burkhart, 2014; Malti et al., 2011; Maalouf & Campello, 2014). Of these studies, nine (90%) effectively decreased child behavior problems after the parenting programs. These parenting programs were the following: Triple P (Fujiwara et al., 2011; Heinrichs et al., 2014), Strong Families (Conner & Fraser, 2011), PACE (Begle & Dumas, 2011), ACT Program (Burkhart et al., 2013; Knox & Burkhart, 2014; Knox et al., 2011), FAST (Maalouf & Campello, 2014), and the set of interventions that were assessed by Almeida et al. (2012).

Three studies evaluated the efficacy of the Triple P program on child behavior (Fujiwara et al., 2011; Heinrichs et al., 2014; Malti et al., 2011). One study measured child behavior using the Strengths and Difficulties Questionnaire (SDQ; Goodman, 1997), showing that it effectively decreased child conduct problems (Fujiwara et al., 2011). Another study used the Child Behavior Checklist (CBCL; Achenbach & Resorla, 2000) and found that the mothers in the intervention group reported immediate improvement in child behavior problems during the program; the mothers in the control group did not report this immediate improvement (Heinrichs et al., 2014). One study used the Social Behavior Questionnaire (SBQ; Tremblay et al., 1991) and found no significant effect on children's externalizing behavior (Malti et al., 2011). However, this measure had not been previously used in the country where the parenting educational program was implemented (Switzerland).

The Making Choices Program (for children), associated with the Strong Families Program (for parents), significantly reduced children's aggressive behavior compared with the control group (Conner & Fraser, 2011). Additionally, in this study, the children of parents in the intervention group presented greater improvements in behavior, school performance, and relationships with their caregivers and peers than the control group. This study used the North Carolina Family Assessment Scale (NCFAS; Kirk, Reed, & Lin, 1996) and Berkeley Puppet Interview (BPI; Measelle, Ablow, Cowan, & Cowan, 1998), which both have good internal consistency (Conner & Fraser, 2011).

The PACE program also effectively improved child outcomes. A higher quality of participation in the program predicted positive changes in child coping competence from pre-intervention to follow-up (Begle & Dumas, 2011). The outcomes were evaluated using the Eyberg Child Behavior Inventory-2 (ECBI-2; Boggs, Eyberg, & Reynolds, 1990) and Coping Competence Scale (CCS_R; Moreland & Dumas, 2007), which both have good internal consistency (Begle & Dumas, 2011).

The effectiveness of the ACT program in improving child behavior was assessed using two different measures: Conduct Problems subscale of the SDQ and Externalizing subscale of the CBCL (Knox et al., 2011; Knox & Burkhart, 2014). One of these studies, which performed only within-group comparisons, showed that child behavior problems decreased, reflected by scores on the SDQ and CBCL, from pre- to post-intervention (Knox & Burkhart, 2014). The other study showed that the behavior of children in the ACT intervention group improved more than the comparison group, reflected by scores on the SDQ Conduct Problems subscale, from pre- to post-intervention. However, the CBCL Externalizing subscale indicated that children in both the treatment and comparison groups exhibited significant improvements in behavior over time (Knox et al., 2011). Additionally, another study showed that the ACT program effectively decreased bullying behavior in children, assessed by a questionnaire that was created based on items from the CBCL and SDQ (Burkhart et al., 2013).

After participating in the set of interventions that were assessed by Almeida et al. (2012), parents evaluated their children as showing fewer emotional, social, and behavioral problems. Furthermore, after the interventions, parents with more than 4 years of schooling reported fewer problems with their children than parents with a lower level of education (Almeida et al., 2012).

Parents who participated in the FAST program completed the Conduct Problems subscale of the SDQ to evaluate child behavior (Maalouf & Campello, 2014). The results of the study, which aggregated the results from five countries (Tajikistan, Turkmenistan, Kazakhstan, Kyrgyzstan, and Uzbekistan), showed that the mean score on the Conduct Problems subscale decreased from pre- to post-intervention, showing improvements in children's behavior problems after the intervention (Maalouf & Campello, 2014).

Population database of child maltreatment

One study analyzed the following three population indicators related to child maltreatment: (i) substantiated child maltreatment recorded by child protective services staff, (ii) child out-of-home placements recorded through the foster care system, and (iii) child hospitalizations and emergency room visits attributable to child maltreatment injuries (Prinz et al., 2009). The study reported differential and positive effects in the Triple P system counties, which had lower scores compared with control counties for the three population indicators. Therefore, preventive effects for all population indicators were found.

 

Discussion

The findings of the present systematic review showed that the majority of the studies were conducted in developed countries, with only two studies in developing countries. These findings highlight the urgent call by the World Health Organization (2009) for further research on the applicability and effectiveness of child violence prevention programs in developing countries.

Some studies recruited participants from different locations (e.g., community centers, schools, and non-governmental organizations), whereas other studies enrolled participants from only one location. When studies recruit participants from different locations, variability and the degree of generalization increase because of the greater representativeness of the samples.

The parenting educational programs that were reviewed herein varied with regard to some of their characteristics, but the goals of the interventions were often similar, including: (i) increase parental knowledge about child development, (ii) promote effective parenting practices and skills, (iii) promote the use of non-violent parenting behaviors, and (iv) promote harmonious parent-child relationships. In addition to these general goals, the ACT program adds specific aspects of violence prevention, including the impact of violence and multiple methods for protecting children from violence in the home, community, and media (Knox et al., 2011). The present findings suggest that all of these strategies are important aspects of violence and maltreatment prevention that should be addressed in universal parenting programs.

The present review found that some of the studies did not seek to directly prevent violence and maltreatment but rather promote effective and positive parenting practices and consequently prevent child violence. These results are consistent with another review and a briefing from the World Health Organization (2009), which emphasized that the aims of many parenting programs are not specifically geared toward violence or maltreatment prevention; instead, they are designed to encourage healthy relationships, improve parental strategies, and decrease child behavior problems. Therefore, violence is seldom measured as an outcome, and the measures that were used in the studies are related to promoting effective parenting practices and changing child behavior (Holzer et al., 2006; World Health Organization, 2009). Some of the studies evaluated parenting strategies, including specific practices that are related to violence and maltreatment (e.g., violence prevention skills, awareness and knowledge of alternatives to corporal punishment, spanking and hitting with objects, and harsh discipline). Additionally, one study reported lower scores on population indicators of child maltreatment in counties that participated in the Triple P program. The results of these studies suggest possible relationships between effective parenting practices and child maltreatment prevention.

The results of the studies reviewed herein encourage the implementation of parenting programs as a universal prevention strategy. All of the studies showed some improvements in effective parenting strategies post-intervention. Additionally, the programs effectively improved child behavior in 90% of the studies that assessed this outcome.

The studies that evaluated child behavior reported good psychometric properties of the instruments. Only one study showed that the program did not effectively improve child behavior problems (Malti et al., 2011). However, this study presented problems that were related to the measure of this outcome, which has not been previously used in the country where the parenting program was implemented. Thus, future studies should employ instruments with good psychometric qualities and a history of use in similar studies.

Other parent outcomes, such as the perception of social support, family conflict, mental health, anger management, and internal control, were also evaluated by some of the studies. The studies reported positive results that were related to the effectiveness of the programs in improving these outcomes. However, more evidence is needed with regard to the effectiveness/efficacy of the parenting programs to improve these outcomes because few studies have performed such evaluations.

The present review found that only seven of the studies used an RCT design. Consequently, only these studies evaluated the efficacy of the parenting educational programs. This result shows that future studies should use sophisticated empirical methodologies, such as RCTs.

Considering the methodological CONSORT guidelines, a study with a rigorous methodological design should present a description of the trial design, sufficient details about the intervention to allow replication, and other aspects (e.g., randomization of the participants, power analysis to determine the proper sample size, blinding, and follow-up measures; Schulz, Altman, & Moher, 2010). None of studies reviewed herein mentioned power analysis to determine sample size. Only seven studies included a follow-up assessment; of these, only three were RCTs. The studies were based on self-report only, and no observational measures were included. Consistent with the World Health Organization (2009), the present review suggests that rigorous evaluations of prevention programs worldwide are necessary. Other suggestions for future studies are the utilization of the waiting list design. None of the studies reviewed herein used this design. In this design, the participants are randomly allocated to two groups, and all of the participants receive the intervention, with one group receiving immediate intervention (intervention group) and the control group waiting to receive the intervention (delayed intervention). This design is appropriate when the study cannot be blinded and participation in the intervention is believed by the participants to be much more desirable than the control (Hulley, Cummings, Browner, Grady, & Newman, 2013). Furthermore, when institutions (e.g., communities, schools, and governments) decide that all members of a group should receive a specific intervention, randomization that precludes some individuals from receiving the intervention may be considered unethical, and randomization to a delayed intervention group may be considered acceptable (Hulley et al., 2013).

Some limitations of the present review should be mentioned. The literature searches had strict criteria of only including studies of universal preventive interventions. This focus was established because of the difficulty identifying child maltreatment within families, and this type of intervention is available to everyone within a population group. However, by excluding studies of at-risk populations, could be missed the opportunity to discuss valuable findings on the effectiveness of parenting programs in such populations. Also, to review the recent literature, the search period was restricted to 2008-2014. This period was established because previous reviews on violence and maltreatment prevention interventions covered articles that were published up to 2008. One other limitation was the inclusion of only face-to-face interventions and not interventions that were conducted via multimedia or the Internet. Overall, these limitations unlikely undermine the main findings of the present review.

Opportunities for future research on universal parenting programs can be identified. Future studies should address such relevant topics as the combination of child and parent outcomes, matching report and observation measures, the use of multiple informants or reporting measures (e.g., children, parents, relatives, and teachers), follow-up measures, and RCT designs.

 

Conflict of interest

The authors have no conflict of interest to declare.

 

References

1. Abreu-Lima et al., 2010. Abreu-Lima I., Alarcão M., Almeida A.T., Brandão T., Cruz O., Gaspar M.F., et al. Avaliação de intervenções de educação parental - Relatório 2007-2010. FMH, Universidade Técnica de Lisboa, FPCE, Universidade do Porto, FPCE, Universidade de Coimbra, Instituto de Estudos da Criança, Universidade do Minho, ESE, Instituto Politécnico do Porto, (2010).         [ Links ]

2. Achenbach and Resorla, 2000. Achenbach T.M., Resorla C.A. Manual for the ASEBA preschool forms and profiles: An integrated system of multi-informant assessment. Burlington: University of Vermont, (2000).         [ Links ]

3. Almeida et al., 2012. Almeida A., Abreu-Lima I., Cruz O., Gaspar M.F., Brandão T., Alarcão M., et al. Parent education interventions: Results from a national study in Portugal. European Journal of Developmental Psychology. 2012;9(1):135-49.         [ Links ]

4. APA, 2006. Presidential APA Evidence-based practice in psychology. American Psychologist. 2006;61:271-85.         [ Links ]

5. Arruabarrena and De Paúl, 2012. Arruabarrena I., De Paúl J. Early intervention programs for children and families: Theoretical and empirical bases supporting their social and economic efficiency. Psychosocial Intervention. 2012;21(2):117-27.         [ Links ]

6. Barlow et al., 2010. Barlow J., Smailagic N., Ferriter M., Bennett C., Jones H. Group-based parent-training programmes for improving emotional and behavioural adjustment in children from birth to three years old. Cochrane Database of Systematic Reviews. 2010;3:CD003680.         [ Links ]

7. Barlow et al., 2012. Barlow J., Smailagic N., Huband N., Roloff V., Bennett C. Group-based parent training programmes for improving parental psychosocial health. Cochrane Database of Systematic Reviews. 2012;6:CD002020.         [ Links ]

8. Begle and Dumas, 2011. Begle A.M., Dumas J.E. Child and parental outcomes following involvement in a preventive intervention: Efficacy of the PACE program. Journal of Primary Prevention. 2011;32(2):67-81.         [ Links ]

9. Boggs et al., 1990. Boggs S., Eyberg S., Reynolds L. Concurrent validity of the Eyberg Child Behavior Inventory. Journal of Clinical Child Psychology. 1990;19(1):75-8.         [ Links ]

10. Burkhart et al., 2013. Burkhart K.M., Knox M., Brockmyer J. Pilot evaluation of the ACT Raising Safe Kids Program on children's bullying behavior. Journal of Child and Family Studies. 2013;22(7):942-51.         [ Links ]

11. Butcharty et al., 2006. Butchart A., Harvey A.P., Mian M., Furniss T. Preventing child maltreatment: A guide to taking action and generating evidence. Geneva: World Health Organization, (2006).         [ Links ]

12. Byrne et al., 2014. Byrne S., Rodrigo M.J., Maiquez M.L. Patterns of individual change in a parenting program for child maltreatment and their relation to family and professional environments. Child Abuse and Neglect. 2014;38(3):457-67.         [ Links ]

13. Byrne et al., 2012. Byrne S., Salmela-Aro K., Read S., Rodrigo M.J. Individual and group effects in a community-based implementation of a positive parenting program. Research on Social Work Practice. 2012;23(1):46-56.         [ Links ]

14. Centers for Disease Control and Prevention, 2013. for Centers Child maltreatment. (2013).         [ Links ]

15. Centers for Disease Control and Prevention, 2014. for Centers Understanding child maltreatment. (2014).         [ Links ]

16. Christian and Schwarz, 2011. Christian C.W., Schwarz D.F. Child maltreatment and the transition to adult-based medical and mental health care. Pediatrics. 2011;127(1):139-45.         [ Links ]

17. Cicchetti and Blender, 2006. Cicchetti D., Blender J.A. A multiple-levels-of-analysis perspective on resilience: Implications for the developing brain, neural plasticity, and preventive interventions. Annals of the New York Academy of Sciences. 2006;1094:248-58.         [ Links ]

18. Conner and Fraser, 2011. Conner N.W., Fraser M.W. Preschool social-emotional skills training: A controlled pilot test of the Making Choices and Strong Families programs. Research on Social Work Practice. 2011;21(6):699-711.         [ Links ]

19. Durrant et al., 2014. Durrant J.E., Plateau D.P., Ateah C., Stweart-Tufescu A., Jones A., Ly G., et al. Preventing punitive violence: Preliminary data on the Positive Discipline in Everyday Parenting (PDEP) program. Canadian Journal of Community Mental Health. 2014;33(2):109-25.         [ Links ]

20. Fang et al., 2012. Fang X., Brown D.S., Florence C.S., Mercy J.A. The economic burden of child maltreatment in the United States and implications for prevention. Child Abuse and Neglect. 2012;36(2):156-65.         [ Links ]

21. Fetsch et al., 2008. Fetsch R.J., Yang R.K., Pettit M.J. The RETHINK Parenting and Anger Management Program: A follow-up validation study. Family Relations. 2008;57(5):543-52.         [ Links ]

22. Fujiwara et al., 2011. Fujiwara T., Kato N., Sanders M.R. Effectiveness of Group Positive Parenting Program (Triple P) in changing child behavior, parenting style, and parental adjustment: An intervention study in Japan. Journal of Child and Family Studies. 2011;20(6):804-13.         [ Links ]

23. Goodman, 1997. Goodman R. The Strengths and Difficulties Questionnaire: A research note. Journal of Child Psychology and Psychiatry. 1997;38(5):581-6.         [ Links ]

24. Heinrichs et al., 2014. Heinrichs N., Kliem S., Hahlweg K. Four-year follow-up of a randomized controlled trial of Triple P group for parent and child outcomes. Prevention Science. 2014;15(2):233-45.         [ Links ]

25. Holzer et al., 2006. Holzer P.J., Higgins J.R., Bromfield L.M., Higgins D.J. The effectiveness of parent education and home visiting child maltreatment prevention programs. Australian Institute of Family Studies, (2006).         [ Links ]

26. Hulley et al., 2013. Hulley S.B., Cummings S.R., Browner W.S., Grady D.G., Newman T.B. Designing clinical research. Philadelphia: Lippincott Williams & Wilkins, (2013).         [ Links ]

27. Jonson-Reid et al., 2012. Jonson-Reid M., Kohl P.L., Drake B. Child and adult outcomes of chronic child maltreatment. Pediatrics. 2012;129(5):839-45.         [ Links ]

28. Kaminski et al., 2008. Kaminski J.W., Valle L.A., Filene J.H., Boyle C.L. A meta-analytic review of components associated with parent training program effectiveness. Journal of Abnormal Child Psychology. 2008;36(4):567-89.         [ Links ]

29. Kane et al., 2007. Kane G.A., Wood V.A., Barlow J. Parenting programmes: A systematic review and synthesis of qualitative research. Child: Care, Health and Development. 2007;33(6):784-93.         [ Links ]

30. Kendall et al., 2013. Kendall S., Bloomfield L., Appleton J., Kitaoka K. Efficacy of a group-based parenting program on stress and self-efficacy among Japanese mothers: A quasi-experimental study. Nursing and Health Sciences. 2013;15(4):454-60.         [ Links ]

31. Kirk et al., 1996. Kirk R.S., Reed K., Lin A. North Carolina Family Assessment Scale (NCFAS). Chapel Hill, NC: School of Social Work, Jordan Institute for Families, University of North Carolina at Chapel Hill, (1996).         [ Links ]

32. Knerr et al., 2013. Knerr W., Gardner F., Cluver L. Improving positive parenting skills and reducing harsh and abusive parenting in low- and middle-income countries: A systematic review. Prevention Science. 2013;14(4):352-63.         [ Links ]

33. Knox and Burkhart, 2014. Knox M., Burkhart K. A multi-site study of the ACT Raising Safe Kids program: Predictors of outcomes and attrition. Children and Youth Services Review. 2014;39:20-4.         [ Links ]

34. Knox et al., 2013. Knox M., Burkhart K., Cromly A. Supporting positive parenting in community health centers: The ACT Raising Safe Kids program. Journal of Community Psychology. 2013;41(4):395-407.         [ Links ]

35. Knox et al., 2011. Knox M., Burkhart K., Howe T. Effects of the ACT Raising Safe Kids Parenting Program on children's externalizing problems. Family Relations. 2011;60(4):491-503.         [ Links ]

36. Knox et al., 2010. Knox M.S., Burkhart K., Hunter K.E. ACT Against Violence Parents Raising Safe Kids Program: Effects on maltreatment-related parenting behaviors and beliefs. Journal of Family Issues. 2010;32(1):55-74.         [ Links ]

37. Lundahl et al., 2006. Lundahl B., Risser H.J., Lovejoy M.C. A meta-analysis of parent training: Moderators and follow-up effects. Clinical Psychology Review. 2006;26(1):86-104.         [ Links ]

38. Maalouf and Campello, 2014. Maalouf W., Campello G. The influence of family skills programmes on violence indicators: Experience from a multi-site project of the United Nations Office on Drugs and Crime in low and middle income countries. Aggression and Violent Behavior. 2014;19(6):616-24.         [ Links ]

39. MacMillan et al., 2009. MacMillan H.L., Wathen C.N., Barlow J., Fergusson D.M., Leventhal J.M., Taussig H.N. Interventions to prevent child maltreatment and associated impairment. Lancet. 2009;373(9659):250-66.         [ Links ]

40. Malti et al., 2011. Malti T., Ribeaud D., Eisner M.P. The effectiveness of two universal preventive interventions in reducing children's externalizing behavior: A cluster randomized controlled trial. Journal of Clinical Child and Adolescent Psychology. 2011;40(5):677-92.         [ Links ]

41. Marcynyszyn et al., 2011. Marcynyszyn L.A., Maher E.J., Corwin T.W. Getting with the (evidence-based) program: An evaluation of the Incredible Years Parenting Training Program in child welfare. Children and Youth Services Review. 2011;33(5):747-57.         [ Links ]

42. McCoy, 2013. McCoy D.C. Early violence exposure and self-regulatory development: A bioecological systems perspective. Human Development. 2013;56(4):254-73.         [ Links ]

43. Measelle et al., 1998. Measelle J.R., Ablow J.C., Cowan P.A., Cowan C.P. Assessing young children's views of their academic, social, and emotional lives: An evaluation of the self-perception scales of the Berkeley Puppet Interview. Child Development. 1998;69:1556-76.         [ Links ]

44. Mejia et al., 2012. Mejia A., Calam R., Sanders M.R. A review of parenting programs in developing countries: Opportunities and challenges for preventing emotional and behavioral difficulties in children. Clinical Child and Family Psychology Review. 2012;15(2):163-75.         [ Links ]

45. Mikton and Butchhart, 2009. Mikton C., Butchart A. Child maltreatment prevention: A systematic review of reviews. Bulletin of the World Health Organization. 2009;87(5):353-61.         [ Links ]

46. Moher et al., 2009. Moher D., Liberati A., Tetzlaff J., Altman D.G., the PRISMA GroupPreferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. Journal of Clinical Epidemiology. 2009;62(10):1006-12.         [ Links ]

47. Moreland and Dumas, 2007. Moreland A.D., Dumas J.E. Evaluating child coping competence: Theory and measurement. Journal of Child and Family Studies. 2007;17(3):437-54.         [ Links ]

48. O'Connell et al., 2009. O'Connell M.E., Boat T.F., Warner K.E. Preventing mental, emotional and behavioral disorders among young people: Progress and possibilities. Washington, DC: National Academies Press, (2009).         [ Links ]

49. Oveisi et al., 2010. Oveisi S., Ardabili H.E., Dadds M.R., Majdzadeh R., Mohammadkhani P., Rad J.A., et al. Primary prevention of parent-child conflict and abuse in Iranian mothers: A randomized-controlled trial. Child Abuse and Neglect. 2010;34(3):206-13.         [ Links ]

50. Portwood et al., 2011. Portwood S.G., Lambert R.G., Abrams L.P., Nelson E.B. An evaluation of the Adults and Children Together (ACT) against violence parents raising safe kids program. Journal of Primary Prevention. 2011;32(3-4):147-60.         [ Links ]

51. Prinz et al., 2009. Prinz R.J., Sanders M.R., Shapiro C.J., Whitaker D.J., Lutzker J.R. Population-based prevention of child maltreatment: The U.S. Triple P System Population Trial. Prevention Science. 2009;10(1):1-12.         [ Links ]

52. Renzaho and Vignjevic, 2011. Renzaho A.M.N., Vignjevic S. The impact of a parenting intervention in Australia among migrants and refugees from Liberia, Sierra Leone, Congo, and Burundi: Results from the African Migrant Parenting Program. Journal of Family Studies. 2011;17(1):71-9.         [ Links ]

53. Rios and Williams, 2008. Rios K.S.A., Williams L.C.A. Family intervention as a strategy to prevent behavior problems in children: A review. Psicologia em Estudo. 2008;13:799-806.         [ Links ]

54. Sandelowski, 2008. Sandelowski M. Reading, writing and systematic review. Journal of Advanced Nursing. 2008;64(1):104-10.         [ Links ]

55. Schulz et al., 2010. Schulz K.F., Altman D.G., Moher D. CONSORT 2010 statement: Updated guidelines for reporting parallel group randomized trials. British Medical Journal. 2010;340:c332.         [ Links ]

56. Shonkoff and Garner, 2012. Shonkoff J.P., Garner A.S. The lifelong effects of early childhood adversity and toxic stress. Pediatrics. 2012;129(1):e232-46.         [ Links ]

57. Tremblay et al., 1991. Tremblay R.E., Loeber R., Gagnon C., Charlebois P., Larivee S., LeBlanc M. Disruptive boys with stable and unstable high fighting behavior patterns during junior elementary school. Journal of Abnormal Child Psychology. 1991;19:285-300.         [ Links ]

58. Trivette and Dunst, 2009. Trivette C.M., Dunst C.J. Community-based parent support programs. Encyclopedia on early childhood development, Montreal: Centre of Excellence for Early Childhood Development, 2009. pp. 1-7.         [ Links ]

59. Weymouth and Howe, 2011. Weymouth L.A., Howe T.R. A multi-site evaluation of Parents Raising Safe Kids Violence Prevention Program. Children and Youth Services Review. 2011;33(10):1960-7.         [ Links ]

60. World Bank, 2015. Bank World How does the World Bank classify countries?. (2015).         [ Links ]

61. World Health Organization, 2009. Health World Violence prevention the evidence - Preventing violence through the development of safe, stable and nurturing relationships between children and their parents and caregivers. Series of briefings on violence prevention: The evidence. Geneva: World Health Organization, (2009).         [ Links ]

 

 

Correspondence:
Elisa Rachel Pisani Altafim
linhares@fmrp.usp.br

Received 28 August 2015
Accepted 24 October 2015

Creative Commons License Todo el contenido de esta revista, excepto dónde está identificado, está bajo una Licencia Creative Commons