Predictive efficacy of violence risk assessment instruments in Latin-America
Eficacia predictora de los instrumentos de evaluación del riesgo de violencia en Latinoamérica
Jorge Oscar Folino
National University of La Plata, Argentina
]]>
ABSTRACT
In Latin America, violence risk assessment used to be based in the non-structured clinical approach. An Argentinian cohort study that included violence risk assessment tools changed the tradition. The objective of this study is to inform of the observed predictive efficacy of these tools in the follow-up until March 2012. One hundred and fifty three consecutive pre-released convicted males were recruited from September 2001 through September 2004 in La Plata, Argentina. The pre-release assessment measures included the Hare Psychopathy Checklist-Revised, Assessing Risk for Violence V2, Structured Professional Judgment, and Violence Risk Appraisal Guide. The mean follow-up time was 1,290 days. Ninety-nine (64.7%) subjects had at least one general relapse, and 91 (59.5%) had at least one violent relapse. The incidence rate of violent recidivism was 16.8 per 100 person-years. While some indicators of predictive validity had no clinical significance, the time-dependent indicators did have clinical significance.
Key words: Violence. Risk assessment. Risk scale. Predictive validity. Offender population.
RESUMEN
En Latinoamérica, la evaluación del riesgo de violencia se basaba en la aproximación clínica no estructurada. A comienzos del presente siglo un estudio de cohorte argentino cambió la tendencia. El propósito de este estudio es informar sobre la eficacia predictiva de esos instrumentos en el seguimiento hasta marzo de 2012 de la cohorte de penados liberados. Se reclutó a 153 varones penados, candidatos a ser liberados consecutivamente bajo condiciones entre septiembre de 2001 y septiembre de 2004. Las medidas basales estaban constituidas por el Hare Psychopathy Checklist-Revised, Assessing Risk for Violence V2, Violence Risk Appraisal Guide y el juicio profesional estructurado. El período promedio de seguimiento fue de 1.290 días. Noventa y nueve (64.7%) sujetos tuvieron, por lo menos, una recidiva general y 91 (59.5%) tuvieron, por lo menos, una recidiva violenta. La tasa de incidencia de recidiva violenta fue de 16.8 por 100 persona-años. Algunos indicadores de validez predictiva no alcanzaron significación clínica, pero sí los estimadores tiempo-dependientes.
Palabras clave: Violencia. Evaluación de riesgo. Escala de riesgo. Validez predictiva. Población prisionera.
In Latin America, violence risk assessment (VRA) during the 20th century was based on a non-structured clinical approach (Singh, Condemarín, & Folino, 2013). But in the last 10 years of the 20th century, the academic and forensic fields restructured the theoretical conceptualization of the subject in Argentina. Risk assessment predictive quality and its value as a tool to inform prevention plans were highlighted (Folino, 1994, 1996, 2004; Folino & Escobar-Córdoba, 2004). Finally, around 2000 a joint effort between the Master Course in Forensic Psychiatry of the National University of La Plata (UNLP) and the Supreme Court of Justice of the Province of Buenos Aires established a program to acquire empirical evidence on VRA (Folino, Marengo, Marchiano, & Ascazibar, 2004).
The objectives of the Pilot Program for Assessment of Risk in Released Males in the Prosecutor General Bureau of the Supreme Court of Justice of the Province of Buenos Aires were to create a procedure for systematic assessment of the risk of violent recidivism in forensic patients and in the inmates who were applying to any form of anticipated release, and to contribute to the creation of intervention programs that would help to decrease the recidivism rate. It was also a goal of the program to provide the judicial system with an assessment procedure that would be transparent, that the parties involved would be able to supervise it, and that would allow for follow-up assessments.
]]> Due to the prevailing paradigm, there were notorious shortfalls in knowledge, including the base rate for criminal recidivism in populations released from prison. Determining this rate was one of the first aims of the Program. Thus, a cohort of males released in 1991 was formed and the official criminal registries for the subsequent 10 years were obtained. The result was that 34% had had at least one new conviction and 52% had at least one new charge (Folino & Marchiano, 2002).In addition, a protocol for pre-release assessment was designed. Nine internationally-used instruments, or parts of them, were translated: the Hare Psychopathy Checklist-Revised (PCL-R; Hare, 1991, 2003), the Assessing Risk for Violence V 2 (HCR-20; Webster, Douglas, Eaves, & Hart, 1997; Folino, 2003), the Violence Risk Appraisal Guide (VRAG; Quinsey, Harris, Rice, & Cormier, 1999; Quinsey & Lalumière, 1995), the Lifestyle Criminality Screening Form - Revised (LSCF-R; Walters, 2003a, 2003b), the Iterative Classification Tree (ICT; Monahan et al., 2000; Steadman et al., 2000), the Rapid Risk Assessment for Sexual Offense Recidivism (RRASOR; Hanson, 1997), the Sexual Offender Risk Appraisal Guide (SORAG; Quinsey, Harris, Rice, & Cormier, 2006), the Child and Adolescent Taxon Scale (CATS; Quinsey et al., 1999), and the Cormier-Lang Scale (Cormier et al., 1999).
A concurrent cohort study was designed to evaluate the predictive validity and reliability of the pre-release assessment protocol based on "Out" follow-up, from the moment of release on. Other components of validity of the translated instruments were tested as well (Castillo, 2007; Folino, Almirón, & Ricci, 2007; Folino, Astorga, Sifuentes, Ranze, & Tenaglia, 2003; Folino, Castillo et al., 2004; Folino, Escobar-Córdoba, & Castillo, 2006; Folino & Hare, 2005; Folino et al., 2005; Folino & Mendicoa, 2006).
The Argentinian studies were accompanied by other studies that were frontline in Latin America regarding the subject. In many of them the academic diffusion from the National University of La Plata was of main importance (Folino & Raverta, 2006), including studies with the PCL-R and the HCR-20 in:
• Brazil (De Borba Telles, Day, Folino, & Taborda, 2009; De Borba Telles, Folino, & Taborda, 2009, 2012; Teitelbaum, 2010).
• Chile (León-Mayer, 2012; León-Mayer, Asún Salazar, & Folino, 2010; León-Mayer, Cortés Olavarría, & Folino, 2014; León-Mayer, Neuman, Hare, & Folino, 2013).
• Colombia (Folino & Escobar-Córdoba, 2004; González, Escobar-Córdoba, & Castellano-Castañeda, 2007; Ruiz, 2006; Tejada & Escobar-Córdoba, 2005).
• Ecuador (Ochoa-Rosales, 2007).
Both the "Out" Argentinian cohort study and the "In" Brazilian cohort study - a follow up study of forensic mental health inpatients conducted at the Rogério Cardoso Forensic Hospital in Porto Alegre - supported the reliability and predictive validity of the VRAG, the Hare PCL-R, and the HCR-20 for forensic populations (De Borba Telles et al., 2009a,2012; Folino, 2006), but not for convicted populations. The "Out" follow up for the Argentinian convicted and released cohort did not produce significant results until the follow-up of January 2007 (Folino, 2009). Thus, it is important to prolong follow-up periods to investigate if there is variation in the rate of violent recidivism and if there is an increase in the predictive efficacy of the pre-release assessment measurements.
]]> The purpose of the present study was to determine the violent and general recidivism rates of a cohort of released convicted male from time of release between September 2001 and September 2004 through March 2012 and to analyze the predictive validity of four VRA instruments included in the pre-release assessment.
Method
Participants
The cohort of the study comprised all males (n = 178) who were consecutive candidates for release during the recruitment period (September 2001 - September 2004) in the Penal Execution Court No. 1 of the Judicial Department of La Plata, Argentina. Of the 178 males evaluated, 25 (14%) were forensic patients and 153 (86%) were convicted. The cohort of the present study comprises the 153 released convicted males; mean age at release was 29.4 years (age range, 20-75 years, SD 8.7).
The Penal Execution Court No. 1 was the only court during the recruitment period in the Judicial Department of La Plata, which has a population of 1 million inhabitants. The mean age of the present cohort was statistically similar to that of the cohort of convicts in the Province of Buenos Aires in 1991 (n = 3, 324, t = 1.032, gl 95, p = .305, 95% CI = -0.84, 2.66) (Folino & Marchiano, 2002).
The index crimes were crimes against property (85%), threats, assaults, homicides, and attempted homicides (11%), sexual offenses (2%), and other crimes (2%).
Pre-release Assessment and Instruments
Assessment was conducted before release of all convicted males with the following instruments: HCR-20 (Webster et al., 1997), PCL-R (Hare, 2003), VRAG (Quinsey et al., 1999), and the Structured Professional Judgment (SPJ; Douglas & Ogloff, 2003). The SPJ was based on professional review following the guidelines of the HCR-20, and conclusions were expressed as low, moderate, or high recidivism risk. The results were transformed in an ordinal variable with a minimum of 1 and a maximum of 3 for statistical purposes. Recent meta-analyses and systematic reviews have informed that these instruments have a moderate predictive efficacy and values under the ROC curve between .66 and .74 (Singh, Grann, & Fazel, 2011; Yang, Wong, & Coid, 2010).
As recommended (Blomhoff, Seim, & Friis, 1990; Douglas & Ogloff, 2003; Monahan & Steadman, 1994), multiple methods were used to obtain the necessary information (judicial files, clinical and criminal records, psychiatric and social assessment interviews, and psychological and psychiatric forensic reports).
]]> The first translated and commented Spanish version of the HCR-20 was used (Folino, 2003; Webster et al., 1997). Local studies informed of alpha coefficients of .76 for Section H, .55 for Section C, and .88 for Section R; the agreement between evaluators as measured by the intraclass correlation coefficient was .94 for H, .75 for C, and .97 for R (Folino et al., 2004a).The authorized Argentinian research version of the PCL-R was used. Two independent studies had provided evidence for its reliability. The first study reported alpha coefficients of .86 for total scores, .83 for Factor 1, and .86 for Factor 2; an intraclass correlation coefficient of .89 for Factor 1 and .92 for factor 2; and .92 for Total Score. The comparison of two categorical diagnoses of three simultaneous evaluators with adjusted kappas was .90 (Folino et al., 2003). In the second study, the results were even higher: alpha coefficient of .99 for Total Score, .98 for Factor 1, and .99 for Factor 2; the singular measure of the intraclass correlation coefficient was higher (Folino & Castillo, 2006).
Two forensic psychiatrists conducted the clinical interviews of the pre-release assessment (simultaneously in 60% of the cases) and a social worker trained in the forensic field conducted the interviews of the participants and their families for information on environmental risk factors and to obtain other contact information. Evaluators were advised by lawyers who worked for the Penal Execution Court.
Design
The study had a concurrent cohort design. The events of interest were "general recidivism," which was any offense or crime or violent act, even though it did not have legal consequences and "violent recidivism," which implied violence.
It was considered that the subjects were "in opportunity to recidivate" from the moment of release. Administrative censoring was March 1, 2012. The average follow-up period up to general recidivism or censoring was 1,277 days (range, 1 - 3,488 days). The mean time to violent recidivism or to censoring was 1,290 days (range, 1 - 3,488 days).
From September 2001 to September 2004, multiple information sources were used to obtain outcome information, including official records of new charges and interviews with released subjects and their families about every three months. Data from the interviews were obtained by trained social workers who were blind to the pre-release assessment (Folino et al., 2005).
After that period only the official registries of new penal charges were used (Prosecutor General Bureau Office of the Province of Buenos Aires, Police of the Province of Buenos Aires, Federal Police and Gendarmería), though we also checked the Provincial Registry of People and Gendarmería for subjects who died or left the country. There was only one lost case due to death.
Predicted Outcome
The recidivism measure was recorded as both a categorical and continuous variable with the Overt Agression Scale (OAS; Silver & Yudofsky, 1991; Yudofsky, Silver, Jackson, Endicott, & Williams, 1986).
]]> As a categorical event, recidivism was considered either "charged" (robbery, homicide, etc.) or "violence with no penal accusation" (using a definition of violence from the HCR-20 (Webster et al., 1997).Any OAS score higher than 6 for a single recidivism event was considered "violent recidivism."
Statistical Analysis
The point biserial and Spearman correlations were obtained, as well as Kaplan-Meier's survival function and the Area Under the Curve Receiver Operating Characteristics (AUC-ROC). Multivariate logistic regression analysis and Cox regression (Cox, 1972) were executed, after checking if the assumption of proportional hazards was met. Calibration components in risk assessment (Singh, 2013) were also estimated. Age was selected as a control variable for the logistic regression analysis because of its association with recidivism (Hill, Habermann, Klusmann, Berner, & Briken, 2008; Looman & Abracen, 2010; Lund, Hofvander, Forsman, Anckarsäter, & Nilsson, 2013; Quinsey et al., 1999; Webster et al., 1997). The variables were dichotomized as follows: Hare PCL-R score with a cutoff of 30 and VRAG and HCR-20 with the mean. The statistical analysis was made with the IBM SSPS software (IBM Corp. SPSS Inc, 2011). The data was entered in an ad-hoc database with security measures.
Ethical Considerations
Two conditions decreased the risk of ethics faults: a) the observational design maintains the confidentiality of the individuals of the sample; b) the assessments were part of the activities that had been ordered by the Court, with clear knowledge of all parties involved in each case, such as defense attorney, curators, and prosecutors. The data obtained was coded and entered in a database from the Prosecutor General Bureau of the Supreme Court of Justice of the Province of Buenos Aires. The project was approved by the Bioethical Committee of the Institute of Bioethics and Humanities of the Mainetti Foundation, which is independent from the Judicial Power and the National University of La Plata.
Results
During the follow-up period, 99 (64.7%) of the subjects had at least one general relapse and 91 (59.5%) subjects had at least one violent relapse. The incidence rate of violent recidivism was 16.8 per 100 person-years.
]]> During the period in which information on recidivism was collected via interviews with individuals and their families, as well as by checking official records, recidivism events were reported by subjects in 14 (14.1%) of the 99 recidivating cases; in 50% of those 14 cases, official information of a second offense was also obtained.
Table 1 shows the mean scores obtained at pre-release assessment.
Table 1. Descriptive Statistics of Pre-release
Assessment Scores 
Note. N = 153. PCL-R: Hare Psychopathy Checklist. VRAG:
Violence Risk Appraisal Guide. HCR-20: Historical
Clinical Risk- 20. SPJ: Structured Professional ]]>
Judgment. Cormier-Lang System: Cormier-Lang Criminal
History Score for Violent/Nonviolent Offenses.
The prevailing diagnoses were related to substance abuse and antisocial personality disorder (Table 2).
Table 2. Mental Disorders 
Note. Diagnostic categories DSM IV
(American Psychiatric Association, 2000).
]]> The association of the VRA baseline scores with dichotomous and interval outcome measures was estimated. In general, the point bi-serial correlations for the total values were higher for violent recidivism than general recidivism: HCR 20 (.207, p = .005 vs. .152, p = .03); VRAG (.269, p < .001 vs. .240, p = .001); PCL-R (.206, p = .005 vs. .179, p = .01); SPJ (.248, p = .248 vs. .236, p = .002). For each outcome measure the association with VRAG scores was the strongest, followed by SPJ. With respect to the HCR-20 subscales, the subscale H had the strongest point bi-serial correlation (.189, p = .02). In the case of PCL-R, the antisocial facet (Facet 4) was outstanding (r = .254, p = .001). The results highlight the relevance of static factors associated with the transgressor lifestyle, which are measured by these scales. Similar results were obtained with the estimate of the AUCs (Tables 3 and 4). The VRAG and the antisocial facet of the PCL-R were best at discriminating violent recidivating individuals.
Table 3. Instruments and Discrimination Validity to General Recidivism 
Note. PCL-R: Hare Psychopathy Checklist. VRAG: Violence Risk Appraisal Guide.
HCR-20: Historical Clinical Risk- 20. H: HCR- 20 Historical scale. C: HCR- 20
Clinical scale. R: HCR- 20 Risk scale. SPJ: Structured Professional Judgment. SE:
Standard Error. AUC: Area Under the Curve of the Receiver Operating Characteristic.
Table 4. Instruments and Discrimination Validity to Violent Recidivism ]]>
Note. PCL-R: Hare Psychopathy Checklist. VRAG: Violence Risk Appraisal Guide.
HCR-20: Historical Clinical Risk- 20. H: HCR- 20 Historical scale. C: HCR- 20
Clinical scale. R: HCR- 20 Risk scale. SPJ: Structured Professional Judgment. SE:
standard error. AUC: Area Under the Curve of the Receiver Operating Characteristic.
For each VRAG category, a regular growing trend of the proportions of recidivating individuals was identified. While no subject was classified in the lowest category of risk, the percentage of recidivating individuals was 0%, 33%, 50%, 46%, 51%, 73%, 70%, and 100% for the categories 2, 3, 4, 5, 6, 7, 8, and 9 respectively.
Predictive validity was also determined by dichotomizing the total pre-release assessment scores. In the case of the PCL-R a cutoff of 30 was used (as recommended by the Technical Manual for the categorical diagnosis of psychopathy) and for the HCR-20 and the VRAG the means were used (Table 5). Of the three instruments, the VRAG had the best predictive power.
Table 5. Instruments and Performance Indicators ]]>
Note. PPV: Positive Predictive Value. NPV: Negative Predictive Value. NND: Number
Needed to Detain. NSD: Number Safely Discharged. RR: Relative Risk. PCL-R:
Psychopaty Cheklist-Revised. VRAG: Violence Risk Appraisal Guide.
HCR-20: Historical Clinical Risk- 20.
Logistic regression models were estimated with "violent recidivism" as the dependent variable. When controlling by age (OR = 0.94; 95% CI .89, 99; p = .012), VRAG higher than the mean (VRAG > 12) doubled the risk of violent recidivism (OR = 2.14; 95% CI 1.07, 4.35; p = .04), as did PCL-R higher than the mean (PCL-R > 20; OR = 2.13; 95% CI 1.07, 4,24; p = .03) and SPJ measured as an interval variable (minimum 1; maximum 3; OR = 2.13; 95% CI 1.08, 4.21; p = 0.3). However, HCR 20 higher than the mean and PCL-R > 29 showed no significant association when controlling for age. The associations had a marginal statistical significance and no associations were found when total values were entered as interval variables: VRAG (OR = 1.04; 95% CI .1, 1.09; p = .03); PCL-R (OR = 1.06; 95% CI 1.01, 1.11; p = .01); HCR 20 (OR 1.06; 95% CI 1.01, 1.11; p = .03).
Estimations of Kaplan-Maier function for the VRAG stratified by the mean value and for the SPJ factor stratified in low, moderate, and high scores showed that the greater the risk factor, the higher the accumulated probability of general recidivism during the follow-up time, log rank (Mantel-Cox) = 7.6 (1); p = .006 and log rank (Mantel-Cox) = 7.9 (2); p = .02, respectively. On the other hand, the Kaplan-Meier Function for the HCR-20 stratified by the mean and the PCL-R total stratified by the mean or by the cutoff score of 30 showed no significant differences.
The trend was even more noticeable when calculating the Kaplan-Meier with violent recidivism as the outcome: VRAG, log rank (Mantel-Cox) = 9.5 (1); p = .002; and of those having greater risk according to the SPJ, log rank (Mantel-Cox) = 8.44 (2); p = .015 (Figures 1 and 2). Likewise, Kaplan-Meier function with the HCR-20 stratified by the mean and the PCL-R total, either stratified by the mean or by the cutoff score of 30 showed that those that had higher scores in the instruments also had the higher accumulated probability of recidivism with violent acts, but the differences were not significant: HCR-20, log rank = 2.99 (1); p = .08; PCL-R stratified by the means, log rank = 3.31 (1); p = .07; PCL-R stratified by cutoff score of 30, log rank = 0.77 (1); p = .38.
]]>
Figure 2. Kaplan-Maier Cumulative Survival Function for Structured
Professional Judgment and Violent Recidivism.
Taking into account the significant result of the function of Kaplan-Meier, Cox regression was estimated with age at release and the dichotomized VRAG factor as co-variables. Controlling for age, RR = .951 (95% IC 0.917, 0.985); p = .006, the VRAG value higher than the mean increased the rate of violent recidivism 57%, RR = 1.573 (95% IC 1.023, 2.419), p = .039.
]]> Discussion
This study, as part of a program created at the beginning of the millennium in Argentina, has helped to disseminate a systematic style of assessment of risk of violence over traditional non-systematic practices in Latin America. The systematic methodology resulted in a technically improved model with respect to the previous model based on "beliefs and thoughts" that had various vulnerabilities (Monahan, 1981a, 1981b; Quinsey et al., 1999; Rice, Harris, & Quinsey, 2002) and that, due to the non-systematic way of working, created barriers to explore its efficacy. It should be noted that, with independence of results, this study made it possible to test the reliability and predictive validity of a battery of instruments to assess the risk of violent recidivism, for the first time in Latin America. Thus, the program achieved its objective and inaugurated a period of diffusion so that other experts would add evidence to the complex area of violence risk assessment, which sits in the interface of law and mental health.
This study analyzed the predictive validity of various VRA assessment tools in a cohort of released convicted males in Argentina. It provides valuable information about which VRA tool was most reliable, and the results can be used for comparisons with other populations. The long recruitment period of the consecutive candidates for early release enabled us to obtain a representative profile of the prison population at the moment of "leaving" the prison system.
Evidences from several studies support integrated evaluation and intervention according to the model of Risk-Need-Responsivity (Andrews & Bonta, 2010; Andrews, Bonta, & Wormith, 2006). In Argentina, common day practice is far away from the systematic use of the model, but this study shows its plausibility. As found in other countries (Rodríguez et al., 2011), substance abuse disorders was an outstanding health problem. The program established a thorough diagnostic system for substance abuse disorders, which lead to referral to treatment in the community according to the risk and needs principles. On the other hand, a biochemical monitoring system was implemented. Drug metabolite testing in different substrates (urine, hear, nails) reinforced the monitoring and re-intervention in those cases with a decreased predisposition to withdrawal (Folino, Arado, Ferrari, & Marengo, 2002).
General and violent recidivism rates (65% and 59% respectively) reached in a 3.5-year follow up were much higher than was estimated with a 1991 cohort study from a single province in Argentina with a longer follow-up time (Folino & Marchiano, 2002). The higher rates are worrisome for public security and from a preventive point of view. In addition to their own original vulnerabilities, people released from prison also face the stressors of social re-incorporation (Folino et al., 2005). Thus, there is a clear need for the state to create programs for secondary prevention for this population. The recidivism rates in the present study might be useful as baseline data to compare the impact of future programs aimed at diminishing recidivism rates.
This study found that VRA instruments improve prediction of recidivism rates, but with low efficiency. The results show a lesser efficiency than those from studies in other countries included in recent meta-analyses (Singh et al., 2011; Yang et al., 2010). The four instruments predicted violent recidivism better than general recidivism, contrary to the recent findings with other instruments and with bigger populations (Zhang, Roberts, & Farabee, 2011). The percentage of subjects with a recidivism event increased according to the risk classifications in the nine categories of the VRAG, and the VRAG was the only instrument that reached an AUC of .65 for violent recidivism. But the index is still below .70, which is considered clinically significant.
Predictive efficiency was greater when the probability of accumulated recidivism in the follow-up time was considered. Kaplan-Meier function showed that individuals who had been exposed to greater risk according to VRAG classification and the SPJ had a significantly greater probability of both general and violent recidivism. The results suggest that preventive services should be provided mostly during the first period after release. They also add clinical relevance to the use of instruments.
Age has traditionally been significantly and inversely associated with violent recidivism (Hill, Habermann, Klusmann, Berner, & Briken, 2008; Looman & Abracen, 2010; Lund, Hofvander, Forsman, Anckarsäter, & Nilsson, 2013; Quinsey et al., 1999; Webster et al., 1997). In multivariate analyses controlled for age, the VRAG maintained its predictive value.
The results of the PCL-R were not in line with early studies that reported a high violence predictive power for the diagnosis of psychopathy (Harris, Rice, & Cormier, 1991; Salekin, Rogers, & Sewell, 1996). The slightly better performance found with facets 3 and 4 suggests that preventive measures aimed at addressing criminogenic factors differently than interpersonal or affective personality factors could be more beneficial (Andrews & Bonta, 2003; Bonta, Law, & Hanson, 1998; Yang et al., 2010). There is also the possibility that the effect of personality factors on the risk for violent recidivism is surpassed by socioeconomic and political instabilities, such as those experienced in Argentina from the turn of the century. A recent study in England and Wales has also shown predictive difficulties in psychopathic subjects (Coid, Ullrich, & Kallis, 2013). The authors suggest that one possible reason is that the items of the instruments show little variation in psychopathic offenders and, therefore, are not adequate to differentiate those at high and low risk for violent reoffending. Further research is needed to find better indicators of social performance during the reincorporation period and to identify the most sensitive personality factors.
One limitation of the study is the decrease in information sources in the follow-up period since the last quarter of 2004, when the interviews with released subjects and their families were stopped. The strengths of the study include that the social workers were blinded to the pre-release assessment, the representativeness of the sample, and the wide range of sources of official records for new charges.
]]> The present study's findings complement the results of previous studies in Latin America. While previous Latin American reports supported the predictive validity of the instruments in forensic population (De Borba Telles et al., 2012; Folino, 2006), this study suggests caution about risk assessment when the targeted population is made up by convicts. Future studies should identify local risk factors and look for any interactions with regional socioeconomic conditions.The performance of these instruments is far from optimal and there is a need to focus on preventive actions in cases that are classified as high risk, as well as in those that are low risk (Large, Ryan, Callaghan, Paton, & Singh, 2014). A future study is planned to explore the distributions of individual risk factors in the different categories formed by the omnibus measure, with the hypothesis that there are different factors that influence different subgroups. This would allow for a refinement in the assessment process and in the planning of interventions.
Unfortunately, the knowledge and diffusion of structured and actuarial systems of assessment is very new in Latin America, as is the acknowledgement of the importance of research on the subject. The lack of dissemination of this kind of systematic assessment prevents studies with larger samples and makes it difficult to adapt the VRA instruments as it occurs elsewhere in the world (Ragusa-Salerno, Ostermann, & Thomas, 2013; Rettenberger, Haubner-Maclean, & Eher, 2013; Zhang et al., 2011;). Further, the penitentiary institutions in Latin America remain disconnected to the precarious "out" services and institutional actions are carried out inconsistently as short-term policies or in reaction to media comments. We will have to wait for the use of evidence-based practices and for bridging the gap between science and practice in penitentiary institutions.
Conflict of Interest
The present study had no specific financing and was conducted as part of the official work for the Prosecutor General Bureau of the Supreme Court of Justice of the Province of Buenos Aires in a covenant with the Master Course in Forensic Psychiatry at the School of Medicine of the National University of La Plata.
The author translated the instruments jointly with an official translator. The results of the present study were provided in a work report to the judicial institution.
Previous results of the program were published in articles mentioned in the bibliography.
Acknowledgements
]]> The author wants to acknowledge Elizabeth León Mayer for her help with the translation.
References
1. Acero-González, A. R., Escobar-Córdoba, F., & Castellano-Castañeda, G. (2007). Factores de riesgo para violencia y homicidio juvenil (Juvenile homicide and violence risk factors). Revista Colombiana de Psiquiatría, XXXVI, 78-97. [ Links ]
2. Andrews, D. A., & Bonta, J. (2003). The psychology of criminal conduct (3rd ed.). Cincinnati: Anderson Publishing. [ Links ]
3. Andrews, D. A., & Bonta, J. (2010). Rehabilitating criminal justice policy and practice. Psychology, Public Policy, and Law, 16, 39-55, http://dx.doi.org/10.1037/a0018362. [ Links ]
4. Andrews, D. A., Bonta, J., & Wormith, J. S. (2006). The recent past and near future of risk and/or need assessment. Crime & Delinquency, 52, 7-27. http://dx.doi.org/10.1177/0011128705281756. [ Links ]
5. Blomhoff, S., Seim, S., & Friis, S. (1990). Can prediction of violence among psychiatric inpatients be improved? Hospital & Community Psychiatry, 41, 771-775. [ Links ]
6. Bonta, J., Law, M., & Hanson, K. (1998). The prediction of criminal and violent recidivism among mentally disordered offenders: a meta-analysis. Psychological Bulletin, 123, 123-142. [ Links ]
7. Castillo, J. (2007). La prediccion de futura violencia con instrumentos de evaluación compuestos (Prediction of future violence with compound risk assessment instrument) (PhD dissertation). La Plata, Argentina: National University of La Plata. [ Links ]
8. Coid, J. W., Ullrich, S., & Kallis, C. (2013). Predicting future violence among individuals with psychopathy. The British Journal of Psychiatry, 203, 387-388. http://dx.doi.org/10.1192/bjp.bp.112.118471. [ Links ]
9. Cormier, C., Lang, C., Quinsey, V. L., Harris, G. T., Rice, M. E., & Cormier, C. A. (1999). Cormier-Lang System for Quantifying Criminal History (3rd ed.). Washington: American Psychological Association. [ Links ]
10. Cox, D. R. (1972). Regression models and life tables. Journal of The Royal Statistical Society Series B, 34, 187-220. [ Links ]
11. De Borba Telles, L. E., Day, V. P., Folino, J. O., & Taborda, J. G. V. (2009). Reliability of the Brazilian version of HCR-20 Assessing Risk for Violence. Revista Brasileira de Psiquiatria, 31, 253-256. [ Links ]
12. De Borba Telles, L. E., Folino, J. O., & Taborda, J. G. V. (2009). Incidência de conduta violenta e antissocial em população psiquiátrica forense (Incidence of violent and antisocial behavior in forensic psychiatric population). Revista de Psiquiatria de Rio Grande Do Sul, 33, 3-7. [ Links ]
13. De Borba Telles, L. E., Folino, J. O., & Taborda, J. G. V. (2012). Accuracy of the Historical, Clinical and Risk Management Scale (HCR-20) in predicting violence and other offences in forensic psychiatric patients in Brazil. International Journal of Law and Psychiatry, 35, 427-431. [ Links ]
14. Douglas, K. S., & Ogloff, J. R. P. (2003). Multiple Facets of Risk for Violence: The Impact of Judgmental Specificity on Structured Decisions About Violence Risk. International Journal of Forensic Mental Health, 2, 19-34. http://dx.doi.org/10.1080/14999013.2003.10471176. [ Links ]
15. Folino, J. O. (1994). Interfase Psiquiátrico Judicial (Judicial-psychiatric interfase). Buenos Aires, Argentina: Lema Editorial, S.R.L. [ Links ]
16. Folino, J. O. (1996). Salud Mental y Derecho en Canadá (Law and mental health in Canada). Rosario, Argentina: Biblioteca Norte Sur Asesoría Cultural de la Embajada de Canadá para la Argentina y Uruguay. [ Links ]
17. Folino, J. O. (2003). Evaluación de Riesgo de Violencia - HCR-20. Versión en español, adaptada y comentada (Assessing risk for violence: adapted and commented Spanish version). La Plata, Argentina: Interfase Forense. [ Links ]
18. Folino, J. O. (2004). Nuevos paradigmas en la evaluación de peligrosidad (New paradigms in the assessment of dangerousness). Doctrina Judicial - Editorial La Ley, XX, 871-876. [ Links ]
19. Folino, J. O. (2006). Violence Risk Assessment Instrruments: do they work in Latin- America? Paper presented at the 6th Annual IAFMHS Conference: A Safe Society: Effective Assessment, Prevention and Treatment in Forensic Mental Health. Amsterdam, Holland: International Association Forensic Mental Health Services. [ Links ]
20. Folino, J. O. (2009). Investigación latinoamericana en evaluación de riesgo de violencia y psicopatía (Latin-american research on violence risk assessment and psychopathy). Proceedings of the XXXI Congress International Academy of Law and Mental Health (p. 444). New York: International Academy of Law and Mental Health. [ Links ]
21. Folino, J. O., Almirón, M. P., & Ricci, M. A. (2007). Factores de riesgo de recidiva violenta en mujeres filicidas (Violence recidivism risk factors in filicide women). Vertex, Revista Argentina de Psiquiatría, XVIII, 258-267. [ Links ]
22. Folino, J.O., Arado, M., Ferrari, L., & Marengo, M. (2002). Manejo del riesgo de recidiva violenta y el abuso de sustancias (Violent recidivism risk management and substance abuse) (Documento de Trabajo No. 7). La Plata, Argentina: Procuración General de la Suprema Corte de Justicia de la Provincia de Buenos Aires. [ Links ]
23. Folino, J. O., Astorga, C., Sifuentes, M., Ranze, S., & Tenaglia, D. (2003). Confiabilidad de la Hare Psychopathy Checklist-Revised en población psiquiátrico forense argentina (Reliability of the Psychopathy Checklist-Revisded in Argentinian forensic psychiatric population). Alcmeon - Revista Argentina de Clínica Neuropsiquiátrica, 13, 5-11. [ Links ]
24. Folino, J. O., Cáceres, M. S., Campos, M. L., Silveri, M., Ucín, S., & Ascazibar, M. (2005). Evaluación de factores dinámicos de riesgo de violencia (Assessment of violence dynamic risk factors). Vertex, 16, 188-195. [ Links ]
25. Folino, J. O., & Castillo, J. L. (2006). Las facetas de la psicopatía según la Hare Psychopathy Checklist Revised y su confiabilidad (The facets of Hare Psychopathy Cheklist and its reliability). Vertex, 17, 325-330. [ Links ]
26. Folino, J. O., Castillo, J. L., Cáceres, M. S., Campos, M. L., Silveri, M., & Ucín, S. (2004). Confiabilidad de la versión argentina de la HCR-20 (Reliability of the Argentinian version of the HCR-20). Medicina Forense Argentina - Boletín de La Asociación de Médicos Forenses de La República Argentina, 27, 2-5. [ Links ]
27. Folino, J. O., & Escobar-Córdoba, F. (2004). Nuevos aportes a la evaluación de riesgo de violencia (New contributions to violence risk assessment). MedUNAb -Especial Salud Mental - Revista de La Facultad de Medicina de La Universidad de Autónoma de Bucaramanga, 7, 99-105. [ Links ]
28. Folino, J. O., Escobar-Córdoba, F., & Castillo, J. L. (2006). Exploración de la validez de la escala de impulsividad de Barratt (BIS 11) en población carcelaria argentina (Reliability exploration of the Barratt impulsivity scale BIS11). Revista Colombiana de Psiquiatría, 35, 132-148. [ Links ]
29. Folino, J. O., & Hare, R. D. (2005). Listado revisado para verificación de la psicopatía: su estandarización y validación en la Argentina (Psychopathy Cheklist Revised: Argentinian standardization and validity). Acta Psiquiátrica y Psicológica de América Latina, 51, 94-104. [ Links ]
30. Folino, J. O., & Marchiano, S. (2002). Tasa Basal de Recidiva Delictiva. Intercambios, (5). Retrieved from http://der.jursoc.unlp.edu.ar/intercambios/index.htm. [ Links ]
31. Folino, J. O., Marengo, C. M., Marchiano, S. E., & Ascazibar, M. (2004). The Risk Assessment Program and the Court of Penal Execution in the Province of Buenos Aires. Argentina. International Journal of Offender Therapy and Comparative Criminology, 48, 49-58. http://dx.doi.org/10.1177/0306624X03257526. [ Links ]
32. Folino, J. O., & Mendicoa, G. (2006). La Psicopatía, el MMPI y la Hare PCL R (Psychopathy, the MMPI and the Hare PCL-R). Alcmeon - Revista Argentina de Clínica Neuropsiquiátrica, 13, 43-54. [ Links ]
33. Folino, J. O., & Raverta, M. J. (2006). Forensic Psychiatry in Argentina: A Training Forum For Latin America. American Academy of Psychiatry and the Law Newsletter, 31, 28-29. [ Links ]
34. Hanson, K. R. (1997). The Development of a Brief Actuarial Risk Scale for Sexual Offense Recidivism. Ottawa, Ontario, Canada: Public Works and Government Services Canada. [ Links ]
35. Hare, R. D. (1991). The Hare Psychopathy Checklist-Revised. Toronto, Ontario: Multi- Health Systems. [ Links ]
36. Hare, R. D. (2003). The Hare Psychopathy Checklist - Revised 2nd Edition Technical Manual. Toronto: Multi-Health Systems, Inc. [ Links ]
37. Harris, G. T., Rice, M. E., & Cormier, C. A. (1991). Psychopathy and violent recidivism. Law and Human Behavior, 15, 625-637. [ Links ]
38. Hill, A., Habermann, N., Klusmann, D., Berner, W., & Briken, P. (2008). Criminal recidivism in sexual homicide perpetrators. International Journal of Offender Therapy and Comparative Criminology, 52, 5-20. http://dx.doi.org/10.1177/0306624X07307450. [ Links ]
39. IBM Corp. SPSS Inc. (2011). IMB SPSS Sstatistics (v.20). United States: SPSS, Inc. [ Links ]
40. Large, M. M., Ryan, C. J., Callaghan, S., Paton, M. B., & Singh, S. P. (2014). Can violence risk assessment really assist in clinical decisionmaking? The Australian and New Zealand Journal of Psychiatry, 48, 286-288. http://dx.doi.org/10.1177/0004867413498275. [ Links ]
41. León-Mayer, E. (2012). La psicopatía en prisioneros chilenos: prevalencia y métodos de evaluación (Psychopathy in Chilean prisoners: prevalence and assessment methods) (PhD dissertation). National University of La Plata, La Plata, Argentina. Retrieved from http://hdl.handle.net/10915/25394. [ Links ]
42. León-Mayer, E., Asún Salazar, D., & Folino, J. O. (2010). Confiabilidad y validez de la versión chilena de la Hare PCL-R (Reliability and validity of the Hare PCLR Chilean version). Revista Facultad de Medicina de La Universidad Nacional de Colombia, 58, 103-114. [ Links ]
43. León-Mayer, E., Cortés Olavarría, M. S., & Folino, J. O. (2014). Descripción multidimensional de población carcelaria chilena (Multidimensional description of Chilean prison population). Psicoperspectivas, 13, 68-81. [ Links ]
44. León-Mayer, E., Neuman, C., Hare, R. R., & Folino, J. O. (2013). Aproximación diagnóstica de psicopatía mediante instrumento autoinformado (Psychopathy diagnostic approach with a self reported instrument). Revista Criminalidad, 55, 251-264. [ Links ]
45. Looman, J., & Abracen, J. (2010). Comparison of measures of risk for recidivism in sexual offenders. Journal of Interpersonal Violence, 25, 791-807. http://dx.doi.org/10.1177/0886260509336961. [ Links ]
46. Lund, C., Hofvander, B., Forsman, A., Anckarsäter, H., & Nilsson, T. (2013). Violent criminal recidivism in mentally disordered offenders: a follow-up study of 13-20 years through different sanctions. International Journal of Law and Psychiatry, 36, 250-257. http://dx.doi.org/10.1016/j.ijlp.2013.04.015. [ Links ]
47. Monahan, J. (1981a). Predicting violent behaviour: An assessment of the clinical techniques. Beverly Hills, CA: Sage. [ Links ]
48. Monahan, J. (1981b). The clinical prediction of violent behavior. Rockville, MD: National Institute of Mental Health. [ Links ]
49. Monahan, J., & Steadman, H. (1994). Violence and Mental Disorder - Developments in Risk Assessment. Chicago: The University of Chicago Press. [ Links ]
50. Monahan, J., Steadman, H. J., Appelbaum, P. S., Robbins, P. C., Mulvey, E. P., Silver, E., & Grisso, T. (2000). Developing a clinically useful actuarial tool for assessing violence risk. British Journal of Psychiatry, 176, 312-319. [ Links ]
51. Ochoa-Rosales, M. (2007). Factores de riesgo en la población carcelaria del Cantón Cuenca Ecuador (Risk factors of the prison population in Cuenca district, Ecuador) (Ms Cs dissertation). La Plata, Argentina: National University of La Plata. [ Links ]
52. Quinsey, V. L., Harris, G. T., Rice, M. E., & Cormier, C. A. (1999). Violent Offenders - Appraising and Managing Risk (3rd. ed.). Washington: American Psychological Association. [ Links ]
53. Quinsey, V. L., Harris, G. T., Rice, M. E., & Cormier, C. A. (2006). Violent Offenders: Appraising and Managing Risk (2nd Edition). Washington DC: American Psychological Association. [ Links ]
54. Quinsey, V. L., & Lalumière, M. L. (1995). Psychopathy is a nonarbitrary class. Behavioral and Brain Sciences, 18, 571. http://dx.doi.org/10.1017/S0140525X00039935. [ Links ]
55. Ragusa-Salerno, L. M., Ostermann, M., & Thomas, S. S. (2013). Does the LSI-R Have Utility for Sex Offenders? Criminal Justice and Behavior., http://dx.doi.org/10.1177/0093854813481667. [ Links ]
56. Rettenberger, M., Haubner-Maclean, T., & Eher, R. (2013). The contribution of age to the Static-99 risk assessment in a population-based prison sample of sexual offenders. Criminal Justice and Behavior, 40, 1413-1433. http://dx.doi.org/10.1177/0093854813492518. [ Links ]
57. Rice, M. E., Harris, G. T., & Quinsey, V. L. (2002). The appraisal of violence risk. Current Opinion in Psychiatry, 15, 589-593. http://dx.doi.org/10.1097/00001504-200211000-00005. [ Links ]
58. Rodríguez, F. J., Bringas, C., Rodríguez, L., López-Cepero, J., Pérez, B., & Estrada, C. (2011). Drug abuse and criminal family records in the criminal history of prisoners. The European Journal of Psychology Applied to Legal Context, 3, 89-105. [ Links ]
59. Ruiz, J. I. (2006). Adaptación de la escala PCL-R 20 para evaluación de rasgos psicopáticos en una muestra carcelaria (Adapted PCL-R 20 to assess psychopathic traits in prison sample). Avances en Medición, 4(1), 61-72. [ Links ]
60. Salekin, R., Rogers, R., & Sewell, K. (1996). A review and meta-analysis of the Psychopathy Checklist and Psychopathy Checklist-Revised: Predictive validity of dangerousness. Clinical Psychology: Science and Practice, 3, 203-215. http://dx.doi.org/10.1111/j.1468-2850.1996.tb00071.x. [ Links ]
61. Silver, J. M., & Yudofsky, S. C. (1991). The Overt Aggression Scale: Overview and Guiding Principles. Journal of Neuropsychiatry, 3, S22-S29. [ Links ]
62. Singh, J. P. (2013). Predictive validity performance indicators in violence risk assessment: A methodological primer. Behavioral Sciences and the Law, 31, 8-22. http://dx.doi.org/10.1002/bsl.2052. [ Links ]
63. Singh, J. P., Condemarín, C., & Folino, J. O. (2013). El uso de instrumentos de evaluación de riesgo de violencia en Argentina y Chile (The use of violence risk assessment instruments in Argentina and Chile). Revista Criminalidad, 55, 279-290. [ Links ]
64. Singh, J. P., Grann, M., & Fazel, S. (2011). A comparative study of violence risk assessment tools: a systematic review and metaregression analysis of 68 studies involving 25,980 participants. Clinical Psychology Review, 31, 499-513. http://dx.doi.org/10.1016/j.cpr.2010.11.009. [ Links ]
65. Steadman, H. J., Silver, E., Monahan, J., Appelbaum, P. S., Robbins, P. C., Mulvey, E. P., & Banks, S. (2000). A classification tree approach to the development of actuarial violence risk assessment tools. Law and Human Behavior, 24, 83-100. [ Links ]
66. Teitelbaum, P. (2010). Tasa basal de recidiva delictiva de los pacientes liberados post medida de seguridad del Instituto Psiquiátrico Forense de Porto Alegre, Brasil, en un período de 10 años (1994-2004) (Crime recidivism basal rate in released patients from the Forensic Psych) (Ms Cs dissertation). La Plata, Argentina: National University of La Plata. [ Links ]
67. Tejada, P. A., & Escobar-Córdoba, F. (2005). Inimputabilidad y riesgo de violencia (Non guilty by reason of insanity and risk of violence). Revista Colombiana de Psiquiatría, 34(Supl), 104S-115S. [ Links ]
68. Walters, G. D. (2003a). Predicting Criminal Justice Outcomes with the Psychopathy Checklist and Lifestyle Criminality Screening Form: A Meta-Analitic Comparison. Behavioral Sciences & the Law, 21, 89-102. http://dx.doi.org/10.1002/bsl.519. [ Links ]
69. Walters, G. D. (2003b). Predicting Institutional Adjustment and Recidivism With the Psychopathy Checklist Factor Scores: A Meta-Analysis. Law and Human Behavior, 27, 541-558. http://dx.doi.org/10.1023/A:1025490207678. [ Links ]
70. Webster, C. D., Douglas, K. S., Eaves, D., & Hart, S. D. (1997). HCR-20: Assessing Risk for Violence Version 2. Burnaby: Mental Health, Law, and Policy Institute, Simon Fraser University. [ Links ]
71. Yang, M., Wong, S. C. P., & Coid, J. (2010). The efficacy of violence prediction: a metaanalytic comparison of nine risk assessment tools. Psychological Bulletin, 136, 740-767. http://dx.doi.org/10.1037/a0020473. [ Links ]
72. Yudofsky, S. C., Silver, J. M., Jackson, W., Endicott, J., & Williams, D. (1986). The Overt Aggression Scale for the Objective Rating of Verbal and Physical Aggression. American Journal of Psychiatry, 143, 35–39. [ Links ]
73. Zhang, S. X., Roberts, R. E. L., & Farabee, D. (2011). An Analysis of Prisoner Reentry and Parole Risk Using COMPAS and Traditional Criminal History Measures. Crime & Delinquency, 60, 167–192. http://dx.doi.org/10.1177/0011128711426544 [ Links ]
]]>
Correspondence: Received: 31 March 2014
Received in revised form 8 November 2014
Accepted: 13 November 2014