SciELO - Scientific Electronic Library Online

 
vol.9 número1Prestar falsas declaraciones de delitos: la distinción entre alegaciones verdaderas y falsas de violaciónPredictores de la agresión sexual en adolescentes: dominancia de género vs. actitudes favorables hacia la violación índice de autoresíndice de materiabúsqueda de artículos
Home Pagelista alfabética de revistas  

Servicios Personalizados

Revista

Articulo

Indicadores

Links relacionados

  • En proceso de indezaciónCitado por Google
  • No hay articulos similaresSimilares en SciELO
  • En proceso de indezaciónSimilares en Google

Compartir


The European Journal of Psychology Applied to Legal Context

versión On-line ISSN 1989-4007versión impresa ISSN 1889-1861

The European Journal of Psychology Applied to Legal Context vol.9 no.1 Madrid ene./jun. 2017

https://dx.doi.org/10.1016/j.ejpal.2016.03.002 

Articles

Structured behavioral interview as a legal guarantee for ensuring equal employment opportunities for women: A meta-analysis

La entrevista conductual estructurada como garantía legal que asegura la igualdad de oportunidades laborales para la mujer: meta-análisis

Pamela Alonso1  , Silvia Moscoso1  , Jesús F. Salgado1 

1University of Santiago de Compostela, Spain

Abstract

Equal employment opportunities for women are a legal requirement in many legal environments, including the United States (US) and European Union (EU) legislations. In this context, indirect discrimination in the access to jobs is an illegal practice. For this reason, personnel selection procedures must be fair for protected-by-law groups. Specifically, gender discrimination is the focus of research on employment interviews. This article presents a meta-analysis of gender differences in the scores in structured behavioral interviews (SBI). A database was created consisting of studies conducted with real candidates and employees. Psychometric meta-analysis methods were applied. The results showed that the SBI is fair for women and men and does not show evidence of adverse impact and indirect discrimination. Implications for the practice of personnel selection are discussed and future research is suggested.

Keywords: Legal environment; Personnel selection; Behavioral interview; Meta-analysis; Adverse impact; Equal employment opportunities; Indirect discrimination

Resumen

La igualdad de oportunidades laborales para la mujer es un requisito legal en muchos marcos legales, como la legislación de Estados Unidos o de la Unión Europea. En este contexto, la discriminación indirecta en el acceso al trabajo es una práctica ilegal. Este es el motivo por el que los procedimientos de selección de personal deben ser justos para los grupos protegidos por ley. En concreto, la discriminación de género es el centro de investigación en las entrevistas de empleo. Este artículo presenta un metaanálisis de las diferencias de género en las puntuaciones de las entrevistas conductuales estructuradas (ECE). Se elaboró una base de datos compuesta de estudios realizados con aspirantes y empleados reales, aplicándose métodos metaanalíticos psicométricos. Los resultados indican que la ECE es justa para mujeres y hombres, no habiendo señales de efectos negativos ni de discriminación indirecta. Se comentan las consecuencias para la práctica en selección de personal, a la vez que se recomienda la necesidad de investigación futura.

Palabras clave: Marco legal; Selección de personal; Entrevista conductual; Metaanálisis; Efectos negativos; Igualdad de oportunidades laborales; Discriminación indirecta

In the domain of psychology applied to the legal context, litigation on employment discrimination is an area in which Industrial, Work and Organizational (IWO) psychologists are frequently required as expert witnesses (Borgida & Kim, 2007; Cascio, 2007; Gutek, 2007; Landy, 2005; Thornton III & Wingate, 2005) in order to testify whether or not adverse impact and sex discrimination has happened (Glick & Fiske, 2007; Gutek & Stockdale, 2005; Gutman, 2005). Typically, sex discrimination occurs when a woman receives unfair treatment in the workplace because of gender. The unfair treatment can occur, for instance, in terms of hiring, firing, layoffs, compensation level, job assignments, progress and promotion, and other terms and conditions of employment (Crosby & Sctockdale, 2007). However, as Sackett et al. (2010) pointed out in their review of the perspectives from twenty-two countries on the legal environment in relation to personnel selection, the legal context determines how IWO psychologists can approach to making an a priori case of discrimination. The influence of the legal context is especially relevant in the United States (US) and the countries of the European Union (EU).

In the US, the prohibition of employment discrimination was established in the Title VII of the 1964 Civil Rights Act. This act prohibits employment discrimination based on race, color, religion, sex, or national origin. According to Outtz (2005), race cases differ little from sex, religion, and national cases in terms of the legal elements involved.

In the EU, legally ensuring and warranting equal opportunities for men and women in all domains (i.e., social, political, economic, legal, and so on) has been one of the major challenges since the beginning (Hanges & Feinberg, 2010). Equality between men and women is a fundamental value of the EU, as mentioned in articles 2 and 3 of the Treaty on EU (Council of the European Union, 2015), in articles 8, 153, and 157 of the Treaty on the Functioning of the EU (Council of the European Union, 2015), and in articles 21 and 23 of the Charter of Fundamental Rights of the EU (European Union, 2012). Since its foundation, the EU has also adopted an important number of norms and acts that constitute the main basis of its policy of equality, among others, Directive 2000/78/EC (Council of the European Union, 2000), Directive 2002/73/EC (European Parliament & the Council, 2002), Directive 2006/54/EC (European Parliament & the Council, 2006) and Directive 2010/41/EU (European Parliament & the Council, 2010).

Moreover, in March 2010, the European Union Commission (EUC) adopted the Women's Charter (European Union Commission, 2010). In this Charter, the EUC renewed the commitment for equality between genders and insisted on the need to include equality between women and men in all its policies in a transversal way. On the other hand, the Council of the EU adopted a European Pact for gender equality for the period 2011-2020 (Council of the European Union, 2011). In this Pact, the Council proposes that the states and the European Union, among other things, adopt measures to close gender gaps at work and to promote a better work-life balance for women and men.

Equal opportunities are particularly relevant in the labor environment, in which findings of recently published studies showed women to be disadvantaged, both in terms of the job level to which they have access, and their working conditions (Bastida & Moscoso, 2015; Bettio & Verashchagina, 2014; Instituto de la Mujer, 2014; Instituto Nacional de Estadística, 2014; Morel, Palier, & Palme, 2012). In this context, to ensure and guarantee equal employment opportunities to women in relation to employment access is one of the keys to reducing this situation of inequality between genders. In this regard, a crucial issue is to know whether the procedures (e.g., tests, interviews, inventories, reference checks, and so on) used by organizations to attract and select future employees are legally sound.

Adverse Impact and Types of Discrimination in the Access to Employment according to the Legislation

From a legal point of view, with regard to the access to employment, the concepts of adverse impact and discrimination must be taken into account from a perspective of equal employment opportunities. On occasions, it can produce systematic differences in the candidate assessments of a protected-by-law group during the hiring processes. This phenomenon is named adverse impact and is independent of whether such differences can be considered as discriminatory or not. In itself, adverse impact is a neutral term, which reflects simply the possibility that an injustice against a particular social group can occur. With this in mind, it is necessary to take into account that a selection procedure (e.g., test, interview, and so on) is not biased and unfair because the members of the different subgroups simply obtain lower average scores than the majority group. In other words, when a selection instrument is used and produces adverse impact, it is not necessarily the case that this is discrimination (Aramburu-Zabala, 2001). It would be unfair discrimination when the members of a minority group obtain lower scores in the selection procedures but at the same time there are no group differences in their job performance scores (Arvey, 1979).

Discrimination can be of two types. On one hand, there is direct discrimination when the selection process treats an individual in a less favorable way because he/she is a member of a specific social group (e.g., women, immigrants, blacks, Latin-Americans, and so on). Therefore, this type of discrimination is the most obvious and is produced by the intention of the employer to discriminate against the members of social groups protected by law. On the other hand, there is indirect discrimination when an employer uses a selection procedure that, apparently, is neutral, but in which the members of a protected-by-law group (e.g., women) obtain systematically worst results in it, regardless of their job performance. Indirect discrimination is typically not intentional and more difficult to prove than direct discrimination.

In this respect, European laws, similarly to US laws, demand that the selection procedures that produce adverse impact must fulfill two requirements in order to be used without an accusation of indirect discrimination: (1) to be valid (i.e., that the procedure can predict future job performance), and (2) to be suitable (i.e., that there is no other similar procedure with equal or greater validity and that does not produce adverse impact). In this case, there would be a non-discriminatory adverse impact. However, if these two requirements are not fulfilled, the use of a procedure with adverse impact would be considered as discriminatory (Alonso, 2011; Aramburu-Zabala, 2001).

Personnel Selection Interviews

Organizations have a large number of tools for selecting their employees. These tools not only produce different results regarding the quality of the selection process (e.g., in terms of reliability, predictive validity, and economic utility) but also could produce different results depending on the gender of the participants (Alonso, Táuriz, & Choragwicka, 2009; Aramburu-Zabala, 2001; Arvey, 1979; Hough, Oswald, & Ployhart, 2001). This article will be focused on the employment interview, as this is the most common procedure for hiring personnel (Salgado, Ones, & Viswesvaran, 2001).

Comparing all the procedures that can be used for personnel selection, the most current findings show that the employment interview is probably the most important technique, both in terms of the frequency of its use and its relevance for making decisions (Huffcutt, Culbertson, & Weyhrauch, 2013; Salgado & Moscoso, 2011). This finding has been confirmed across the world. For instance, Clark (1993) concluded that the unstructured interview was the instrument most used by companies from France, Germany, Italy, and United Kingdom. Shackleton and Newell (1994) found a similar result in another sample of companies of United Kingdom, France, Belgium, Germany, and Italy. Five years later, Ryan, McFarland, Baron, and Page (1999), in a study consisting of 959 organizations from 20 countries of the five continents, found that the interview was the most used procedure.

The results of the most recent studies on this issue concur with the previous findings. Similar results were found in New Zealand (Taylor, Keelty, & McDonnell, 2002), in Brazil (Pereira, Primi, & Cobêro, 2003), in United Kingdom (The Chartered Institute of Personnel and Development, 2004, 2011) and in Spain (Alonso, Moscoso, & Cuadrado, 2015), among other countries. However, Salgado and Moscoso (2002) have pointed out that interviews can be classified according to the content and the degree of structure. Content and structure factors have a tremendous impact on the psychometric properties of the interviews, but their results concerning the potential discrimination based on gender have not been sufficiently studied.

Salgado and Moscoso (2002, 2006), taking into account the type of question included in the employment interviews, have classified this procedure in two categories: conventional interviews (CI) and structured behavioral interviews (SBI). CI includes many different types of questions, mainly about credentials, achievements, biographical facts, technical knowledge, and self-evaluative information. Interviewers that use CI consider this type of questions necessary to assess the candidate. On the other hand, SBI mainly have questions focused on the behavior of the candidates in past situations similar to the situations that the new employee will be involved in the new job.

In comparing these two categories of employment interviews, SBI showed better empirical support in terms of reliability and predictive validity (Choragwicka & Moscoso, 2007; Conway, Jako & Goodman, 1995; Huffcutt et al., 2013; Moscoso & Salgado, 2001; Motowidlo et al., 1992; Saez, 2007; Salgado & Moscoso, 1995; Salgado & Moscoso, 2006; Salgado & Moscoso, 2011; Salgado, Moscoso, & Gorriti, 2004; Salgado, Gorriti, & Moscoso, 2007). The SBI focuses on assessing the real behavior in the past, asking candidates to describe what they have done in similar situations to the ones that can occur in the future job (Janz, 1982; Moscoso, Gorriti, & Salgado, 2007; Motowidlo et al., 1992; Salgado, 1995; Salgado & Moscoso, 1995; Salgado & Moscoso, 2011). Moreover, Janz, Hellervik, and Gilmore (1986) pointed out that the more recent and frequent the behavior, the more valid the interview.

The SBI can be defined by the following characteristics (Motowidlo et al., 1992; Moscoso et al., 2007; Salgado, 1995; Salgado & Moscoso, 1995, 2011): (1) it is based on the results of a job analysis, typically done with the critical incident technique, in order to identify the requirements of knowledge, ability, skill, and other important competencies for a good job performance; (2) it is composed of standardized questions about the behavior of the interviewee in similar past situations in order to permit the assessment of the applicant in relation to a specific competency which is considered relevant for the job; (3) the interviewer asks some questions to find out some details about the situation, interviewee behavior, and outcomes; (4) the interviewer can record the interview or take notes; (5) after asking all the questions, the interviewer reviews the recording or the notes and assesses the candidate using behaviorally-anchored rating scales (BARS); (6) the evaluations of the different job dimensions are averaged to calculate the overall score in the interview; (7) the same process is done with all the candidates; and (8) the hiring decision is made after all the interviews are done.

With regard to the psychometric properties of SBI, several meta-analyses have found that it is one of the selection procedures with the largest coefficients of reliability and validity, improving the results obtained by other interview types, especially unstructured interviews (Conway et al., 1995; Huffcutt & Arthur, 1994; Huffcutt et al., 2013; Salgado & Moscoso, 1995; Wiesner & Cronshaw, 1988). Specifically, Salgado and Moscoso (2006), summarizing and grouping the meta-analyses by Salgado and Moscoso (1995), McDaniel, Whetzel, Schmidt, and Maurer (1994), and Huffcutt and Arthur (1994), obtained an operative validity coefficient of .64 for predicting job performance.

In spite of its psychometric properties, that make SBI one of the most powerful instruments for personnel selection (Salgado & Moscoso, 2008; Schmidt & Hunter, 1998), it is one of the types of interview least used by organizations (Alonso et al., 2015). Some practical reasons can explain the low usage of SBI. The first reason is that SBI requires that interviewers (and assessors) have previous training in this technique. A second reason is that the development and application of SBI is more expensive than other interviews (e.g., unstructured interviews) (Salgado & Moscoso, 2011). Furthermore, its generalizability is smaller due to the fact that it is based on a job analysis and, consequently, it only can be applied to jobs with similar dimensions. Unstructured and structured conventional interviews can be used in practically all types of jobs with some changes to the questions.

Despite these difficulties, the findings regarding the psychometric properties of SBI and the studies on its economic utility (Salgado, 2007) recommend and support the use of this technique in comparison with other interview types. Further support for SBI would come from the evidence that the use of SBI guarantees that there is no negative discrimination against women in the hiring processes. This point will be reviewed in the next section.

Empirical Evidence on Indirect Discrimination towards Women in the Structured Behavioral Interview

There are at present a very small number of literature reviews on the potential adverse impact and discrimination against women in the employment interview. The first review, qualitative in nature, was carried out by Arvey (1979), who concluded that, on average, women received lower scores than men. A relevant characteristic of this review is that a large majority of the interviews analyzed were unstructured interviews and some of them were simulations. Nevertheless, Arvey's (1979) review posited the possibility that the most used instrument for making personnel decisions could negatively discriminate against women in a systematic way.

Two decades later, Moscoso (2000), in her review of the research on the selection interview, concluded that, in general, interviews produced less adverse impact than other selection procedures (e.g., ability tests) and that the smaller adverse impact of the interviews could be reduced with the use of SBI. Moscoso (2000) pointed out that research on this topic was very scarce at that time. Huffcutt, Conway, Roth, and Stone (2001) carried out the first meta-analysis on the adverse impact of interviews, finding that there were slight (and practically irrelevant) differences between men and women in the overall scores in the interview (d = 0.06). In this study, analyzing the interviews according to the structure degree, Huffcutt et al. (2001) found that the structured interviews did not produce differences. However, unstructured interviews and low-structured interviews produced small differences (d = 0.23) against women.

A decade later, Alonso (2011) conducted a meta-analysis to determine whether structured interviews produced adverse impact against women. Her results showed that SBI produced practically no gender differences. More recently, Levashina, Hartwell, Morgeson, and Campion (2014) found that men and women obtained the same average scores in structured interviews. This research was conducted with 9 studies, including experimental samples and field samples.

However, the three meta-analytic reviews have a series of limitations that suggest that a new meta-analysis is needed. Firstly, the number of individual studies is very small. Secondly, some samples were obtained in experimental contexts, in which the candidates were simulated (hypothetical ones). Thirdly, neither Huffcutt et al. (2001) nor Levashina et al. (2014) carried out a specific meta-analysis of SBI. Finally, even though Alonso's (2011) meta-analysis provides results for the SBI, a large majority of the total sample came from only two studies. Consequently, the findings might be conditioned by the specific characteristics of these two samples.

Therefore, the goal of the current study is to extend the previous research (and specifically the meta-analysis by Alonso, 2011) in order to provide more robust findings, to confirm or reject whether the SBI is legally fair for women and, consequently, guarantees their access to employment in equal conditions to men. On the basis of the previous findings, we advance the following hypothesis:

Hypothesis

The structured behavioral interview does not produce adverse impact against women.

Method

Literature Search and Coding Studies

The objective of the search was to find the largest number of studies on the relationship between interviewee's gender and score in the SBI in a real context of personnel selection. Therefore, in order to be included in this meta-analysis, studies had to fulfill the following conditions: (1) that it included the effect size of the gender on the interview score or the information to calculate it (e.g., Ns, means, and SDs, correlation between sex and interview score, etc.), (2) that the goal of the interview was to assess the fit of an employee to a specific job or to assess his/her potential suitability, and (3) that the study was not a simulation (i.e., real employees or candidates were assessed). To cover the literature on the relationship between interview and gender as exhaustively as possible and to prevent any bias in the inclusion of studies, we adopted a series of search strategies. First, a computer-based search was conducted in a large number of databases, including Google Scholar, Medline, ProQuest Dissertations & Theses, PsycInfo, SAGE, Teseo, Web of Science, and Wiley Online Library. Several single keywords and combination of keywords were used, including, on one hand, selection interview, employment interview, job interview, interview success, interview ratings, interview performance or hiring recommendations and, on the other hand, sex, gender, sex adverse impact, gender adverse impact, and sex or gender differences. Second, a manual article-by-article search of the articles published between 1975 and 2014 was carried out in a number of top-tier journals, including Academy of Management Journal, European Journal of Work and Organizational Psychology, Human Performance, International Journal of Applied Psychology, International Journal of Selection and Assessment, International Journal of Human Resources Management, Journal of Applied Psychology, Journal of Applied Social Psychology, Journal of Business and Psychology, Journal of Occupational and Organizational Psychology, Journal of Occupational Behavior, Journal of Organizational Behavior, Journal of Social Psychology, Journal of Work and Organizational Psychology, Organizational Behavior and Human Decision Processes, Organizational Psychology Review, Personnel Psychology, Psychological Bulletin, and Sex Roles. Third, the reference section of the articles and the meta-analyses on the topic were reviewed to find articles not identified with the previous strategies. Fourth, we contacted several researchers and asked for both published and unpublished papers on the gender and interview relationships.

By means of these four strategies we were able to create an initial database of 36 studies. However, some of the studies were excluded for the following reasons: (a) the interview was not an SBI; (b) the study reported that there were no differences between men and women, but it did not provide information to estimate the effect size; and (c) the study reported the differences that were statistically significant in some dimensions, but did not report the differences that were not statistically significant. Consequently, we finally obtained 15 studies (with 19 independent samples) to be used in the meta-analysis, of which ten were articles, four were doctoral dissertations, and one unpublished manuscript (see Appendix for complete information). This number of studies is especially relevant when compared with Alonso's (2011) meta-analysis, the largest prior study on this issue, which used only seven studies.

The information of the studies was coded according to the guidelines of the American Psychological Association (APA, 2009). The database included the following information: (a) article reference: authors, year, journal; (b) sample characteristics (selection or promotion, job, country of the study, if the sample were students, applicants or incumbents); criterion measure; interview scores, ratio of accepted and rejected; invitation to a second interview; hiring proposal, research design, etc.; (c) interview reliability: internal consistency and inter-rater coefficient; (d) value of range restriction, u, or, information to estimate it (e.g., proportion of men and women in the initial and final samples); (e) effect size or data to estimate it (e.g., sample size, mean and SD of women and men; correlation between interview and gender; F, t, and so on).

Estimation of Effect Sizes

Having completed the data base, we obtained an effect size coefficient for each independent sample. Based on the suggestion by Schmidt and Hunter (2014); see also Magnusson, 1977), point-biserial correlation coefficients were corrected for attenuation due to the fact that one variable is continuous and another is dichotomized. When the proportion of cases is the same in both groups, then the point-biserial correlation is 80% of the true correlation. Next, these effect sizes were transformed into Cohen's d. Finally, we corrected the sign of the effect sizes taking into account that a negative sign would mean a favorable result for women and a positive sign would mean that the results were favorable to men.

SBI Inter-rater Reliability

From a personnel selection point of view, the most relevant reliability coefficient is an inter-rater coefficient (Salgado & Moscoso, 1995, Schmidt & Hunter, 1996; Schmidt, Le & Ilies, 2003), because this coefficient controls for the majority of the measurement error sources. In the current meta-analysis, several studies do not provide information on the interview interrater reliability. Therefore, we developed an empirical distribution based on the coefficient included in the studies.

The average interrater reliability of the SBI appears in Table 1, firstly the average interrater reliability obtained with the totality of studies included in the meta-analysis, and next, the average interrater obtained if the largest sample is not included. In addition, Table 1 also reports the interrater coefficients found in the prior meta-analysis on this topic (i.e., McDaniel et al., 1994; Salgado & Moscoso, 1995; Salgado et al., 2004; Taylor & Small, 2002).

Table 1 Inter-rater Reliability Coefficients of SBI in this Research Study and in the Previous Meta-analysis. 

Note. K = number of interrater coefficients; r xx = average interrater reliability; SDr = standard deviation of interrater reliability.

Range Restriction of SBI scores

In order to check if the interview scores were affected by range restriction, we compared the initial proportion of women and men with the final proportion included in each study. According to this criterion, a smaller proportion of women in the final sample with respect to the initial sample would mean that there was range restriction.

Table 2 reports the frequency of the range restriction values found in the studies included in this meta-analysis. As we can see, there is a compensation effect, so that the average u is .999. Therefore, it can be considered that there is no range restriction in the final sample.

Table 2 Frequency of the Range Restriction Values in this Meta-analysis. 

u Frequency
0.840 1
0.870 1
1.000 14
1.270 1
M: 0.999
SD: 0.084

Note. U = value of range restriction; M = mean; SD = standard deviation.

Lastly, we conducted a psychometric meta-analysis using the software package developed by Schmidt and Le (2004), based on the meta-analysis methods of Schmidt and Hunter (2014). Psychometric meta-analysis estimates the amount of the observed variance that is due to artifactual errors. In the current meta-analysis, the artifactual errors taken into account were sampling error, interview reliability, and gender range restriction.

Among the samples included in the meta-analysis, there are two studies with a total sample larger than 10,000 individuals (McCarthy, Van Iddekinge, & Campion, 2010; Sacco, Scheu, Ryan, & Schmitt, 2003). This characteristic makes them very different from the rest of samples of the meta-analysis. Considering that the two samples comprise 30,320 subjects, i.e., 88.8% of the total sample, we conducted the meta-analysis twice, once with the total sample size and the second time excluding these two large samples. In this way, we were able to examine if these large-sample studies determined the average effect size.

Results

Table 3 presents the meta-analytic results of the differences between men and women in the SBI. The results of the meta-analysis conducted with all the studies and samples appear in the first row and the results of the meta-analysis carried out without the two largest samples appear in the second row.

Table 3 Results of the Meta-analysis of the Differences between Men and Women in the SBI Scores. 

K N S 2 d S 2 ART %VE δ cy SD δ 90% VC δ
All studies 19 34,130 −0.14 0.0195 0.0023 11.63 -0.16 0.15 .03
Without large-sample studies 17 3,838 −0.11 0.0446 0.0180 40.43 -0.13 0.19 .11

Note. The correlation with a negative sign means a lower score in the group of men; K = number of studies; N = sample size; d̅ = average effect size weighted by sample size; S 2 d = observed variance; S 2 ART = variance accounted for by artifactual errors; %VE = percentage of observed variance accounted for by artifactual errors; δ cy= corrected effect size; SD δ = standard deviation of the corrected effect size; 90% VCδ = 90% credibility value.

From left to right, the first column shows the number of effect size coefficients (K), the second column shows the total simple size (N), the third column is the average effect size weighted by simple size (Cohen's d), and the fourth column shows the observed variance of the observed effect size (S 2 d). The two columns that follow show the sampling error variance (S 2 ART) and the percentage of variance explained by the artifactual errors. Finally, the three last columns show the corrected effect size (δcy), the standard deviation of the corrected effect size (SDδcy), and the 90% credibility value (90%CV).

The findings show that the effect size of the difference of the SBI scores of women and men is small (Cohen, 1977), but favorable to women. The meta-analysis conducted with the total sample size reports a d = -0.16 (K = 19, N = 34,130). The percentage of observed variance accounted for by the artifactual errors was 11.63% and the 90% credibility value was .03, which includes zero as a potential value.

When the meta-analysis was conducted without the coefficients of the two largest simples, the corrected average effect size was similar to the previous one. More specifically, we found a Cohen's d of -0.13, the percentage of explained variance accounted for by artifactual errors was 40.43% and the 90% credibility value was .11, which included 0. Taking into account these findings, we can affirm that the conclusions are the same as with the whole database. In other words, the differences between the scores obtained by women and men in the SBI are very small and practically irrelevant.

In summary, the results support the hypothesis stated, and they agree with the results previously found by Alonso (2011), who had found that when candidates are evaluated with the SBI, it does not produce adverse impact against women. Therefore, the SBI guarantees their access to employment in equal conditions to men.

Discussion

This study has found that the use of the SBI does not show relevant differences in the interview scores received by men and women. This fact implies that the SBI does not produce adverse impact against women. Therefore, it can be said that the use of this tool can help to ensure that women are not indirectly discriminated against during the recruitment process.

This research has contributed to the literature in several ways. First, the most relevant contribution is that the results serve as evidence that the SBI is not biased against women (i.e., there is no adverse impact evidence) and that the SBI does not indirectly discriminate against women. This is a relevant contribution given that, as was mentioned before, facing a possible discrimination lawsuit, the US and European regulation establish that, in relation to burden of proof (see as an example the Directive 2006/54/EC; European Parliament & the Council, 2006), the defendant has to prove that the tool used does not produce that effect. Second, the results suggest that companies have an additional reason to opt for the use of the SBI. Although the selection interview is the tool most used by organizations worldwide to recruit employees, the most widely used interview type, i.e., the unstructured interview, is not the most appropriate from the evidence available (Alonso et al., 2015). The extent of the use of SBI in organizations is lower than that of the conventional interview, despite the fact that it is already known to be one of the best interviews, as demonstrated by its psychometric properties. Now, we also know that its use does not produce adverse impact against women. Therefore, the results of this meta-analysis can be used by organizations as evidence in the case of lawsuits. This is an important additional reason why the use of this tool should be increased to the detriment of other types of interview.

Practical Implications of the Findings and Suggestions for Future Research

The findings have implications for the practice of human resource management. In Europe and in other countries (e.g., US, Canada), surveys continue to show that women are disadvantaged in comparison to men in the labor market. This disadvantage is particularly observed in the great difficulty women experience in accessing management positions, especially at the highest levels, which are occupied mostly by men (Bastida & Moscoso, 2015; Catalyst, 2000, 2016).

At the level of labor market entry, data published by Eurostat (2015) reveal a remarkable increase in the proportion of women in employment in the EU-28. However, comparing rates for men and women, the percentage of men was consistently higher across all of the EU-28 Member States in 2014. Moreover, there are also important differences in the conditions under which women access employment. For example, data shows that women are employed in part-time work to a much higher proportion than men (Eurostat, 2015). In the US, the percentage of the women in the labor market is quite similar to men (United States Equal Employment Opportunities Commission, 2016). However, there are bigger differences in rates when the data are analyzed by hierarchical level, as women remain underrepresented among leaders and top earners in several fields (Stone, 2013; United States Equal Employment Opportunities Commission, 2016).

Despite the EEO legislation, as Burke and Major (2014) have pointed out, talented women continue to have difficulty advancing their careers worldwide. They face multiple barriers in their advancement in organizations (Bastida & Moscoso, 2015). For example, Stone (2013) indicated that women make up only 14 percent of executive officers and 8 percent of top earners at Fortune 500 firms in the US. Furthermore, a recently published study by Catalyst (2016), conducted with a sample of 1,660 business school graduates, concluded that men get more of the critical assignments that lead to advancement in their professional careers than women. Specifically, men's projects had budgets twice as big as women's and with three times as many staff members. Taken together, the studies cited suggest that women's access to employment and executive jobs continues to be an unresolved difficulty. A potential explanatory variable for the above mentioned differences is the kind of assessment procedures used during the selection process, as some of them can produce gender discrimination (Gutek & Stockdale, 2005; Tippins, 2010).

Taking into account that the interview is the most used tool for selection and that it has the largest influence on the hiring decision (Alonso et al., 2015), the findings of this study are relevant because they demonstrate that the use of SBI can help to reduce the problem of discrimination against women in the labor market. In short, in addition to the advantages that this tool offers to the company, i.e., validity and economic utility, its use would also contribute to improving the situation of women in the labor market, facilitating their incorporation on equal terms with men. Future research should verify if these results are being taken on board by practitioners, so that the existing gap between researchers and managers of human resources is reduced (Anderson, Herriot, & Hodkingson, 2001). In other words, it would be interesting to discover whether there has been an increase in the use of the tools that have more empirical support and produce less adverse impact. Specifically, in connection with this investigation, researchers should be interested in checking whether indeed the increased use of SBI by organizations around the world is being found.

Limitations of this Research

The current research has some limitations that should be noticed by readers. A first limitation is that, despite the fact that the total sample is very large (over 34,000 individuals), the number of European studies is relatively small. Cultural differences and different laws could affect the results. Therefore, we suggest updating the meta-analysis when the number of new studies from European countries is enlarged. A second limitation is that the number of different jobs and occupations is small too. The level of job complexity has been found to have an important impact on the validity of employment interviews (Huffcutt, Conway, Roth, & Klehe, 2004). It could be of interest to examine if job complexity also affects adverse impact. Finally, within the same job complexity level, gender stereotypes could affect the results because jobs considered primarily masculine could be related with lower scores for women (Arvey, 1979; Posthuma, Morgeson, & Campion, 2002).

In summary, this research demonstrates that the SBI does not produce adverse impact against women. Consequently, practitioners of human resource management and personnel selection should be aware of the benefits of using the SBI in the hiring processes for three reasons: firstly, the SBI has larger reliability and validity than any other type of interview. Secondly, the SBI is perceived favorably by the applicants. Finally, now we have the evidence to affirm that the SBI contributes to guaranteeing equal employment opportunities for women and men.

References1

Alonso, P. (2011). ¿Producen Resultado Adverso de Género las Entrevistas Estructuradas de Selección de Personal? [Do Structured Selection Interviews Have a Gender Adverse Impact?]. Revista de Psicología del Trabajo y de las Organizaciones, 27, 43-53. [ Links ]

* Alonso, P., Cuadrado, D., Salgado, J. F., & Moscoso, M. (2014). Las entrevistas en el Assessment Center de Desarrollo [The interview in the Development Assessment Center] (Unpublished). Grupo de Investigación en Recursos Humanos y Rendimiento. Universidad de Santiago de Compostela. [ Links ]

Alonso, P., Moscoso, S., & Cuadrado, D. (2015). Personnel selection procedures in Spanish small and medium size organizations. Revista de Psicología del Trabajo y de las Organizaciones, 31, 79-89. http://dx.doi.org/10.1016/j.rpto.2015.04.002Links ]

Alonso, P., Táuriz, G., & Choragwicka, B. (2009). Valoraciones de méritos (Training and experience) en la Administración Pública y la empresa: fiabilidad, validez y discriminación de género [Merit Ratings -Taining and Experience - in the Public Administration and Industry]. Revista de Psicología del Trabajo y de las Organizaciones, 25, 245-258. [ Links ]

American Psychological Association. (2009). Publication Manual of the American Psychological Association (6th ed). Washington, DC: American Psychological Association. [ Links ]

Anderson, N., Herriot, P., & Hodgkinson, G. P. (2001). The practitioner-researcher divide in Industrial, Work and Organizational (IWO) psychology: Where are we now, and where do we go from here? Journal of Occupational and Organizational Psychology, 74, 391-411. http://dx.doi.org/10.1348/096317901167451Links ]

Aramburu-Zabala, L. (2001). Adverse impact in personnel selection: The legal framework and test bias. European Psychologist, 6, 103-111. http://dx.doi.org/10.1027//1016-9040.6.2.103Links ]

Arvey, R. D. (1979). Unfair discrimination in the employment interview: legal and psychological aspects. Psychological Bulletin, 86, 736-765. http://dx.doi.org/10.1037/0033-2909.86.4.736Links ]

* Barrick, M. R., Swider, B. W., & Stewart, G. L. (2010). Initial evaluations in the interview: relationships with subsequent interviewer evaluations and employment offers. Journal of Applied Psychology, 95, 1163-1172. http://dx.doi.org/10.1037/a0019918Links ]

Bastida, M., & Moscoso, S. (2015). Steel barrier: Legal implications from a gender equal opportunity perspective. The European Journal of Psychology Applied to Legal Context, 7, 11-20. http://dx.doi.org/10.1016/j.ejpal.2014.11.004Links ]

* Berges, A. (2010). Validación de procedimientos de selección de personal en la policía local [Validation of recruitment procedures in local police] (unpublished doctoral dissertation). Universidad de Zaragoza, Spain. [ Links ]

Bettio, F., & Verashchagina, A. (2014). Women and men in the ‘Great European Recession’. In M. Karamessini, & J. Rubery (Eds.), Women and austerity: The economic crisis and the future for gender equality. Abingdon, Oxford, UK: Routledge. [ Links ]

Borgida, E., & Kim, A. (2007). Reflections on being an expert witness in class action sex discrimination litigation. In F. J. Crosby, M. S. Stockdale, & S. A. Roop (Eds.), Sex discrimination in the workplace (pp. 117-130). Malden, MA: Blackwell Publishing. [ Links ]

Burke, R. J., & Major, D. A. (2014). Advancing women’s careers: why men matter. In R. J. Burke & D. A. Major (Eds.), Gender in Organizations: Are Men Allies or Adversaries to Women’s Career Advancement? (pp. 11-53). Northampton, MA: Edward Elgar. [ Links ]

Cascio, W. F. (2007). Sex discrimination in the workplace: Lessons from two highprofile cases. In F. J. Crosby, M. S. Stockdale, & S. A. Roop (Eds.), Sex discrimination in the workplace (pp. 143-152). Malden, MA: Blackwell Publishing. [ Links ]

Catalyst (2000). Women and the M.B.A.: The Gateway to Opportunity. Retrieved from http://www.catalyst.org/system/files/women_and_the_mba_gateway_to_opportunity.pdfLinks ]

Catalyst (2016). Women CEOs of the S&P 500. Retrieved from http://www.catalyst.org/knowledge/women-ceos-sp-500Links ]

Choragwicka, B., & Moscoso, S. (2007). Validez de contenido de una Entrevista Conductual Estructurada [Content validity of a Behavioral Structured Interview]. Revista de Psicología del Trabajo y de las Organizaciones, 23, 75-92. [ Links ]

Clark, T. (1993). Selection methods used by executive search consultancies in four European countries: A survey and critique. International Journal of Selection and Assessment, 1, 41-49. http://dx.doi.org/10.1111/j.1468-2389.1993.tb00082.xLinks ]

Cohen, J. (1977). Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc. [ Links ]

Conway, J. M., Jako, R. A., & Goodman, D. F. (1995). A meta-Analysis of interrater and internal consistency reliability of selection interviews. Journal of Applied Psychology, 80, 565-579. http://dx.doi.org/10.1037/0021-9010.80.5.565Links ]

Council of the European Union (2000). Council Directive 2000/78/EC of 27 November 2000 establishing a general framework for equal treatment in employment and occupation. Official Journal of the European Union, L303, 0016-0022. Retrieved from http://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:32000L0078&qid=1458047615905&from=ENLinks ]

Council of the European Union (2011). Council conclusions on the European Pact for gender equality for the period 2011-2020. Retrieved from http://www.consilium.europa.eu/uedocs/cms_data/docs/pressdata/en/lsa/119628.pdfLinks ]

Council of the European Union (2015). Consolidated versions of the Treaty on European Union and the Treaty on the Functioning of the European Union and the Charter of Fundamental Rights of the European Union. Retrieved from: http://data.consilium.europa.eu/doc/document/ST-6655-2008-REV-8/en/pdfLinks ]

Crosby, J. M., & Sctockdale, M. S. (2007). Introduction: Understanding sex discrimination. In F. J. Crosby, M. S. Stockdale, & S. A. Roop (Eds.), Sex discrimination in the workplace (pp. 3-6). Malden, MA: Blackwell Publishing. [ Links ]

* Soete, B. de, Lievens, F., Oostrom, J., & Westerveld, L. (2013). Alternative predictors for dealing with the diversity-validity dilemma in personnel selection: the constructed response multimedia test. International Journal of Selection and Assessment, 21, 239-250. http://dx.doi.org/10.1111/ijsa.12034Links ]

European Parliament and the Council (2002). Directive 2002/73/EC of the European Parliament and of the Council of 23 September 2002 amending Council Directive 76/207/EEC on the implementation of the principle of equal treatment for men and women as regards access to employment, vocational training and promotion, and working conditions (Text with EEA relevance). Official Journal of the European Communities, L269, 0015-0020. Retrieved from http://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:32002L0073&qid=1458048237095&from=enLinks ]

European Parliament and the Council (2006). Directive 2006/54/EC of the European Parliament and of the Council of 5 July 2006 on the implementation of the principle of equal opportunities and equal treatment of men and women in matters of employment and occupation (recast). Official Journal of the European Union, L204, 23-36. Retrieved from http://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:32006L0054&qid=1458049582829&from=ENLinks ]

European Parliament and the Council (2010). Directive 2010/41/EU of the European Parliament and the Council of 7 July on the application of the principle of equal treatment between men and women engaged in an activity in a self-employed capacity and repealing Council Directive 86/613/EEC. Official Journal of the European Union, 180, 1-6. Retrieved from http://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:32010L0041&qid=1458048333118&from=ENLinks ]

European Union. (2012). Charter of Fundamental Rights on the European Union. Official Journal of the European Communities, 326, 391-407. Retrieved from http://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:12012P/TXT&from=ENLinks ]

European Union Commission (2010). A Strengthened Commitment to Equality between Women and Men: A Women’s Charter. Retrieved from http://ec.europa.eu/archives/commission_2010-2014/president/news/documents/pdf/20100305_1_en.pdfLinks ]

Eurostat (2015). Europe in figures - Eurostat yearbook. Retrieved from Eurostat website: http://ec.europa.eu/eurostat/statistics-explained/index.php/Employment_statisticsLinks ]

Glick, P., & Fiske, S. T. (2007). Sex discrimination: The psychological approach. In F. J. Crosby, M. S. Stockdale, & S. A. Ropp (Eds.), Sex discrimination in the workplace: Multidisciplinary perspectives (pp. 155-187). Malden, MA: Blackwell Publishing. [ Links ]

* Grove, D. A. (1981). A behavioral consistency approach to decision making in employment selection. Personnel Psychology, 34, 55-64. http://dx.doi.org/10.1111/j.1744-6570.1981.tb02177.xLinks ]

Gutek, B. A. (2007). My experience as an expert witness in sex discrimination. In F. J. Crosby, M. S. Stockdale, & S. A. Roop (Eds.), Sex discrimination in the workplace (pp. 131-142). Malden, MA: Blackwell Publishing. [ Links ]

Gutek, B. A., & Stockdale, M. S. (2005). Sex discrimination in employment. In F. J. Landy (Ed.), Employment discrimination litigation. Behavioral, quantitative, and legal perspectives (pp. 229-254). San Francisco, CA: Jossey-Bass. [ Links ]

Gutman, A. (2005). Adverse Impact: Judicial, Regulatory, and Statutory Authority. In F. J. Landy (Ed.), Employment discrimination litigation. Behavioral, quantitative, and legal perspectives (pp. 20-46). San Francisco, CA: Jossey-Bass. [ Links ]

Hanges, P. J., & Feinberg, E. G. (2010). International perspectives on Adverse Impact: Europe and Beyond. In J. L. Outtz (Ed.), Adverse Impact: Implications for Organizational Staffing and High States Selection (pp. 349-373). New York: Routledge. [ Links ]

Hough, L. M., Oswald, F. L., & Ployhart, R. E. (2001). Determinants, detection, and amelioration of adverse impact in personnel selection procedures: issues, evidence and lessons learned. International Journal of Selection and Assessment, 9, 152-194. http://dx.doi.org/10.1111/1468-2389.00171Links ]

Huffcutt, A. I., & Arthur, W. (1994). Hunter and Hunter (1984) revisited: Interview validity for entry-level jobs. Journal of Applied Psychology, 79, 184-190. http://dx.doi.org/10.1037/0021-9010.79.2.184Links ]

Huffcutt, A. I., Conway, J. M., Roth, P. L., & Klehe, U. C. (2004). The impact of job complexity and study design on situational and behavior description interview validity. International Journal of Selection and Assessment, 12, 262-273. http://dx.doi.org/10.1111/j.0965-075X.2004.280_1.xLinks ]

Huffcutt, A. I., Conway, J. M., Roth, P. L., & Stone, N. J. (2001). Identification and meta-analytic assessment of psychological constructs measured in employment interviews. Journal of Applied Psychology, 86, 897-913. http://dx.doi.org/10.1037/0021-9010.86.5.897Links ]

Huffcutt, A. I., Culbertson, S. S., & Weyhrauch, W. S. (2013). Employment Interview Reliability: New meta-analytic estimates by structure and format. International Journal of Selection and Assessment, 21, 264-276. http://dx.doi.org/10.1111/ijsa.12036Links ]

Instituto de la Mujer y para la Igualdad de Oportunidades y Ministerio de Sanidad, Servicios Sociales e Igualdad (2014). Plan Estratégico de Igualdad de Oportunidades 2014-2016 [Strategic Plan for Equal Opportunities 2014-2016]. Administración General del Estado. Madrid. [ Links ]

Instituto Nacional de Estadística e Instituto de la Mujer y para la Igualdad de Oportunidades (2014). Mujeres y Hombres en España [Women and men in Spain]. Administración General del Estado. Madrid. [ Links ]

Janz, T. (1982). Initial comparisons of patterned behavior description interviews versus unstructured interviews. Journal of Applied Psychology, 67, 577-580. http://dx.doi.org/10.1037/0021-9010.67.5.577Links ]

Janz, T., Hellervik, L., & Gilmore, D. C. (1986). Behavior description interviewing: New, accurate, cost effective. Englewood Cliffs, NJ: Prentice Hall. [ Links ]

* Klehe, U. C., & Latham, G. (2006). What would you do-really or ideally? Constructs underlying the behavior description interview and the situational interview in predicting typical versus maximum performance. Human Performance, 19, 357-382. http://dx.doi.org/10.1207/s15327043hup1904_3Links ]

* Kluemper, D. H. (2006). An Examination of Ability-Based Emotional Intelligence in the Structured Employment Interview (doctoral dissertation). Oklahoma State University. [ Links ]

Landy, F. J. (2005). Phases of employment litigation. In F. J. Landy (Ed.), Employment discrimination litigation. Behavioral, quantitative, and legal perspectives (pp. 3-19). San Francisco, CA: Jossey-Bass. [ Links ]

Levashina, J., Hartwell, C. J., Morgeson, F. P., & Campion, M. A. (2014). The structured employment interview: Narrative and quantitative review of the research literature. Personnel Psychology, 67, 241-293. http://dx.doi.org/10.1111/peps.12052Links ]

Magnusson, D. (1977). Teoría de los tests [Test Theory]. México D. F: Trillas. [ Links ]

* McCarthy, J. M., Iddekinge, C. H. van, & Campion, M. A. (2010). Are highly structured job interviews resistant to demographic similarity effects? Personnel Psychology, 63, 325-359. http://dx.doi.org/10.1111/j.1744-6570.2010.01172.xLinks ]

McDaniel, M. A., Whetzel, D. L., Schmidt, F. L., & Maurer, S. D. (1994). The validity of employment interviews: A comprehensive review and meta-analysis. Journal of Applied Psychology, 79, 599-616. http://dx.doi.org/10.1037/0021-9010.79.4.599Links ]

Morel, N., Palier, B., & Palme, J. (2012). Towards a social investment welfare state? Ideas, policies and challenges. Bristol, UK: The Policy Press. [ Links ]

Moscoso, S. (2000). Selection interview: A Review of Validity Evidence, Adverse Impact and Applicant Reactions. International Journal of Selection and Assessment. 8, 237-247. http://dx.doi.org/10.1111/1468-2389.00153Links ]

Moscoso, S., Gorriti, M., & Salgado, J. F. (2007). La entrevista de selección de personal: Características y aplicaciones de la entrevista conductual estructurada (ECE) [The selection interview: Features and applications of structured behavioral interview (SBI)]. In A. Osca (Ed.), Selección, Evaluación y Desarrollo de los Recursos Humanos (pp. 273-303). Madrid: Sanz y Torres, S.L. [ Links ]

Moscoso, S., & Salgado, J. F. (2001). Psychometric Properties of an Estructured Behavioral Interview to Hire Private Security Personnel. Journal of Business and Psychology, 16, 51-59. http://dx.doi.org/10.1023/A:1007835704733Links ]

* Motowidlo, S. J., Carter, G. W., Dunnette, M. D., Tippins, N., Werner, S., Burnett, J. R., & Vaughan, M. J. (1992). Studies of the structured behavioral interview. Journal of Applied Psychology, 77, 571-587. http://dx.doi.org/10.1037/0021-9010.77.5.571Links ]

Outtz, J. L. (2005). Race discrimination cases: Common themes. In F. J. Landy (Ed.), Employment Discrimination Litigation. Behavioral, Quantitative, and Legal Perspectives (pp. 201-228). San Francisco, CA: Jossey-Bass. [ Links ]

Pereira, F. M., Primi, R., & Cobêro, C. (2003). Validade de testes utilizados em seleçao de pessoal segundo recrutadores [Validity of tests used in personnel selection according to recruiters]. Psicologia: teoria e Prática, 5, 83-98. [ Links ]

Posthuma, R. A., Morgeson, F. P., & Campion, M. A. (2002). Beyond employment interview validity: A comprehensive narrative review of recent research and trends over time. Personnel Psychology, 55, 1-81. http://dx.doi.org/10.1111/j.1744-6570.2002.tb00103.xLinks ]

* Pulakos, E. D., & Schmitt, N. (1995). Experience-based and situational interview questions: Studies of validity. Personnel Psychology, 48, 289-308. http://dx.doi.org/10.1111/j.1744-6570.1995.tb01758.xLinks ]

Ryan, A. N. N., McFarland, L., Baron, H., & Page, R. (1999). An international look at selection practices: Nation and culture as explanations for variability in practice. Personnel Psychology, 52, 359-392. http://dx.doi.org/10.1111/j.1744-6570.1999.tb00165.xLinks ]

* Sacco, J. M., Scheu, C. R., Ryan, A. M., & Schmitt, N. (2003). An Investigation of Race and Sex Similarity Effects in Interviews: A Multilevel Approach to Relational Demography. Journal of Applied Psychology, 88, 852-865. http://dx.doi.org/10.1037/0021-9010.88.5.852Links ]

Sackett, P. R., Shen, W., Myors, B., Lievens, F., Schollaert, E., Hoye, G., . . . Aguinis, H. (2010). Perspectives from twenty-two countries on the legal environment for selection. In N. Tippins & J. L. Farr (Eds.), Handbook of Employee Selection (pp. 651-676). New York: Routledge. [ Links ]

Saez, J. (2007). Diseño y validación de una Entrevista Conductual Estructurada para la Selección de Agentes de Policía Local [Design and validation of a structured behavioral interview for the selection of local police officers]. Revista de Psicología del Trabajo y las Organizaciones, 23, 57-74. [ Links ]

* Saez, J. (2011). Determinantes del desempe˜ño individual en agentes de policía local [Determinants of individual performance in local police officers] (unpublished doctoral dissertation). Universidad de Santiago de Compostela, Spain. [ Links ]

Salgado, J. F. (1995). La entrevista estructurada conductual: características, ventajas y limitaciones [Structural behavioral interview: features, advantages, and limitations]. Alta Dirección, 181, 29-32. [ Links ]

Salgado, J. F. (2007). Análisis de utilidad económica de la Entrevista Conductual Estructurada en la selección de personal de la administración general del País Vasco [Utility Analysis of the Structured Behavioral Interview within the Selection of Personnel for the General Administration of the Bask Country]. Revista de Psicología del Trabajo y de las Organizaciones, 23, 139-154. [ Links ]

* Salgado, J. F., Gorriti, M., & Moscoso, S. (2007). La Entrevista Conductual Estructurada y el Desempeñ o Laboral en la Administración Pública Española: Propiedades Psicométricas y Reacciones de Justicia [The Structured Behavioral Interview and Job Performance in the Spanish Public Administration: Psychometric Properties and Fairness Reactions]. Revista de Psicología del Trabajo y de las Organizaciones, 23, 39-55. [ Links ]

Salgado, J. F., & Moscoso, S. (1995). Validez de las entrevistas conductuales estructuradas [Structured behavioural interview validity]. Revista de Psicología del Trabajo y las Organizaciones, 11, 9-24. [ Links ]

Salgado, J. F., & Moscoso, S. (2002). Comprehensive meta-analysis of the construct validity of the employment interview. European Journal of Work and Organizational Psychology, 11, 299-324. [ Links ]

Salgado, J. F., & Moscoso, S. (2006). Utiliser les entretiens comportementaux structurés pour la sélection du personnel? [Utilising structured behavioral interviews for personnel selection?]. In C. Lévy-Leboyer, C. Louche, & J. P. Rolland (Eds.), RH: Les apports de la psychologie du travail (1) (pp. 195-207). Paris: Éditions dO´rganisation. [ Links ]

Salgado, J. F., & Moscoso, S. (2008). Selección de personal en la empresa y las administraciones públicas: de la visión tradicional a la visión estratégica [Personnel selection in industry and public administration: From the traditional view to the strategic view]. Papeles del Psicólogo, 29, 16-24. [ Links ]

Salgado, J. F., & Moscoso, S. (2011). La Entrevista Conductual Estructurada de Selección de Personal: Teoría, práctica y rentabilidad [Structured Behavioral Interview for Personnel Selection: Theory, Practice and profitability] (3rd edition). Madrid: Pirámide. [ Links ]

Salgado, J. F., Moscoso, S., & Gorriti, M. (2004). Investigaciones sobre la Entrevista Conductual Estructurada (ECE) en la Selección de Personal en la Administración General del País Vasco: Meta-análisis de la Fiabilidad [A study of Structured Behavioural Interview in Personnel Selection in the Basque Country General Administration: A meta-analysis of reliability]. Revista de Psicología del Trabajo y de las Organizaciones, 20, 107-139. [ Links ]

Salgado, J. F., Ones, D. S., & Viswesvaran, C. (2001). A new look at the predictors in personnel selection. In N. Anderson, D. S. Ones, H. K. Sinangil, & C. Viswesvaran (Eds.), International Handbook of Work and Organizational Psychology (1). London, UK: Sage. [ Links ]

Schmidt, F. L., & Hunter, J. E. (1996). Measurement error in psychological research: Lessons from 26 research scenarios. Psychological Methods, 1, 199-223. [ Links ]

Schmidt, F. L., & Hunter, J. E. (1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124, 262-274. http://dx.doi.org/10.1037/0033-2909.124.2.262Links ]

Schmidt, F. L., & Hunter, J. E. (2014). Methods of meta-analysis (Third edition). Newbury Park, CA: Sage. [ Links ]

Schmidt, F. L., & Le, H. (2004). Software for the Hunter-Schmidt meta-analysis methods. University of Iowa, Department of Management & Organization. [ Links ]

Schmidt, F. L., Le, H., & Ilies, R. (2003). Beyond alpha: An empirical examination of the effects of different sources of measurement error on reliability estimates for measures of individual-differences constructs. Psychological Methods, 8, 206-224. http://dx.doi.org/10.1037/1082-989X.8.2.206Links ]

Shackleton, V., & Newell, S. (1994). European management selection methods: A comparison of five countries. International Journal of Selection and Assessment, 2, 91-102. http://dx.doi.org/10.1111/j.1468-2389.1994.tb00155.xLinks ]

* Silvester, J., & Dykes, C. (2007). Selecting political candidates: A longitudinal study of assessment centre performance and political success in the 2005 UK General Election. Journal of Occupational and Organizational Psychology, 80, 11-25. http://dx.doi.org/10.1348/096317906X156287Links ]

Stone, P. (2013, March). ‘Opting Out’: Challenging Stereotypes and Creating Real Options for Women in the Professions. In R. J. Ely & A. J. C. Cuddy (Organizers), Gender & Work: Challenging Conventional Wisdom. Symposium conducted in the Harvard Business School. Retrieved from http://www.hbs.edu/faculty/conferences/2013-w50-research-symposium/Documents/stone.pdfLinks ]

Taylor, P., Keelty, Y., & McDonnell, B. (2002). Evolving personnel selection practices in New Zealand organisations and recruitment firms. New Zealand Journal of Psychology, 31, 8-18. [ Links ]

Taylor, P. J., & Small, B. (2002). Asking applicants what they would do versus what they did do: A meta-analytic comparison of situational and past behaviour employment interview questions. Journal of Occupational and Organizational Psychology, 75, 277-294. http://dx.doi.org/10.1348/096317902320369712Links ]

The Chartered Institute of Personnel and Development (2004). Recruiment, retention and turnover 2004. A survey of the UK and Ireland. Retrieved from Agency name website: http://www.cipd.co.uk/Links ]

The Chartered Institute of Personnel and Development (2011). Annual survey report 2011. Retrieved from: https://www.hays.co.uk/cs/groups/hays_common/documents/webassets/hays_433891.pdfLinks ]

Thornton, G. C. III, & Wingate, P. H. (2005). Industrial and organizational psychologists as expert witnesses: affecting employment discrimination litigation post Daubert. In F. J. Landy (Ed.), Employment discrimination litigation. Behavioral, quantitative, and legal perspectives (pp. 167-197). San Francisco, CA: Jossey-Bass. [ Links ]

Tippins, N. T. (2010). Adverse impact in employee selection procedures from the perspective of an organizational consultant. In J. L. Outtz (Ed.), Adverse Impact: Implications for Organizational Staffing and High States Selection (pp. 201-225). New York: Routledge. [ Links ]

United States Equal Employment Opportunities Commission (2016). 2014 Job Patterns for Minorities and Women in Private Industry (EEO-1). Retrieved from http://www1.eeoc.gov/eeoc/statistics/employment/jobpat-eeo1/2014/index.cfm#select_labelLinks ]

Walters, S. E. (2010). Ethnicity, job experience, and interview ratings (doctoral dissertation). California State University. [ Links ]

Wiesner, W. H., & Cronshaw, S. F. (1988). A meta-analytic investigation of the impact of interview format and degree of structure on the validity of the employment interview. Journal of Occupational Psychology, 61, 275-290. http://dx.doi.org/10.1111/j.2044-8325.1988.tb00467.xLinks ]

Financial SupportThis research was partially supported by Grants PSI2011-27943 and PSI2014-56615-P from the Spanish Ministry of Economy and Competitiveness.

1(References with asterisk indicate meta-analysis)

Appendix

Studies Included in the Meta-analysis 

N d r xx (α) r xx (Interrater) u
Alonso, Cuadrado, Salgado, and Moscoso (2014) 63 −0.22 .79 - 1.00
Barrick, Swider, and Stewart (2010) 189 0.25 .84 - 0.84
Berges (2010) 226 −0.30 - .83 1.00
De Soete, Lievens, Oostrom, and Westerveld (2013) 245 −0.08 .64 - -
Grove (1981) 181 0.32 - .69 1.00
Klehe and Latham (2006) 167 −0.03 - .90 1.27
Kluemper (2006) 81 −0.03 - - 1.00
30 −1.08 - - 1.00
McCarthy et al. (2010) 18,285 −0.25 .86 .82 1.00
Motowidlo et al. (1992) 97 0.31 .85 .63 1.00
164 0.19 .79 - 0.87
872 −0.23 .69 - 1.00
162 −0.24 .84 - 1.00
Pulakos and Schmitt (1995) 464 −0.05 - - 1.00
Sacco et al. (2003) 12,007 0.01 .84 - 1.00
Saez (2011) 173 0.00 - .92 1.00
Salgado et al. (2007) 209 −0.38 - .93 1.00
Silvester and Dykes (2007) 415 −0.25 - - 1.00
Walters (2010) 100 −0.08 - - 1.00

Note. N = sample size; d = effect size of the differences between men and women; r xx(α) = internal consistence reliability; r xx = Interrater reliability; u = range restriction.

Received: February 22, 2016; Accepted: March 20, 2016

Corresponding author. Facultad de Relaciones Laborales. Universidad de Santiago de Compostela. 15782 Santiago de Compostela, A Coruña, Spain. E-mail address:pamela.alonso@usc.es (P. Alonso).

Conflict of Interest

The authors of this article declare no conflict of interest.

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License