Abstract

SANCHEZ-MECA, Julio; LOPEZ-PINA, José A.  and  LOPEZ LOPEZ, José Antonio. A review of the meta-analytic studies of reliability generalization. Escritos de Psicología [online]. 2008, vol.2, n.1, pp.110-121. ISSN 1989-3809.

The meta-analytic approach of reliability generalization (RG) pretends to show that reliability is an empirical property that varies from one test application to another. This recent meta-analytic approach is helping to make the researchers aware of the importance of reporting reliability estimates obtained from the own data and, of avoiding the malpractice of inducting reliability coefficients from other studies and previous applications of the test. The stages to carry out an RG study are presented: (a) formulating the problem, (b) searching for the studies, (c) coding studies, and (d) statistical analysis and interpretation. An updated overview of the statistical problems of this approach is also offered: (a) to transform versus not to transform the reliability coefficients, (b) to weight versus not to weight the coefficients, and (d) which statistical model is the most appropriate (fixed-, random-, and mixed-effects). A systematic review of the 49 RG studies published to date is presented with the purpose of analyzing the heterogeneity in how the data are statistically analyzed. Finally, the implications of the RG studies for research and professional practice are discussed.

Keywords : Reliability generalization; meta-analysis; reliability coefficient.

        · abstract in Spanish     · text in Spanish     · Spanish ( pdf )