<?xml version="1.0" encoding="ISO-8859-1"?><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
<front>
<journal-meta>
<journal-id>0212-9728</journal-id>
<journal-title><![CDATA[Anales de Psicología]]></journal-title>
<abbrev-journal-title><![CDATA[Anal. Psicol.]]></abbrev-journal-title>
<issn>0212-9728</issn>
<publisher>
<publisher-name><![CDATA[Universidad de Murcia]]></publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id>S0212-97282021000100020</article-id>
<article-id pub-id-type="doi">10.6018/analesps.37.1.433051</article-id>
<title-group>
<article-title xml:lang="en"><![CDATA[The small impact of p-hacking marginally significant results on the meta-analytic estimation of effect size]]></article-title>
<article-title xml:lang="es"><![CDATA[El pequeño impacto del "haqueo" de resultados marginalmente significativos sobre la estimación meta-analítica del tamaño del efecto]]></article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Botella]]></surname>
<given-names><![CDATA[Juan]]></given-names>
</name>
<xref ref-type="aff" rid="Aff"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Suero]]></surname>
<given-names><![CDATA[Manuel]]></given-names>
</name>
<xref ref-type="aff" rid="Aff"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Durán]]></surname>
<given-names><![CDATA[Juan I]]></given-names>
</name>
<xref ref-type="aff" rid="Aff"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Blázquez]]></surname>
<given-names><![CDATA[Desirée]]></given-names>
</name>
<xref ref-type="aff" rid="Aff"/>
</contrib>
</contrib-group>
<aff id="Af1">
<institution><![CDATA[,Universidad Autónoma de Madrid  ]]></institution>
<addr-line><![CDATA[ ]]></addr-line>
<country>Spain</country>
</aff>
<aff id="Af2">
<institution><![CDATA[,Universidad a Distancia de Madrid  ]]></institution>
<addr-line><![CDATA[ ]]></addr-line>
<country>Spain</country>
</aff>
<aff id="Af3">
<institution><![CDATA[,Universidad de Murcia  ]]></institution>
<addr-line><![CDATA[ ]]></addr-line>
<country>Spain</country>
</aff>
<pub-date pub-type="pub">
<day>00</day>
<month>04</month>
<year>2021</year>
</pub-date>
<pub-date pub-type="epub">
<day>00</day>
<month>04</month>
<year>2021</year>
</pub-date>
<volume>37</volume>
<numero>1</numero>
<fpage>178</fpage>
<lpage>187</lpage>
<copyright-statement/>
<copyright-year/>
<self-uri xlink:href="http://scielo.isciii.es/scielo.php?script=sci_arttext&amp;pid=S0212-97282021000100020&amp;lng=en&amp;nrm=iso"></self-uri><self-uri xlink:href="http://scielo.isciii.es/scielo.php?script=sci_abstract&amp;pid=S0212-97282021000100020&amp;lng=en&amp;nrm=iso"></self-uri><self-uri xlink:href="http://scielo.isciii.es/scielo.php?script=sci_pdf&amp;pid=S0212-97282021000100020&amp;lng=en&amp;nrm=iso"></self-uri><abstract abstract-type="short" xml:lang="en"><p><![CDATA[Abstract The label p-hacking (pH) refers to a set of opportunistic practices aimed at making statistically significant p values that should be non-significant. Some have argued that we should prevent and fight pH for several reasons, especially because of its potential harmful effects on the assessment of both primary research results and their meta-analytical synthesis. We focus here on the effect of a specific type of pH, focused on marginally significant studies, on the combined estimation of effect size in meta-analysis. We want to know how much we should be concerned with its biasing effect when assessing the results of a meta-analysis. We have calculated the bias in a range of situations that seem realistic in terms of the prevalence and the operational definition of pH. The results show that in most of the situations analyzed the bias is less than one hundredth (± 0.01), in terms of d or r. To reach a level of bias of five-hundredths (± 0.05), there would have to be a massive presence of this type of pH, which seems rather unrealistic. We must continue to fight pH for many good reasons, but our main conclusion is that among them is not that it has a big impact on the meta-analytical estimation of effect size.]]></p></abstract>
<abstract abstract-type="short" xml:lang="es"><p><![CDATA[Resumen La etiqueta p-hacking (pH) se refiere a un conjunto de prácticas oportunistas destinadas a hacer que sean significativos algunos valores p que deberían ser no significativos. Algunos han argumentado que debemos prevenir y luchar contra el pH por varias razones, especialmente debido a sus posibles efectos nocivos en la evaluación de los resultados de la investigación primaria y su síntesis meta-analítica. Nos focalizamos aquí en el efecto de un tipo específico de pH, centrado en estudios marginalmente significativos, en la estimación combinada del tamaño del efecto en el meta-análisis. Queremos saber cuánto deberíamos preocuparnos por su efecto de sesgo al evaluar los resultados de un meta-análisis. Hemos calculado el sesgo en una variedad de situaciones que parecen realistas en términos de prevalencia y de la definición operativa del pH. Los resultados muestran que en la mayoría de las situaciones analizadas el sesgo es inferior a una centésima (± 0.01), en términos de d o r. Para alcanzar un nivel de sesgo de cinco centésimas (± 0.05), tendría que haber una presencia masiva de este tipo de pH, lo que parece poco realista. Hay muchas buenas razones para luchar contra el pH, pero nuestra conclusión principal es que entre esas razones no se incluye que tenga un gran impacto en la estimación meta-analítica del tamaño del efecto.]]></p></abstract>
<kwd-group>
<kwd lng="en"><![CDATA[p-hacking]]></kwd>
<kwd lng="en"><![CDATA[effect size]]></kwd>
<kwd lng="en"><![CDATA[meta-analysis]]></kwd>
<kwd lng="es"><![CDATA[p-hacking]]></kwd>
<kwd lng="es"><![CDATA[tamaño del efecto]]></kwd>
<kwd lng="es"><![CDATA[meta-análisis]]></kwd>
</kwd-group>
</article-meta>
</front><back>
<ref-list>
<ref id="B1">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Anvari]]></surname>
<given-names><![CDATA[F.]]></given-names>
</name>
<name>
<surname><![CDATA[Lakens]]></surname>
<given-names><![CDATA[D.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[The replicability crisis and public trust in psychological science]]></article-title>
<source><![CDATA[Comprehensive Results in Social Psychology]]></source>
<year>2019</year>
<page-range>1-21</page-range></nlm-citation>
</ref>
<ref id="B2">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Baker]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Is there a reproducibility crisis? A Nature survey lifts the lid on how researchers view the &#8216;crisis' rocking science and what they think will help]]></article-title>
<source><![CDATA[Nature]]></source>
<year>2016</year>
<volume>533</volume>
<numero>7604</numero>
<issue>7604</issue>
<page-range>452-5</page-range></nlm-citation>
</ref>
<ref id="B3">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Bakker]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[van Dijk]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
<name>
<surname><![CDATA[Wicherts]]></surname>
<given-names><![CDATA[J. M.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[The Rules of the Game Called Psychological Science]]></article-title>
<source><![CDATA[Perspectives on Psychological Science]]></source>
<year>2012</year>
<volume>7</volume>
<page-range>543-54</page-range></nlm-citation>
</ref>
<ref id="B4">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Banks]]></surname>
<given-names><![CDATA[G. C.]]></given-names>
</name>
<name>
<surname><![CDATA[Rogelberg]]></surname>
<given-names><![CDATA[S. G.]]></given-names>
</name>
<name>
<surname><![CDATA[Woznyj]]></surname>
<given-names><![CDATA[H. M.]]></given-names>
</name>
<name>
<surname><![CDATA[Landis]]></surname>
<given-names><![CDATA[R. S.]]></given-names>
</name>
<name>
<surname><![CDATA[Rupp]]></surname>
<given-names><![CDATA[D. E.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Evidence on questionable research practices: The good, the bad, and the ugly]]></article-title>
<source><![CDATA[Journal of Business and Psychology]]></source>
<year>2016</year>
<volume>31</volume>
<page-range>323-38</page-range></nlm-citation>
</ref>
<ref id="B5">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Bishop]]></surname>
<given-names><![CDATA[D. V.]]></given-names>
</name>
<name>
<surname><![CDATA[Thompson]]></surname>
<given-names><![CDATA[P. A.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Problems in using p-curve analysis and text-mining to detect rate of p-hacking and evidential value]]></article-title>
<source><![CDATA[PeerJ]]></source>
<year>2016</year>
<volume>4</volume>
</nlm-citation>
</ref>
<ref id="B6">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Borenstein]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Hedges]]></surname>
<given-names><![CDATA[L. V.]]></given-names>
</name>
<name>
<surname><![CDATA[Higgins]]></surname>
<given-names><![CDATA[J. P. T.]]></given-names>
</name>
<name>
<surname><![CDATA[Rothstein]]></surname>
<given-names><![CDATA[H. R.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[A basic introduction to fixed-effects and random-effects models for meta-analysis]]></article-title>
<source><![CDATA[Research Synthesis Methods]]></source>
<year>2010</year>
<volume>1</volume>
<page-range>97-111</page-range></nlm-citation>
</ref>
<ref id="B7">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Bosco]]></surname>
<given-names><![CDATA[F. A.]]></given-names>
</name>
<name>
<surname><![CDATA[Aguinis]]></surname>
<given-names><![CDATA[H.]]></given-names>
</name>
<name>
<surname><![CDATA[Singh]]></surname>
<given-names><![CDATA[K.]]></given-names>
</name>
<name>
<surname><![CDATA[Field]]></surname>
<given-names><![CDATA[J. G.]]></given-names>
</name>
<name>
<surname><![CDATA[Pierce]]></surname>
<given-names><![CDATA[C. A.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Correlational effect size benchmarks]]></article-title>
<source><![CDATA[Journal of Applied Psychology]]></source>
<year>2015</year>
<volume>100</volume>
<page-range>431-49</page-range></nlm-citation>
</ref>
<ref id="B8">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Botella]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
<name>
<surname><![CDATA[Duran]]></surname>
<given-names><![CDATA[J. I.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[A meta-analytical answer to the crisis of confidence of Psychology]]></article-title>
<source><![CDATA[Anales De Psicología/Annals of Psychology]]></source>
<year>2019</year>
<volume>35</volume>
<numero>2</numero>
<issue>2</issue>
<page-range>350-6</page-range></nlm-citation>
</ref>
<ref id="B9">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Botella]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
<name>
<surname><![CDATA[Ximénez]]></surname>
<given-names><![CDATA[M. C.]]></given-names>
</name>
<name>
<surname><![CDATA[Revuelta]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
<name>
<surname><![CDATA[Suero]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Optimization of sample size in controlled experiments: the CLAST rule]]></article-title>
<source><![CDATA[Behavior Research Methods, Instruments &amp; Computers]]></source>
<year>2006</year>
<volume>38</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>65-76</page-range></nlm-citation>
</ref>
<ref id="B10">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Brodeur]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
<name>
<surname><![CDATA[Lé]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Sangnier]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Zylberberg]]></surname>
<given-names><![CDATA[Y.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Star wars: The empirics strike back]]></article-title>
<source><![CDATA[American Economic Journal: Applied Economics]]></source>
<year>2016</year>
<volume>8</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>1-32</page-range></nlm-citation>
</ref>
<ref id="B11">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Carter]]></surname>
<given-names><![CDATA[E. C.]]></given-names>
</name>
<name>
<surname><![CDATA[Schönbrodt]]></surname>
<given-names><![CDATA[F. D.]]></given-names>
</name>
<name>
<surname><![CDATA[Gervais]]></surname>
<given-names><![CDATA[W. M.]]></given-names>
</name>
<name>
<surname><![CDATA[Hilgard]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Correcting for bias in psychology: A comparison of meta-analytic methods]]></article-title>
<source><![CDATA[Advances in Methods and Practices in Psychological Science]]></source>
<year>2019</year>
<volume>2</volume>
<numero>2</numero>
<issue>2</issue>
<page-range>115-44</page-range></nlm-citation>
</ref>
<ref id="B12">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Cohen]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
</person-group>
<source><![CDATA[Statistical power analysis for the behavioural sciences]]></source>
<year>1988</year>
<edition>2</edition>
<publisher-loc><![CDATA[New York ]]></publisher-loc>
<publisher-name><![CDATA[Academic Press]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B13">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[De Boeck]]></surname>
<given-names><![CDATA[P.]]></given-names>
</name>
<name>
<surname><![CDATA[Jeon]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Perceived crisis and reforms: Issues, explanations, and remedies]]></article-title>
<source><![CDATA[Psychological Bulletin]]></source>
<year>2018</year>
<volume>144</volume>
<numero>7</numero>
<issue>7</issue>
<page-range>757</page-range></nlm-citation>
</ref>
<ref id="B14">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[De Winter]]></surname>
<given-names><![CDATA[J. C.]]></given-names>
</name>
<name>
<surname><![CDATA[Dodou]]></surname>
<given-names><![CDATA[D.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[A surge of p-values between 0.041 and 0.049 in recent decades (but negative results are increasing rapidly too)]]></article-title>
<source><![CDATA[PeerJ]]></source>
<year>2015</year>
<page-range>3</page-range></nlm-citation>
</ref>
<ref id="B15">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[DeCoster]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
<name>
<surname><![CDATA[Sparks]]></surname>
<given-names><![CDATA[E. A.]]></given-names>
</name>
<name>
<surname><![CDATA[Sparks]]></surname>
<given-names><![CDATA[J. C.]]></given-names>
</name>
<name>
<surname><![CDATA[Sparks]]></surname>
<given-names><![CDATA[G. G.]]></given-names>
</name>
<name>
<surname><![CDATA[Sparks]]></surname>
<given-names><![CDATA[C. W.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Opportunistic biases: Their origins, effects, and an integrated solution]]></article-title>
<source><![CDATA[American Psychologist]]></source>
<year>2015</year>
<volume>70</volume>
<numero>6</numero>
<issue>6</issue>
<page-range>499</page-range></nlm-citation>
</ref>
<ref id="B16">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Earp]]></surname>
<given-names><![CDATA[B. D.]]></given-names>
</name>
<name>
<surname><![CDATA[Trafimow]]></surname>
<given-names><![CDATA[D.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Replication, falsification, and the crisis of confidence in social psychology]]></article-title>
<source><![CDATA[Frontiers in Psychology]]></source>
<year>2015</year>
<volume>6</volume>
<page-range>621</page-range></nlm-citation>
</ref>
<ref id="B17">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Fanelli]]></surname>
<given-names><![CDATA[D.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[How many scientists fabricate and falsify research? A systematic review and meta-analysis of survey data]]></article-title>
<source><![CDATA[PloS one]]></source>
<year>2009</year>
<volume>4</volume>
<numero>5</numero>
<issue>5</issue>
</nlm-citation>
</ref>
<ref id="B18">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Fiedler]]></surname>
<given-names><![CDATA[K.]]></given-names>
</name>
<name>
<surname><![CDATA[Schwarz]]></surname>
<given-names><![CDATA[N.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Questionable research practices revisited]]></article-title>
<source><![CDATA[Social Psychological and Personality Science]]></source>
<year>2016</year>
<volume>7</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>45-52</page-range></nlm-citation>
</ref>
<ref id="B19">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Francis]]></surname>
<given-names><![CDATA[G.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Publication bias and the failure of replication in experimental psychology]]></article-title>
<source><![CDATA[Psychonomic Bulletin &amp; Review]]></source>
<year>2012</year>
<volume>19</volume>
<numero>6</numero>
<issue>6</issue>
<page-range>975-91</page-range></nlm-citation>
</ref>
<ref id="B20">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Franco]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
<name>
<surname><![CDATA[Malhotra]]></surname>
<given-names><![CDATA[N.]]></given-names>
</name>
<name>
<surname><![CDATA[Simonovits]]></surname>
<given-names><![CDATA[G.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Publication bias in the social sciences: Unlocking the file drawer]]></article-title>
<source><![CDATA[Science]]></source>
<year>2014</year>
<volume>345</volume>
<numero>6203</numero>
<issue>6203</issue>
<page-range>1502-5</page-range></nlm-citation>
</ref>
<ref id="B21">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Friese]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Frankenbach]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[p-Hacking and publication bias interact to distort meta-analytic effect size estimates]]></article-title>
<source><![CDATA[Psychological Methods]]></source>
<year>2019</year>
</nlm-citation>
</ref>
<ref id="B22">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Hall]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
<name>
<surname><![CDATA[Martin]]></surname>
<given-names><![CDATA[B. R.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Towards a taxonomy of research misconduct: The case of business school research]]></article-title>
<source><![CDATA[Research Policy]]></source>
<year>2019</year>
<volume>48</volume>
<numero>2</numero>
<issue>2</issue>
<page-range>414-27</page-range></nlm-citation>
</ref>
<ref id="B23">
<nlm-citation citation-type="">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Hartgerink]]></surname>
<given-names><![CDATA[C. H.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Reanalyzing Head et al. (2015): Investigating the robustness of widespread p-hacking]]></article-title>
<source><![CDATA[PeerJ]]></source>
<year>2017</year>
<volume>5</volume>
</nlm-citation>
</ref>
<ref id="B24">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Head]]></surname>
<given-names><![CDATA[M. L.]]></given-names>
</name>
<name>
<surname><![CDATA[Holman]]></surname>
<given-names><![CDATA[L.]]></given-names>
</name>
<name>
<surname><![CDATA[Lanfear]]></surname>
<given-names><![CDATA[R.]]></given-names>
</name>
<name>
<surname><![CDATA[Kahn]]></surname>
<given-names><![CDATA[A. T.]]></given-names>
</name>
<name>
<surname><![CDATA[Jennions]]></surname>
<given-names><![CDATA[M. D.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[The extent and consequences of p-hacking in science]]></article-title>
<source><![CDATA[PLoS Biology]]></source>
<year>2015</year>
<volume>13</volume>
<numero>3</numero>
<issue>3</issue>
</nlm-citation>
</ref>
<ref id="B25">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Hedges]]></surname>
<given-names><![CDATA[L. V.]]></given-names>
</name>
<name>
<surname><![CDATA[Vevea]]></surname>
<given-names><![CDATA[J. L.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Selection method approaches]]></article-title>
<person-group person-group-type="editor">
<name>
<surname><![CDATA[Rothstein]]></surname>
<given-names><![CDATA[H. R.]]></given-names>
</name>
<name>
<surname><![CDATA[Sutton]]></surname>
<given-names><![CDATA[A. J.]]></given-names>
</name>
<name>
<surname><![CDATA[Borenstein]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
</person-group>
<source><![CDATA[Publication bias in meta-analysis: Prevention, assessment and adjustments]]></source>
<year>2005</year>
<page-range>145-74</page-range><publisher-loc><![CDATA[Chichester, England ]]></publisher-loc>
<publisher-name><![CDATA[John Wiley &amp; Sons]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B26">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Holtfreter]]></surname>
<given-names><![CDATA[K.]]></given-names>
</name>
<name>
<surname><![CDATA[Reisig]]></surname>
<given-names><![CDATA[M. D.]]></given-names>
</name>
<name>
<surname><![CDATA[Pratt]]></surname>
<given-names><![CDATA[T. C.]]></given-names>
</name>
<name>
<surname><![CDATA[Mays]]></surname>
<given-names><![CDATA[R. D.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[The perceived causes of research misconduct among faculty members in the natural, social, and applied sciences]]></article-title>
<source><![CDATA[Studies in Higher Education]]></source>
<year>2019</year>
<page-range>1-13</page-range></nlm-citation>
</ref>
<ref id="B27">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Ioannidis]]></surname>
<given-names><![CDATA[J. P.]]></given-names>
</name>
<name>
<surname><![CDATA[Trikalinos]]></surname>
<given-names><![CDATA[T. A.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[An exploratory test for an excess of significant findings]]></article-title>
<source><![CDATA[Clinical Trials]]></source>
<year>2007</year>
<volume>4</volume>
<numero>3</numero>
<issue>3</issue>
<page-range>245-53</page-range></nlm-citation>
</ref>
<ref id="B28">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[John]]></surname>
<given-names><![CDATA[L. K.]]></given-names>
</name>
<name>
<surname><![CDATA[Loewenstein]]></surname>
<given-names><![CDATA[G.]]></given-names>
</name>
<name>
<surname><![CDATA[Prelec]]></surname>
<given-names><![CDATA[D.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Measuring the prevalence of questionable research practices with incentives for truth telling]]></article-title>
<source><![CDATA[Psychological Science]]></source>
<year>2012</year>
<volume>23</volume>
<numero>5</numero>
<issue>5</issue>
<page-range>524-32</page-range></nlm-citation>
</ref>
<ref id="B29">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Johnson]]></surname>
<given-names><![CDATA[N. L.]]></given-names>
</name>
<name>
<surname><![CDATA[Kotz]]></surname>
<given-names><![CDATA[S.]]></given-names>
</name>
<name>
<surname><![CDATA[Balakrishnan]]></surname>
<given-names><![CDATA[N.]]></given-names>
</name>
</person-group>
<source><![CDATA[Continuous Univariate Distributions]]></source>
<year>1994</year>
<volume>2</volume>
<edition>2</edition>
<publisher-loc><![CDATA[New York ]]></publisher-loc>
<publisher-name><![CDATA[John Wiely Sons. Inc]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B30">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Kraemer]]></surname>
<given-names><![CDATA[H. C.]]></given-names>
</name>
<name>
<surname><![CDATA[Gardner]]></surname>
<given-names><![CDATA[C.]]></given-names>
</name>
<name>
<surname><![CDATA[Brooks]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
<name>
<surname><![CDATA[Yesavage]]></surname>
<given-names><![CDATA[J. A.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Advantages of excluding underpowered studies in meta-analysis: Inclusionist versus exclusionist viewpoints]]></article-title>
<source><![CDATA[Psychological Methods]]></source>
<year>1998</year>
<volume>3</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>23-31</page-range></nlm-citation>
</ref>
<ref id="B31">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Krawczyk]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[The search for significance: a few peculiarities in the distribution of P values in experimental psychology literature]]></article-title>
<source><![CDATA[PloS One]]></source>
<year>2015</year>
<volume>10</volume>
<numero>6</numero>
<issue>6</issue>
</nlm-citation>
</ref>
<ref id="B32">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Lane]]></surname>
<given-names><![CDATA[D. M.]]></given-names>
</name>
<name>
<surname><![CDATA[Dunlap]]></surname>
<given-names><![CDATA[W. P.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Estimating effect size: Bias resulting from the significance criterion in editorial decisions]]></article-title>
<source><![CDATA[British Journal of Mathematical &amp; Statistical Psychology]]></source>
<year>1978</year>
<volume>31</volume>
<page-range>107-12</page-range></nlm-citation>
</ref>
<ref id="B33">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Leggett]]></surname>
<given-names><![CDATA[N. C.]]></given-names>
</name>
<name>
<surname><![CDATA[Thomas]]></surname>
<given-names><![CDATA[N. A.]]></given-names>
</name>
<name>
<surname><![CDATA[Loetscher]]></surname>
<given-names><![CDATA[T.]]></given-names>
</name>
<name>
<surname><![CDATA[Nicholls]]></surname>
<given-names><![CDATA[M. E.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[The life of p: &#8220;Just significant&#8221; results are on the rise]]></article-title>
<source><![CDATA[The Quarterly Journal of Experimental Psychology]]></source>
<year>2013</year>
<volume>66</volume>
<numero>12</numero>
<issue>12</issue>
<page-range>2303-9</page-range></nlm-citation>
</ref>
<ref id="B34">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Marszalek]]></surname>
<given-names><![CDATA[J. M.]]></given-names>
</name>
<name>
<surname><![CDATA[Barber]]></surname>
<given-names><![CDATA[C.]]></given-names>
</name>
<name>
<surname><![CDATA[Kohlhart]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
<name>
<surname><![CDATA[Cooper]]></surname>
<given-names><![CDATA[B. H.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Sample size in psychological research over the past 30 years]]></article-title>
<source><![CDATA[Perceptual and Motor Skills]]></source>
<year>2011</year>
<volume>112</volume>
<numero>2</numero>
<issue>2</issue>
<page-range>331-48</page-range></nlm-citation>
</ref>
<ref id="B35">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Martinson]]></surname>
<given-names><![CDATA[B. C.]]></given-names>
</name>
<name>
<surname><![CDATA[Anderson]]></surname>
<given-names><![CDATA[M. S.]]></given-names>
</name>
<name>
<surname><![CDATA[De Vries]]></surname>
<given-names><![CDATA[R.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Scientists behaving badly]]></article-title>
<source><![CDATA[Nature]]></source>
<year>2005</year>
<volume>435</volume>
<numero>7043</numero>
<issue>7043</issue>
<page-range>737</page-range></nlm-citation>
</ref>
<ref id="B36">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Marusic]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
<name>
<surname><![CDATA[Wager]]></surname>
<given-names><![CDATA[E.]]></given-names>
</name>
<name>
<surname><![CDATA[Utrobicic]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
<name>
<surname><![CDATA[Rothstein]]></surname>
<given-names><![CDATA[H. R.]]></given-names>
</name>
<name>
<surname><![CDATA[Sambunjak]]></surname>
<given-names><![CDATA[D.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Interventions to prevent misconduct and promote integrity in research and publication]]></article-title>
<source><![CDATA[Cochrane Database of Systematic Reviews]]></source>
<year>2016</year>
<volume>4</volume>
</nlm-citation>
</ref>
<ref id="B37">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Mueller]]></surname>
<given-names><![CDATA[G. P.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[When the search for truth fails: A computer simulation of the impact of the publication bias on the meta-analysis of scientific literature]]></article-title>
<source><![CDATA[Scientometrics]]></source>
<year>2018</year>
<volume>117</volume>
<numero>3</numero>
<issue>3</issue>
<page-range>2061-76</page-range></nlm-citation>
</ref>
<ref id="B38">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Pashler]]></surname>
<given-names><![CDATA[H.]]></given-names>
</name>
<name>
<surname><![CDATA[Harris]]></surname>
<given-names><![CDATA[C. R.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Is the replicability crisis overblown? Three arguments examined]]></article-title>
<source><![CDATA[Perspectives on Psychological Science]]></source>
<year>2012</year>
<volume>7</volume>
<numero>6</numero>
<issue>6</issue>
<page-range>531-6</page-range></nlm-citation>
</ref>
<ref id="B39">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Pashler]]></surname>
<given-names><![CDATA[H.]]></given-names>
</name>
<name>
<surname><![CDATA[Wagenmakers]]></surname>
<given-names><![CDATA[E.J.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Editors' Introduction to the Special Section on Replicability in Psychological Science: A Crisis of Confidence?]]></article-title>
<source><![CDATA[Perspectives on Psychological Science]]></source>
<year>2012</year>
<volume>7</volume>
<page-range>528-30</page-range></nlm-citation>
</ref>
<ref id="B40">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Richard]]></surname>
<given-names><![CDATA[F. D.]]></given-names>
</name>
<name>
<surname><![CDATA[Bond Jr.]]></surname>
<given-names><![CDATA[C. F.]]></given-names>
</name>
<name>
<surname><![CDATA[Stokes-Zoota]]></surname>
<given-names><![CDATA[J. J.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[One hundred years of social psychology quantitatively described]]></article-title>
<source><![CDATA[Review of General Psychology]]></source>
<year>2003</year>
<volume>7</volume>
<page-range>331-63</page-range></nlm-citation>
</ref>
<ref id="B41">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Ross]]></surname>
<given-names><![CDATA[L.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[From the fundamental attribution error to the truly fundamental attribution error and beyond: My research journey]]></article-title>
<source><![CDATA[Perspectives on Psychological Science]]></source>
<year>2018</year>
<volume>13</volume>
<numero>6</numero>
<issue>6</issue>
<page-range>750-69</page-range></nlm-citation>
</ref>
<ref id="B42">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Rothstein]]></surname>
<given-names><![CDATA[H. R.]]></given-names>
</name>
<name>
<surname><![CDATA[Sutton]]></surname>
<given-names><![CDATA[A. J.]]></given-names>
</name>
<name>
<surname><![CDATA[Borenstein]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
</person-group>
<source><![CDATA[Publication bias in meta-analysis: Prevention, assessment, and adjustments]]></source>
<year>2005</year>
<publisher-loc><![CDATA[Nueva York ]]></publisher-loc>
<publisher-name><![CDATA[Wiley]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B43">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Rubio-Aparicio]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[Marín-Martínez]]></surname>
<given-names><![CDATA[F.]]></given-names>
</name>
<name>
<surname><![CDATA[Sánchez-Meca]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
<name>
<surname><![CDATA[López-López]]></surname>
<given-names><![CDATA[J. A.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[A methodological review of meta-analyses of the effectiveness of clinical psychology treatments]]></article-title>
<source><![CDATA[Behavior Research Methods]]></source>
<year>2018</year>
<volume>50</volume>
<numero>5</numero>
<issue>5</issue>
<page-range>2057-73</page-range></nlm-citation>
</ref>
<ref id="B44">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Schneck]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Examining publication bias-a simulation-based evaluation of statistical tests on publication bias]]></article-title>
<source><![CDATA[PeerJ]]></source>
<year>2018</year>
<volume>5</volume>
<edition>e4115</edition>
</nlm-citation>
</ref>
<ref id="B45">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Sijtsma]]></surname>
<given-names><![CDATA[K.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Playing with data-or how to discourage questionable research practices and stimulate researchers to do things right]]></article-title>
<source><![CDATA[Psychometrika]]></source>
<year>2016</year>
<volume>81</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>1-15</page-range></nlm-citation>
</ref>
<ref id="B46">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Simmons]]></surname>
<given-names><![CDATA[J. P.]]></given-names>
</name>
<name>
<surname><![CDATA[Nelson]]></surname>
<given-names><![CDATA[L. D.]]></given-names>
</name>
<name>
<surname><![CDATA[Simonsohn]]></surname>
<given-names><![CDATA[U.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant]]></article-title>
<source><![CDATA[Psychological Science]]></source>
<year>2011</year>
<volume>22</volume>
<numero>11</numero>
<issue>11</issue>
<page-range>1359-66</page-range></nlm-citation>
</ref>
<ref id="B47">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Simonsohn]]></surname>
<given-names><![CDATA[U.]]></given-names>
</name>
<name>
<surname><![CDATA[Nelson]]></surname>
<given-names><![CDATA[L. D.]]></given-names>
</name>
<name>
<surname><![CDATA[Simmons]]></surname>
<given-names><![CDATA[J. P.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[P-curve: a key to the file-drawer]]></article-title>
<source><![CDATA[Journal of Experimental Psychology: General]]></source>
<year>2014</year>
<volume>143</volume>
<numero>2</numero>
<issue>2</issue>
<page-range>534</page-range></nlm-citation>
</ref>
<ref id="B48">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Simonsohn]]></surname>
<given-names><![CDATA[U.]]></given-names>
</name>
<name>
<surname><![CDATA[Nelson]]></surname>
<given-names><![CDATA[L. D.]]></given-names>
</name>
<name>
<surname><![CDATA[Simmons]]></surname>
<given-names><![CDATA[J. P.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[p-curve and effect size: Correcting for publication bias using only significant results]]></article-title>
<source><![CDATA[Perspectives on Psychological Science]]></source>
<year>2014</year>
<volume>9</volume>
<page-range>666-81</page-range></nlm-citation>
</ref>
<ref id="B49">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Stricker]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
<name>
<surname><![CDATA[Günther]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Scientific misconduct in psychology: A systematic review of prevalence estimates and new empirical data]]></article-title>
<source><![CDATA[Zeitschrift für Psychologie]]></source>
<year>2019</year>
<volume>227</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>53</page-range></nlm-citation>
</ref>
<ref id="B50">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Ulrich]]></surname>
<given-names><![CDATA[R.]]></given-names>
</name>
<name>
<surname><![CDATA[Miller]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[p-hacking by post hoc selection with multiple opportunities: Detectability by skewness test?: Comment on Simonsohn, Nelson, and Simmons (2014)]]></article-title>
<source><![CDATA[Journal of Experimental Psychology: General]]></source>
<year>2015</year>
<volume>144</volume>
<numero>6</numero>
<issue>6</issue>
<page-range>1137-45</page-range></nlm-citation>
</ref>
<ref id="B51">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Ulrich]]></surname>
<given-names><![CDATA[R.]]></given-names>
</name>
<name>
<surname><![CDATA[Miller]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Some properties of p-curves, with an application to gradual publication bias]]></article-title>
<source><![CDATA[Psychological Methods]]></source>
<year>2018</year>
<volume>23</volume>
<numero>3</numero>
<issue>3</issue>
<page-range>546</page-range></nlm-citation>
</ref>
<ref id="B52">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[van Aert]]></surname>
<given-names><![CDATA[R. C.]]></given-names>
</name>
<name>
<surname><![CDATA[Wicherts]]></surname>
<given-names><![CDATA[J. M.]]></given-names>
</name>
<name>
<surname><![CDATA[van Assen]]></surname>
<given-names><![CDATA[M. A.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Publication bias examined in meta-analyses from psychology and medicine: A meta-meta-analysis]]></article-title>
<source><![CDATA[PloS One]]></source>
<year>2019</year>
<volume>14</volume>
<numero>4</numero>
<issue>4</issue>
</nlm-citation>
</ref>
<ref id="B53">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[van Assen]]></surname>
<given-names><![CDATA[M. A. L. M.]]></given-names>
</name>
<name>
<surname><![CDATA[van Aert]]></surname>
<given-names><![CDATA[R. C. M.]]></given-names>
</name>
<name>
<surname><![CDATA[Wicherts]]></surname>
<given-names><![CDATA[J. M.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Meta-analysis using effect size distributions of only statistically significant studies]]></article-title>
<source><![CDATA[Psychological Methods]]></source>
<year>2015</year>
<volume>20</volume>
<page-range>293-309</page-range></nlm-citation>
</ref>
<ref id="B54">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Wigboldus]]></surname>
<given-names><![CDATA[D. H.]]></given-names>
</name>
<name>
<surname><![CDATA[Dotsch]]></surname>
<given-names><![CDATA[R.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Encourage playing with data and discourage questionable reporting practices]]></article-title>
<source><![CDATA[Psychometrika]]></source>
<year>2016</year>
<volume>81</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>27-32</page-range></nlm-citation>
</ref>
<ref id="B55">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Yong]]></surname>
<given-names><![CDATA[E.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[In the wake of high-profile controversies, psychologists are facing up to problems with replication]]></article-title>
<source><![CDATA[Nature]]></source>
<year>2012</year>
<volume>485</volume>
<page-range>298-300</page-range></nlm-citation>
</ref>
</ref-list>
</back>
</article>
