<?xml version="1.0" encoding="ISO-8859-1"?><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
<front>
<journal-meta>
<journal-id>1886-144X</journal-id>
<journal-title><![CDATA[Psicothema]]></journal-title>
<abbrev-journal-title><![CDATA[Psicothema]]></abbrev-journal-title>
<issn>1886-144X</issn>
<publisher>
<publisher-name><![CDATA[Colegio Oficial de Psicólogos del Principado de Asturias]]></publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id>S1886-144X2024000200005</article-id>
<article-id pub-id-type="doi">10.7334/psicothema2023.208</article-id>
<title-group>
<article-title xml:lang="en"><![CDATA[Enhancing content validity assessment with item response theory modeling]]></article-title>
<article-title xml:lang="es"><![CDATA[Mejorando la evaluación de la validez del contenido a través del modelado de la teoría de respuesta al ítem]]></article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Schames-Kreitchmann]]></surname>
<given-names><![CDATA[Rodrigo]]></given-names>
</name>
<xref ref-type="aff" rid="Aff"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Nájera]]></surname>
<given-names><![CDATA[Pablo]]></given-names>
</name>
<xref ref-type="aff" rid="Aff"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Sanz]]></surname>
<given-names><![CDATA[Susana]]></given-names>
</name>
<xref ref-type="aff" rid="Aff"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Sorrel]]></surname>
<given-names><![CDATA[Miguel Ángel]]></given-names>
</name>
<xref ref-type="aff" rid="Aff"/>
</contrib>
</contrib-group>
<aff id="Af1">
<institution><![CDATA[,Universidad Nacional de Educación a Distancia  ]]></institution>
<addr-line><![CDATA[ ]]></addr-line>
<country>Spain</country>
</aff>
<aff id="Af2">
<institution><![CDATA[,Universidad Autónoma de Madrid  ]]></institution>
<addr-line><![CDATA[ ]]></addr-line>
<country>Spain</country>
</aff>
<pub-date pub-type="pub">
<day>00</day>
<month>00</month>
<year>2024</year>
</pub-date>
<pub-date pub-type="epub">
<day>00</day>
<month>00</month>
<year>2024</year>
</pub-date>
<volume>36</volume>
<numero>2</numero>
<fpage>145</fpage>
<lpage>153</lpage>
<copyright-statement/>
<copyright-year/>
<self-uri xlink:href="http://scielo.isciii.es/scielo.php?script=sci_arttext&amp;pid=S1886-144X2024000200005&amp;lng=en&amp;nrm=iso"></self-uri><self-uri xlink:href="http://scielo.isciii.es/scielo.php?script=sci_abstract&amp;pid=S1886-144X2024000200005&amp;lng=en&amp;nrm=iso"></self-uri><self-uri xlink:href="http://scielo.isciii.es/scielo.php?script=sci_pdf&amp;pid=S1886-144X2024000200005&amp;lng=en&amp;nrm=iso"></self-uri><abstract abstract-type="short" xml:lang="en"><p><![CDATA[Abstract:  Background: Ensuring the validity of assessments requires a thorough examination of the test content. Subject matter experts (SMEs) are commonly employed to evaluate the relevance, representativeness, and appropriateness of the items. This article proposes incorporating item response theory (IRT) into model assessments conducted by SMEs. Using IRT allows for the estimation of discrimination and threshold parameters for each SME, providing evidence of their performance in differentiating relevant from irrelevant items, thus facilitating the detection of suboptimal SME performance while improving item relevance scores.  Method: Use of IRT was compared to traditional validity indices (content validity index and Aiken's V) in the evaluation of conscientiousness items. The aim was to assess the SMEs&#8217; accuracy in identifying whether items were designed to measure conscientiousness or not, and predicting their factor loadings.  Results: The IRT-based scores effectively identified conscientiousness items (R2 = 0.57) and accurately predicted their factor loadings (R2 = 0.45). These scores demonstrated incremental validity, explaining 11% more variance than Aiken's V and up to 17% more than the content validity index.  Conclusions: Modeling SME assessments with IRT improves item alignment and provides better predictions of factor loadings, enabling improvement of the content validity of measurement instruments.]]></p></abstract>
<abstract abstract-type="short" xml:lang="es"><p><![CDATA[Resumen:  Antecedentes: Garantizar la validez de evaluaciones requiere un examen exhaustivo del contenido de una prueba. Es común emplear expertos en la materia (EM) para evaluar la relevancia, representatividad y adecuación de los ítems. Este artículo propone integrar la teoría de respuesta al ítem (TRI) en las evaluaciones hechas por EM. La TRI ofrece parámetros de discriminación y umbral de los EM, evidenciando su desempeño al diferenciar ítems relevantes/irrelevantes, detectando desempeños subóptimos, mejorando también la estimación de la relevancia de los ítems.  Método: Se comparó el uso de la TRI frente a índices tradicionales (índice de validez de contenido y V de Aiken) en ítems de responsabilidad. Se evaluó la precisión de los EM al discriminar si los ítems medían responsabilidad o no, y si sus evaluaciones permitían predecir los pesos factoriales de los ítems.  Resultados: Las puntuaciones de TRI identificaron bien los ítems de responsabilidad (R2 = 0,57) y predijeron sus cargas factoriales (R2 = 0,45). Además, mostraron validez incremental, explicando entre 11% y 17% más de varianza que los índices tradicionales.  Conclusiones: La TRI en las evaluaciones de los EM mejora la alineación de ítems y predice mejor los pesos factoriales, mejorando validez del contenido de los instrumentos.]]></p></abstract>
<kwd-group>
<kwd lng="en"><![CDATA[Content validity]]></kwd>
<kwd lng="en"><![CDATA[Subject matter experts]]></kwd>
<kwd lng="en"><![CDATA[Item response theory]]></kwd>
<kwd lng="en"><![CDATA[Validity]]></kwd>
<kwd lng="en"><![CDATA[Test development]]></kwd>
<kwd lng="es"><![CDATA[Validez de contenido]]></kwd>
<kwd lng="es"><![CDATA[Expertos en la materia]]></kwd>
<kwd lng="es"><![CDATA[Teoría de respuesta al ítem]]></kwd>
<kwd lng="es"><![CDATA[Validez]]></kwd>
<kwd lng="es"><![CDATA[Desarrollo de tests]]></kwd>
</kwd-group>
</article-meta>
</front><back>
<ref-list>
<ref id="B1">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Abad]]></surname>
<given-names><![CDATA[F. J]]></given-names>
</name>
<name>
<surname><![CDATA[Sorrel]]></surname>
<given-names><![CDATA[M. A]]></given-names>
</name>
<name>
<surname><![CDATA[Garcia]]></surname>
<given-names><![CDATA[L. F]]></given-names>
</name>
<name>
<surname><![CDATA[Aluja]]></surname>
<given-names><![CDATA[A]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Modeling general, specific, and method variance in personality measures: Results for ZKA-PQ and NEO-PI-R]]></article-title>
<source><![CDATA[Assessment]]></source>
<year>2018</year>
<volume>25</volume>
<numero>8</numero>
<issue>8</issue>
<page-range>959-77</page-range></nlm-citation>
</ref>
<ref id="B2">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Aiken]]></surname>
<given-names><![CDATA[L. R]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Content validity and reliability of single items or questionnaires]]></article-title>
<source><![CDATA[Educational and Psychological Measurement]]></source>
<year>1980</year>
<volume>40</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>955-9</page-range></nlm-citation>
</ref>
<ref id="B3">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Almanasreh]]></surname>
<given-names><![CDATA[E]]></given-names>
</name>
<name>
<surname><![CDATA[Moles]]></surname>
<given-names><![CDATA[R]]></given-names>
</name>
<name>
<surname><![CDATA[Chen]]></surname>
<given-names><![CDATA[T. F]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Evaluation of methods used for estimating content validity]]></article-title>
<source><![CDATA[Research in Social and Administrative Pharmacy]]></source>
<year>2019</year>
<volume>15</volume>
<numero>2</numero>
<issue>2</issue>
<page-range>214-21</page-range></nlm-citation>
</ref>
<ref id="B4">
<nlm-citation citation-type="book">
<collab>American Educational Research Association [AERA]</collab>
<collab>American Psychological Association [APA]</collab>
<collab>National Council on Measurement in Education [NCME]</collab>
<source><![CDATA[Standards for educational and psychological testing]]></source>
<year>2014</year>
<edition>14th ed</edition>
<publisher-name><![CDATA[American Educational Research Association]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B5">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Bhola]]></surname>
<given-names><![CDATA[D. S]]></given-names>
</name>
<name>
<surname><![CDATA[Impara]]></surname>
<given-names><![CDATA[J. C]]></given-names>
</name>
<name>
<surname><![CDATA[Buckendahl]]></surname>
<given-names><![CDATA[C. W]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Aligning tests with States&#8217; content standards: Methods and issues]]></article-title>
<source><![CDATA[Educational Measurement: Issues and Practice]]></source>
<year>2003</year>
<volume>22</volume>
<numero>3</numero>
<issue>3</issue>
<page-range>21-9</page-range></nlm-citation>
</ref>
<ref id="B6">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Chalmers]]></surname>
<given-names><![CDATA[R. P]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[mirt: A multidimensional item response theory package for the R environment]]></article-title>
<source><![CDATA[Journal of Statistical Software]]></source>
<year>2012</year>
<volume>48</volume>
<numero>6</numero>
<issue>6</issue>
<page-range>1-29</page-range></nlm-citation>
</ref>
<ref id="B7">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Collado]]></surname>
<given-names><![CDATA[S]]></given-names>
</name>
<name>
<surname><![CDATA[Corraliza]]></surname>
<given-names><![CDATA[J. A]]></given-names>
</name>
<name>
<surname><![CDATA[Sorrel]]></surname>
<given-names><![CDATA[M. A]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Spanish version of the Children&#8217;s Ecological Behavior (CEB) scale]]></article-title>
<source><![CDATA[Psicothema]]></source>
<year>2015</year>
<volume>27</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>82-7</page-range></nlm-citation>
</ref>
<ref id="B8">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Costa Jr]]></surname>
<given-names><![CDATA[P. T]]></given-names>
</name>
<name>
<surname><![CDATA[McCrae]]></surname>
<given-names><![CDATA[R. R]]></given-names>
</name>
</person-group>
<source><![CDATA[Revised NEO Personaliry Inventory (NEO-PI-R) and NEO Five-Factor Inventory (NEO-FFI) professional manual]]></source>
<year>1992</year>
<publisher-name><![CDATA[Psychological Assessment Resources]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B9">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Fitzpatrick]]></surname>
<given-names><![CDATA[A. R]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[The meaning of content validity]]></article-title>
<source><![CDATA[Applied Psychological Measurement]]></source>
<year>1983</year>
<volume>7</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>3-13</page-range></nlm-citation>
</ref>
<ref id="B10">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[García]]></surname>
<given-names><![CDATA[P. E]]></given-names>
</name>
<name>
<surname><![CDATA[Díaz]]></surname>
<given-names><![CDATA[J. O]]></given-names>
</name>
<name>
<surname><![CDATA[Torre]]></surname>
<given-names><![CDATA[J. de la]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Application of cognitive diagnosis models to competency-based situational judgment tests]]></article-title>
<source><![CDATA[Psicothema]]></source>
<year>2014</year>
<volume>26</volume>
<numero>3</numero>
<issue>3</issue>
<page-range>372-7</page-range></nlm-citation>
</ref>
<ref id="B11">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Gómez-Benito]]></surname>
<given-names><![CDATA[J]]></given-names>
</name>
<name>
<surname><![CDATA[Sireci]]></surname>
<given-names><![CDATA[S]]></given-names>
</name>
<name>
<surname><![CDATA[Padilla]]></surname>
<given-names><![CDATA[J.-L]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Differential item functioning: Beyond validity evidence based on internal structure]]></article-title>
<source><![CDATA[Psicothema]]></source>
<year>2018</year>
<volume>30</volume>
<page-range>104-9</page-range></nlm-citation>
</ref>
<ref id="B12">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Jennrich]]></surname>
<given-names><![CDATA[R. I]]></given-names>
</name>
<name>
<surname><![CDATA[Bentler]]></surname>
<given-names><![CDATA[P. M]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Exploratory bi-factor analysis]]></article-title>
<source><![CDATA[Psychometrika]]></source>
<year>2011</year>
<volume>76</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>537-49</page-range></nlm-citation>
</ref>
<ref id="B13">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Kreitchmann]]></surname>
<given-names><![CDATA[R. S]]></given-names>
</name>
<name>
<surname><![CDATA[Abad]]></surname>
<given-names><![CDATA[F. J]]></given-names>
</name>
<name>
<surname><![CDATA[Ponsoda]]></surname>
<given-names><![CDATA[V]]></given-names>
</name>
<name>
<surname><![CDATA[Nieto]]></surname>
<given-names><![CDATA[M. D]]></given-names>
</name>
<name>
<surname><![CDATA[Morillo]]></surname>
<given-names><![CDATA[D]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Controlling for response biases in self-report scales: Forced-choice vs. psychometric modeling of likert items]]></article-title>
<source><![CDATA[Frontiers in Psychology]]></source>
<year>2019</year>
<volume>10</volume>
</nlm-citation>
</ref>
<ref id="B14">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Li]]></surname>
<given-names><![CDATA[X]]></given-names>
</name>
<name>
<surname><![CDATA[Sireci]]></surname>
<given-names><![CDATA[S. G]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[A new method for analyzing content validity data using multidimensional scaling]]></article-title>
<source><![CDATA[Educational and Psychological Measurement]]></source>
<year>2013</year>
<volume>73</volume>
<numero>3</numero>
<issue>3</issue>
<page-range>365-85</page-range></nlm-citation>
</ref>
<ref id="B15">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Lunz]]></surname>
<given-names><![CDATA[M. E]]></given-names>
</name>
<name>
<surname><![CDATA[Stahl]]></surname>
<given-names><![CDATA[J. A]]></given-names>
</name>
<name>
<surname><![CDATA[Wright]]></surname>
<given-names><![CDATA[B. D]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Interjudge reliability and decision reproducibility]]></article-title>
<source><![CDATA[Educational and Psychological Measurement]]></source>
<year>1994</year>
<volume>54</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>913-25</page-range></nlm-citation>
</ref>
<ref id="B16">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Lunz]]></surname>
<given-names><![CDATA[M. E]]></given-names>
</name>
<name>
<surname><![CDATA[Wright]]></surname>
<given-names><![CDATA[B. D]]></given-names>
</name>
<name>
<surname><![CDATA[Linacre]]></surname>
<given-names><![CDATA[J. M]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Measuring the impact of judge severity on examination scores]]></article-title>
<source><![CDATA[Applied Measurement in Education]]></source>
<year>1990</year>
<volume>3</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>331-45</page-range></nlm-citation>
</ref>
<ref id="B17">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Martone]]></surname>
<given-names><![CDATA[A]]></given-names>
</name>
<name>
<surname><![CDATA[Sireci]]></surname>
<given-names><![CDATA[S. G]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Evaluating alignment between curriculum, assessment, and instruction]]></article-title>
<source><![CDATA[Review of Educational Research]]></source>
<year>2009</year>
<volume>79</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>1332-61</page-range></nlm-citation>
</ref>
<ref id="B18">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Martuza]]></surname>
<given-names><![CDATA[V. R]]></given-names>
</name>
</person-group>
<source><![CDATA[Applying norm-referenced and criterion-referenced measurement in education]]></source>
<year>1977</year>
<publisher-name><![CDATA[Allyn and Bacon]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B19">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Mastaglia]]></surname>
<given-names><![CDATA[B]]></given-names>
</name>
<name>
<surname><![CDATA[Toye]]></surname>
<given-names><![CDATA[C]]></given-names>
</name>
<name>
<surname><![CDATA[Kristjanson]]></surname>
<given-names><![CDATA[L. J]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Ensuring content validity in instrument development: Challenges and innovative approaches]]></article-title>
<source><![CDATA[Contemporary Nurse]]></source>
<year>2003</year>
<volume>14</volume>
<numero>3</numero>
<issue>3</issue>
<page-range>281-91</page-range></nlm-citation>
</ref>
<ref id="B20">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[McCoach]]></surname>
<given-names><![CDATA[D. B]]></given-names>
</name>
<name>
<surname><![CDATA[Gable]]></surname>
<given-names><![CDATA[R. K]]></given-names>
</name>
<name>
<surname><![CDATA[Madura]]></surname>
<given-names><![CDATA[J. P]]></given-names>
</name>
</person-group>
<source><![CDATA[Instrument development in the affective domain: School and corporate applications]]></source>
<year>2013</year>
<publisher-name><![CDATA[Springer]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B21">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Nájera]]></surname>
<given-names><![CDATA[P]]></given-names>
</name>
<name>
<surname><![CDATA[Abad]]></surname>
<given-names><![CDATA[F. J]]></given-names>
</name>
<name>
<surname><![CDATA[Sorrel]]></surname>
<given-names><![CDATA[M. A]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Determining the number of attributes in cognitive diagnosis modeling]]></article-title>
<source><![CDATA[Frontiers in Psychology]]></source>
<year>2021</year>
<volume>12</volume>
</nlm-citation>
</ref>
<ref id="B22">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Nieto]]></surname>
<given-names><![CDATA[M. D]]></given-names>
</name>
<name>
<surname><![CDATA[Abad]]></surname>
<given-names><![CDATA[F. J]]></given-names>
</name>
<name>
<surname><![CDATA[Hernández-Camacho]]></surname>
<given-names><![CDATA[A]]></given-names>
</name>
<name>
<surname><![CDATA[Garrido]]></surname>
<given-names><![CDATA[L. E]]></given-names>
</name>
<name>
<surname><![CDATA[Barrada]]></surname>
<given-names><![CDATA[J. R]]></given-names>
</name>
<name>
<surname><![CDATA[Aguado]]></surname>
<given-names><![CDATA[D]]></given-names>
</name>
<name>
<surname><![CDATA[Olea]]></surname>
<given-names><![CDATA[J]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Calibrating a new item pool to adaptively assess the Big Five]]></article-title>
<source><![CDATA[Psicothema]]></source>
<year>2017</year>
<volume>29</volume>
<numero>3</numero>
<issue>3</issue>
<page-range>390-5</page-range></nlm-citation>
</ref>
<ref id="B23">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Oltmanns]]></surname>
<given-names><![CDATA[J. R]]></given-names>
</name>
<name>
<surname><![CDATA[Widiger]]></surname>
<given-names><![CDATA[T. A]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[The five-factor personality inventory for ICD-11: A aacet-level assessment of the ICD-11 trait model]]></article-title>
<source><![CDATA[Psychological Assessment]]></source>
<year>2020</year>
<volume>32</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>60-71</page-range></nlm-citation>
</ref>
<ref id="B24">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Penfield]]></surname>
<given-names><![CDATA[R. D]]></given-names>
</name>
<name>
<surname><![CDATA[Giacobbi]]></surname>
<given-names><![CDATA[Jr]]></given-names>
</name>
<name>
<surname><![CDATA[Peter]]></surname>
<given-names><![CDATA[R]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Applying a score confidence interval to Aiken&#8217;s item content-relevance index]]></article-title>
<source><![CDATA[Measurement in Physical Education and Exercise Science]]></source>
<year>2004</year>
<volume>8</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>213-25</page-range></nlm-citation>
</ref>
<ref id="B25">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Polit]]></surname>
<given-names><![CDATA[D. F]]></given-names>
</name>
<name>
<surname><![CDATA[Beck]]></surname>
<given-names><![CDATA[C. T]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[The content validity index: Are you sure you know what&#8217;s being reported? critique and recommendations]]></article-title>
<source><![CDATA[Research in Nursing &amp; Health]]></source>
<year>2006</year>
<volume>29</volume>
<numero>5</numero>
<issue>5</issue>
<page-range>489-97</page-range></nlm-citation>
</ref>
<ref id="B26">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Porter]]></surname>
<given-names><![CDATA[A. C]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Measuring the content of instruction: Uses in research and practice]]></article-title>
<source><![CDATA[Educational Researcher]]></source>
<year>2002</year>
<volume>31</volume>
<numero>7</numero>
<issue>7</issue>
<page-range>3-14</page-range></nlm-citation>
</ref>
<ref id="B27">
<nlm-citation citation-type="book">
<collab>R Core Team</collab>
<source><![CDATA[R: A language and environment for statistical computing]]></source>
<year>2023</year>
<publisher-name><![CDATA[R Foundation for Statistical Computing]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B28">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Rios]]></surname>
<given-names><![CDATA[J]]></given-names>
</name>
<name>
<surname><![CDATA[Wells]]></surname>
<given-names><![CDATA[C]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Validity evidence based on internal structure]]></article-title>
<source><![CDATA[Psicothema]]></source>
<year>2014</year>
<volume>26</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>108-16</page-range></nlm-citation>
</ref>
<ref id="B29">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Robitzsch]]></surname>
<given-names><![CDATA[A]]></given-names>
</name>
<name>
<surname><![CDATA[Steinfeld]]></surname>
<given-names><![CDATA[J]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Item response models for human ratings: Overview, estimation methods, and implementation in R]]></article-title>
<source><![CDATA[Psychological Test and Assessment Modeling]]></source>
<year>2018</year>
<volume>60</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>101-38</page-range></nlm-citation>
</ref>
<ref id="B30">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Rovinelli]]></surname>
<given-names><![CDATA[R. J]]></given-names>
</name>
<name>
<surname><![CDATA[Hambleton]]></surname>
<given-names><![CDATA[R. K]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[On the use of content specialists in the assessment of criterion-referenced test item validity]]></article-title>
<source><![CDATA[Dutch Journal of Educational Research]]></source>
<year>1977</year>
<volume>2</volume>
<page-range>49-60</page-range></nlm-citation>
</ref>
<ref id="B31">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Rubio]]></surname>
<given-names><![CDATA[D. M]]></given-names>
</name>
<name>
<surname><![CDATA[Berg-Weger]]></surname>
<given-names><![CDATA[M]]></given-names>
</name>
<name>
<surname><![CDATA[Tebb]]></surname>
<given-names><![CDATA[S. S]]></given-names>
</name>
<name>
<surname><![CDATA[Lee]]></surname>
<given-names><![CDATA[E. S]]></given-names>
</name>
<name>
<surname><![CDATA[Rauch]]></surname>
<given-names><![CDATA[S]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Objectifying content validity: Conducting a content validity study in social work research]]></article-title>
<source><![CDATA[Social Work Research]]></source>
<year>2003</year>
<volume>27</volume>
<numero>2</numero>
<issue>2</issue>
<page-range>94-104</page-range></nlm-citation>
</ref>
<ref id="B32">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Samejima]]></surname>
<given-names><![CDATA[F]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Estimation of latent ability using a response pattern of graded scores]]></article-title>
<source><![CDATA[Psychometrika Monograph Supplement]]></source>
<year>1968</year>
<volume>34</volume>
<numero>4, Pt. 2</numero>
<issue>4, Pt. 2</issue>
<page-range>100</page-range></nlm-citation>
</ref>
<ref id="B33">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Sireci]]></surname>
<given-names><![CDATA[S. G]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Gathering and analyzing content validity data]]></article-title>
<source><![CDATA[Educational Assessment]]></source>
<year>1998</year>
<volume>5</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>299-321</page-range></nlm-citation>
</ref>
<ref id="B34">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Sireci]]></surname>
<given-names><![CDATA[S. G]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[The construct of content validity]]></article-title>
<source><![CDATA[Social Indicators Research]]></source>
<year>1998</year>
<volume>45</volume>
<numero>1/3</numero>
<issue>1/3</issue>
<page-range>83-117</page-range></nlm-citation>
</ref>
<ref id="B35">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Sireci]]></surname>
<given-names><![CDATA[S]]></given-names>
</name>
<name>
<surname><![CDATA[Benítez]]></surname>
<given-names><![CDATA[I]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Evidence for test validation: A guide for practitioners]]></article-title>
<source><![CDATA[Psicothema]]></source>
<year>2023</year>
<volume>35</volume>
<numero>3</numero>
<issue>3</issue>
<page-range>217-26</page-range></nlm-citation>
</ref>
<ref id="B36">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Sireci]]></surname>
<given-names><![CDATA[S. G]]></given-names>
</name>
<name>
<surname><![CDATA[Faulkner-Bond]]></surname>
<given-names><![CDATA[M]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Validity evidence based on test content]]></article-title>
<source><![CDATA[Psicothema]]></source>
<year>2014</year>
<volume>26</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>100-7</page-range></nlm-citation>
</ref>
<ref id="B37">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Tatsuoka]]></surname>
<given-names><![CDATA[K. K]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Rule Space: An Approach for Dealing with Misconceptions Based on Item Response Theory]]></article-title>
<source><![CDATA[Journal of Educational Measurement]]></source>
<year>1983</year>
<volume>20</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>345-54</page-range></nlm-citation>
</ref>
<ref id="B38">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Thissen]]></surname>
<given-names><![CDATA[D]]></given-names>
</name>
<name>
<surname><![CDATA[Wainer]]></surname>
<given-names><![CDATA[H]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Some standard errors in item response theory]]></article-title>
<source><![CDATA[Psychometrika]]></source>
<year>1982</year>
<volume>47</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>397-412</page-range></nlm-citation>
</ref>
<ref id="B39">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Waugh]]></surname>
<given-names><![CDATA[M. H]]></given-names>
</name>
<name>
<surname><![CDATA[McClain]]></surname>
<given-names><![CDATA[C. M]]></given-names>
</name>
<name>
<surname><![CDATA[Mariotti]]></surname>
<given-names><![CDATA[E. C]]></given-names>
</name>
<name>
<surname><![CDATA[Mulay]]></surname>
<given-names><![CDATA[A. L]]></given-names>
</name>
<name>
<surname><![CDATA[DeVore]]></surname>
<given-names><![CDATA[E. N]]></given-names>
</name>
<name>
<surname><![CDATA[Lenger]]></surname>
<given-names><![CDATA[K. A]]></given-names>
</name>
<name>
<surname><![CDATA[Russell]]></surname>
<given-names><![CDATA[A. N]]></given-names>
</name>
<name>
<surname><![CDATA[Florimbio]]></surname>
<given-names><![CDATA[A. R]]></given-names>
</name>
<name>
<surname><![CDATA[Lewis]]></surname>
<given-names><![CDATA[K. C]]></given-names>
</name>
<name>
<surname><![CDATA[Ridenour]]></surname>
<given-names><![CDATA[J. M]]></given-names>
</name>
<name>
<surname><![CDATA[Beevers]]></surname>
<given-names><![CDATA[L. G]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Comparative content analysis of self-report scales for level of personality functioning]]></article-title>
<source><![CDATA[Journal of Personality Assessment]]></source>
<year>2021</year>
<volume>103</volume>
<page-range>161-73</page-range></nlm-citation>
</ref>
<ref id="B40">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Webb]]></surname>
<given-names><![CDATA[N. L]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Issues related to judging the alignment of curriculum standards and assessments]]></article-title>
<source><![CDATA[Applied Measurement in Education]]></source>
<year>2007</year>
<volume>20</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>7-25</page-range></nlm-citation>
</ref>
<ref id="B41">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Wu]]></surname>
<given-names><![CDATA[M]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Some IRT-based analyses for interpreting rater effects]]></article-title>
<source><![CDATA[Psychological Test and Assessment Modeling]]></source>
<year>2017</year>
<volume>59</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>453-70</page-range></nlm-citation>
</ref>
</ref-list>
</back>
</article>
