Introduction
Physical education (PE) classes become a fundamental context for promoting youth’s physical activity (PA) participation. PE lessons are presented to adolescents of all level of abilities as a mandatory subject in most school countries systems. Positive experiences in PE may be important not only to encourage health benefits by helping them meet current PA recommendations (World Health Organization, 2010), but also in promoting lifelong PA habits, which can impact on future public health (Molina-García, Queralt, Estevan, & Sallis, 2016). Thus, effective experiences in PE classes seem an important arena for children and adolescents health, and PE teachers’ behaviours have considerable potential to impact in the motivational, affective and behavioural responses of their students.
Transformational leadership theory (Bass, 1985; Burns, 1978) has been the most studied paradigm for understanding the effects of leaders’ behaviours on their followers in the field of applied psychology (Álvarez, Lila, Tomás, & Castillo, 2016; Beauchamp & Morton, 2011, Molero, Cuadrado, Navas, & Morales, 2007). This theory emphasizes on leadership styles as a way to enhance followers’ intrinsic motivation and development.
Burns (1978) set the stage for the evolution of the transformational leadership (TL) concept and was subsequently developed by Bass and colleagues (Bass, 1985, Bass & Avolio, 1995) trying to response to the lack of empirical evidence to support Burns’ theory. According to Bass and Riggio (2006), transformational leaders play a positive role model (idealized influence); they are able to inspire followers to move into action to create a shared vision, aligning the vision and the goals of the follower with the goals and needs of the group (inspirational motivation). Transformational leaders are concerned about being in tune with the followers’ needs and goals, are ready to understand the followers’ strengths, to pull out those strengths, and to satisfy the followers’ personal goals (individual consideration). And finally, leaders also stimulate followers to think in different ways to face new and old challenges and issues; dissension is not only permitted but stimulated (intellectual stimulation).
TL has been studied extensively in a diverse range of work settings (Barling, Christie, & Hoption, 2011) such as the organizational contexts (Molero, Recio, & Cuadrado, 2010; (Molero et al., 2007), police settings (Álvarez, Lila, Tomás, & Castillo, 2014; Densten, 2003), and also including the educational domains (Beauchamp et al., 2014). Therefore, TL theory represents a theoretical framework that can be applied to understand the effects of teachers’ leadership on their students in the field of PE (Álvarez et al., 2016; Beauchamp & Morton, 2011). In fact, one of the most recent applications of the TL theory has been made into adolescent PE and health promotion settings; and has been called Transformational Teaching (Beauchamp et al., 2010, (2014; Beauchamp & Morton 2011; Wilson et al., 2012). This teaching style involves ‘the demonstration of behaviours that empower and inspire students, transcend teachers’ own self-interests, and give students the confidence to achieve higher levels of functioning’ (Beauchamp & Morton, 2011, p. 133). Beauchamp and Morton (2011) developed a conceptual model regarding to proximal (within-school) and distal (out-of-school) effects. This model suggested that transformational behaviours displayed by school PE teachers enhanced engagement in PA within the PE class (proximal effect) and in PA in their leisure time (distal effect) in adolescents.
To evaluate transformational teaching, Beauchamp and colleagues (2010) developed and validated the Transformational Teaching Questionnaire (TTQ) in Canadian adolescents. This instrument measures four dimensions of transformational leadership (Idealized Influence, Inspirational Motivation, Intellectual Stimulation and Individual Consideration). The authors tested a model with the four dimensions specified as correlated first-order latent factors. However, each of the four factors were found to be highly correlated (r > .86) for what they decided to examine a second-order model, in which four first-order dimensions were specified as contributing towards a higher order latent variable, termed transformational teaching. Each of the subscales and the total scale were found to demonstrate good internal consistency (αs > .85).
Transformational teaching behaviours have been found to predict student self-determined motivation, positive affect responses and engagement (Beauchamp et al., 2010; Beauchamp & Morton, 2011; Wilson et al., 2012). Previous researchers found that transformational teaching behaviours were positively related to adaptive cognitive (belief and attitudes toward PE, motivation toward PE and PA), emotional (enjoyment of PE, satisfaction with the teacher), and behavioural (effort in-class of PA and leisure time on PA) responses among adolescents (e.g., Beauchamp et al., 2010). The tenets of TL have been tested with intervention programs (Beauchamp et al., 2011) aiming at modifying the behaviours of PE teachers towards the transformational style, in order to promote self-determined motivation, self-efficacy and the intention to remain physically active in adolescent students. In Beauchamp et al’s (2011) study, two months after the intervention (time 2), there was an increase in transformational teaching practices and improvements in all three dependent variables (self-determined motivation, self-efficacy and the intention to remain physically active) in the experimental group. Four months after the intervention (time 3), the improvement in self-determined motivation was maintained.
Considering previous empirical evidence, we would expect that TTQ scores will be related to motivational regulations. Concretely, we will hypothesize that student’s perceptions of transformational teaching will be positively associated with the most self-determined forms of motivation (intrinsic motivation and identified regulation) and negatively associated with the lowest self-determined forms of motivation (external regulation and amotivation). We would also expect that TTQ scores will show significant and positive relationship with enjoyment; significant and negative relationship will be expected with boredom.
Making summary of the ideas that have been introduced so far, we could say that transformational teaching is a key factor to enhance students’ PA inside and outside the school. In this line, it is clearly important to assess transformational teaching in the PA context. However, as far as we know, the translation and psychometric properties of a Spanish version of the scale in PE are yet to be established. Thus, the development of a Spanish version of the TTQ would cover a gap in the PA measurement field. The aim of the present study using samples of adolescents, in PE context, was twofold: (1) to translate the TTQ items into Spanish and examine the factor structure and reliability of the Spanish version of the TTQ, and (2) to confirm the factor structure of the TTQ, examine the reliability, test the TTQ invariance across gender, and provide evidence of validity based on the relationships with other variables.
Test translation and adaptation is a major concern in psychometric research (Balluerka, Gorostiaga, Alonso-Arbiol, & Haranburu, 2007; Muñiz, Elosua, & Hambleton, 2013) that will facilitate cross-cultural comparative research and should help in understanding diverse cultural variations. Testing for gender invariance would contribute to the TTQ validation process as far as the study of gender differences in followers' perceptions of the leader have been raised as an interesting topic (e.g., Antonakis et al., 2004); thus, future research could be interested in testing gender differences in the students’ perceptions of teacher’s leadership style.
Method
Participants
Study 1. 1066 secondary school students (502 males, 564 females; M age = 16.81 years; SD = 0.71, range 16-18), from 40 secondary schools from Valencian Community (Spain) volunteered to participate in this study.
Study 2. 1041 adolescents (495 males, 546 females; M age = 16.83 years; SD = 0.70, range 16-18) across 42 secondary schools from Valencian Community (Spain) volunteered to participate in this study.
Instruments
Students’ perceptions of their teachers’ behaviours were measured using the Transformational Teaching Questionnaire (TTQ; Beauchamp et al., 2010). The TTQ begins with the stem ‘My physical education teacher...’ and use a 5-point scale with anchors 1 (Not at all), 2 (Once in a while), 3 (Sometimes), 4 (Fairly often), and 5 (Frequently). The TTQ includes four subscales (each one made up of four items) to measure individualized consideration (e.g., ‘Shows that s/he cares about me’), idealized influence (e.g., ‘Acts as a person that I look up to’), intellectual stimulation (e.g., ‘Creates lessons that really encourage me to think’), and inspirational motivation (e.g., ‘Is enthusiastic about what I am capable of achieving’).
Students’ motivational regulations were assessed using the Spanish version (Moreno-Murcia, González-Cutre, & Chillón, 2009) of the Perceived Locus of Causality Scale (Goudas, Biddle, & Fox, 1994), in which students responded to 20 items (divided into five subscales made up of four items each) that measure intrinsic motivation (e.g., ‘Because PE is fun’), identified regulation (e.g., ‘Because I want to learn sport skills’), introjected regulation (e.g., ‘Because I want the teacher to think I’m a good student’), external regulation (e.g., ‘Because I’ll get into trouble if I don’t’), and amotivation (e.g., ‘But I really don’t know why’). The scale stem was ‘I participate in this physical education class…’ and the responses are rated on a 5-point Likert scale ranging from 1 (Totally disagree) to 5 (Totally agree). Previous research has confirmed the reliability of the instrument both with Spanish (Moreno-Murcia et al., 2009) and English samples (Goudas et al., 1994).
To assess the perception of enjoyment and boredom, we used the Spanish version (Castillo, Balaguer, & Duda, 2001) of the Intrinsic Satisfaction Classroom Scale (Duda & Nicholls, 1992), adapted to PE classes. The instrument has seven items divided into two scales that measure Satisfaction/Enjoyment (five items; e.g., ‘I usually enjoy learning at school’) and Boredom (two items; e.g., ‘I usually wish school would end quickly’). The students are requested to indicate their degree of agreement with the items rated on a 5-point Likert scale ranging from 1 (Totally disagree) to 5 (Totally agree). Previous research has confirmed the reliability of this instrument (Castillo et al., 2001; Duda & Nicholls, 1992).
Procedure
Prior to conducting the study, ethical approval was obtained from the lead author’s institutional review board. After selecting the schools randomly by area (simple random sampling) within the Authors’ Community from the list provided by the Ministry of Education, Research, Culture and Sports, a letter was sent to the director of the schools, informing them about the goals of the investigation and requesting their collaboration. All the schools contacted expressed interest in participating in the investigation. All participants provided informed consent before data collection. The questionnaires were responded to anonymously and voluntarily, and were completed by the students during a 10-minute interval in their classroom. The questionnaires were administered by at least one investigator simultaneously to all the class members. Neither the teacher nor the director of the school was present at any time during questionnaire administration. Students were encouraged to answer honestly and ask the investigator present if they had any questions.
The source English version of the TTQ was translated to Spanish following the back-translation procedure widely described in the literature (e.g., Hambleton & Kanjee, 1995). First, three native Spanish speakers independently translated the original English TTQ version into Spanish. Translation discrepancies among the three translated forms were discussed in order to develop an initial Spanish version of the questionnaire. Next, a second bilingual translator whose native language was English translated the initial Spanish version of the test back into English. The original and back-translated versions of the tests were then compared. Finally, translation differences revealed by the back translation procedure were corrected. After the back-translation procedure had concluded, a pilot study was carried out in order to test the adequacy of the questionnaire for use with Spanish teenagers. No problems were found, so this version was adopted as the final Spanish version of the TTQ (the Spanish version of the questionnaire can be obtained from the first author).
Statistical and Psychometric Analysis
Sample 1 was used to test factorial structure through exploratory factor analysis (EFA) and internal consistency. An independent sample (sample 2) was used to cross-validate the internal structure of the TTQ using confirmatory factor analysis (CFA), estimate the reliability of the scale’s scores, analyse gender invariance, and provide sources of validity based on relationships with other variables.
In both samples Cronbach’s alpha coefficient, Average Variance Extracted (AVE) and composite reliability value (rho) were estimated to evaluate internal consistency. For EFA, unweight least square was chosen as the extraction method, and an oblique rotation criterion was applied (Lloret-Segura, Ferreres-Traver, Hernández-Baeza, & Tomás-Marco, 2014; Sass & Schmitt, 2010). These analyses were carried out using SPSS 20.
CFA were carried out with LISREL 8.80. Considering the ordinal nature of the items, weighted least squares was used to estimate model parameters, and the polychoric correlation matrix and the asymptotic covariance matrix were used as input for the analyses. Hu and Bentler’s (1999) criteria (NNFI and CFI ≥ .95, RMSEA ≤ .08) and χ2/df < 5 (Byrne, 1989) were applied to indicate good fit.
In Study 2 a sequential model testing approach was employed via multi-sample CFA to examine whether the TTQ displayed invariance across gender. A decrease in CFI and NNFI larger than .01 from one model to the next was taken to indicate that the more constrained model was not invariant across the samples (Cheung & Rensvold, 2002). Similarly, Chen (2007) suggested RMSEA increases of less than .015 between alternative models indicate irrelevant differences.
Results
Descriptive Analysis and Exploratory Factor Analysis (Study 1)
The descriptive statistics are offered in Table 1. EFA results showed a one-factor solution that accounted for 60.7% of common variance. All items’ factor loading were higher than .61. The scale demonstrated good internal consistency (α = .96, AVE = .61, rho = .96).
Confirmatory Factor Analysis (Study 2)
Considering the results obtained in the EFA carried out in Study 1, two alternative models were tested: A one-factor model and a four-factor model. The single-factor model showed satisfactory fit: χ2 (104) = 390.88, p < .01; χ2/df = 3.76; RMSEA = .051; NNFI = .974; CFI = .977. The items’ factor loadings ranged from .76 to .95, all statistically significant (p < .01). The transformational teaching factor demonstrated good internal consistency (α = .96, AVE = .81, rho = .99).
The four-factor model adequately fitted the data: χ2 (98) = 344.11, p < .01; χ2/df = 3.51; RMSEA = .049; NNFI = .976; CFI = .980. The items’ factor loadings ranged from .75 to .95, all statistically significant (p < .01). The four subscales demonstrated good internal consistency, with Cronbach’s alpha values ranging from .85 to .90, AVE values ranging from .77 to .87, and rho values ranging from .83 to .96. Table 2 shows descriptive statistics, reliability indices, and correlations among the TTQ subscales. The four subscales were found to be highly correlated (.83 > r > .74); however, considering that factor discrimination can be established when inter-factor correlations are below .85 (Kline, 2005), results showed that TTQ inter-factor correlations supported factor discrimination.
Following the results of the CFA (supporting the unidimensional model), but also the results providing evidence for the factor discrimination of the four dimensions of the scale, and consistent with Beauchamp and colleagues (2010), a four-factor second-order model with the four transformational teaching dimensions specified as contributing towards a higher order factor (termed transformational teaching) was also tested.
The proposed four-factor second-order model adequately fitted the data: χ2 (100) = 349.29, p < .01; χ2/df = 3.49; RMSEA = .049; NNFI = .976; CFI = .980. The items’ factor loadings ranged from .75 to .95, all statistically significant (p < .01).
Evidence of validity based on relationships with other variables (Study 2)
Results revealed a significant and positive correlation between the most self-determined forms of motivations (intrinsic motivation, identified regulation and introjected regulation) and enjoyment with the four subscales of transformational teaching and the total score scale, and negative correlations with the lowest forms of motivation (external regulation and amotivation) and with boredom (see Table 3).
One-factor Measurement Invariance (Study 2)
CFA results (see Table 4) revealed that the proposed factorial structure was acceptable for each gender group considered separately (Models M0a and M0b), as well as for the multi-sample baseline model (Model 1). Model 1 was used as the baseline against which all remaining models were compared in the process of determining evidence of invariance.
Model 2 (M2) tested whether all factor loadings were invariant across gender. The practical fit indices showed that this model has a reasonable fit (see Table 4), except for RMSEA value. However, the incremental fit indexes indicated that the total invariance factor loading hypothesis might not be tenable. Items with higher modification indexes for factor loading parameter were set free in a sequence of nested models. Factor loadings of item 16 (‘Behaves as someone I can trust’) and item 11 (‘Tries to help students who might be struggling’) were detected as non-invariant across gender (see Model M2a and M2b in Table 4).
Model 3 (M3) tested partial factor loadings invariance and total intercept invariance hypothesis. The practical fit indices showed that this model has a reasonable fit (see Table 4). However, the incremental fit indexes indicated that this hypothesis might not be tenable. We looked for the item with the highest modification index for the intercept parameter. Intercept of item 9 (‘Tries to know every student in the class’) was detected as non-invariant across gender (see Model M3a in Table 4).
Measurement invariance analysis indicated that not all the item parameters were invariant across gender; concretely items 9, 11 and 16 were detected to show differential item functioning (DIF). The practical significance of the DIF detected across gender was tested. The mean score on the TTQ, with and without removing items 9, 11 and 16 was computed for each gender group and compared across groups using the standardized mean difference. The DIF is considered trivial when the d value is lower than .20 (Chan, 2000). In the present study, the d difference was .004.
Discussion and Conclusion
The purpose of this study was to translate into Spanish and examine the psychometric properties of the Transformational Teaching Questionnaire (TTQ) in adolescents in PE context. Concretely, reliability, factorial structure, validity based on the relationships with other variables, and measurement invariance across gender were tested. Overall, the TTQ exhibited good psychometrics properties in the Spanish samples.
CFA results suggested that the four transformational teaching dimensions, specified as contributing towards a higher order factor named ‘transformational teaching’, adequately reflects the underlying factor structure of the TTQ, consistently with findings in the literature (see Beauchamp et al., 2010). Nevertheless, results suggested the one-factor and the four-factor models fit the data relatively well. So, researchers can use the different options depending on the research questions.
Results indicated that the single-factor model of the TTQ was invariant across gender. Partial strong factorial invariance (was supported; and the DIF detected showed to be irrelevant. Thus, it was concluded that Spanish adolescents responded in a similar fashion independently of the gender. These findings indicate the Spanish version of the TTQ is a valid scale to assess transformational teaching in PE for both male and female students, and allows for unbiased comparison of average scores in the two gender groups.
As in previous studies (i.e., Beauchamp et al., 2010; Beauchamp & Morton, 2011; Wilson et al., 2012), students’ perception of transformational teaching were positively related to the most self-determined forms of motivation and enjoyment, and negatively associated with the lowest self-determined forms of motivation and boredom. In other words, when students perceived that their teachers use transformational behaviors they informed to be more self-determined motivated, more satisfied in school and less bored. In this sense, self-determined motivation and enjoyment derived from PE have been demonstrated that are best determinants of intention to be physically active (e.g., Quested et al., 2013) and robust predictors of PA at both younger and older ages (Sallis, Prochaska, & Taylor, 2000). PE teachers should provide enjoyable PE experiences to positively influence adolescent involvement in health-enhancing behaviors. Understanding the influence of school PE teachers’ transformational behaviors on adolescent’s cognitive, affective and behavioral outcomes is a key factor to enhance students’ PA inside and outside the school (e.g., Beauchamp & Morton, 2011). Hence to assess transformational teaching in the PA context represents a particularly worthwhile research endeavor.
There are some limitations in our study. First, we cannot generalize this scale to other Spanish age groups, as participants in current study are adolescents ranging from 16 to 18 years old. Future research need to test whether Spanish version of the TTQ is also suitable for measuring perceptions of transformational leadership in other age groups. Second, this study showed that the factor invariance holds across gender groups, however, testing measurement invariance across other target groups (e.g., age groups) would be issues for future investigation, to determine the extent to which the TTQ can be considered a valid measure for carrying out comparison studies of the perceptions of transformational teaching across other groups. Though these limitations, our findings suggested that the Spanish version of TTQ would be useful for assessing transformational teaching in Spanish adolescents, and also for carrying out comparison studies across gender groups.
Finally, our study has a number of theoretical and practical implications. Firstly, results have substantive importance for transformational leadership theory, as they provide evidence for the cross-cultural validation of the TTQ, a questionnaire designed to assess students’ perceptions of their teachers’ behaviours from the perspective of transformational leadership theory (Bass, 1985); and secondly this study provides a valid, reliable and efficient instrument which can be used in broader survey studies or intervention studies with Spanish adolescents in the context of PA and PE.