**Hipatia: a hypermedia learning environment in mathematics**

**Hipatia: un entorno de aprendizaje hipermedia en matemáticas**

**Marisol Cueli ^{1}, Paloma González-Castro^{1}, Jennifer Krawec^{2}, José Carlos Núñez^{1} and Julio Antonio González-Pienda^{1}**

^{1} Department of Psychology, Faculty of Psychology, University of Oviedo (Spain). ^{2} Department of Teaching and Learning School of Education and Human Development, University of Miami (United States of America).

This work is funded by the I+D+i project with reference EDU2010-19798, and the support of a grant from the Ministry of Science and Innovation (BES-2011-045582).

]]> Correspondence

**ABSTRACT**

Literature revealed the benefits of different instruments for the development of mathematical competence, problem solving, self-regulated learning, affective-motivational aspects and intervention in students with specific difficulties in mathematics. However, no one tool combined all these variables. The aim of this study is to present and describe the design and development of a hypermedia tool, Hipatia. Hypermedia environments are, by definición, adaptive learning systems, which are usually a web-based application program that provide a personalized learning environment. This paper describes the principles on which Hipatia is based as well as a review of available technologies developed in different academic subjects. Hipatia was created to boost self-regulated learning, develop specific math skills, and promote effective problem solving. It was targeted toward fifth and sixth grade students with and without learning difficulties in mathematics. After the development of the tool, we concluded that it aligned well with the logic underlying the principles of self-regulated learning. Future research is needed to test the efficacy of Hipatia with an empirical methodology.

**Key words:** Hypermedia; interactive white boards; learning environment; self-regulated learning; mathematics.

**RESUMEN**

La literatura existente señala los beneficios de diferentes herramientas dirigidas al desarrollo de la competencia matemática, la solución de problemas y los aspectos afectivo-motivacionales y la intervención en estudiantes con dificultades específicas de aprendizaje en matemáticas. Sin embargo, no existe una herramienta que combine todas estas variables. El objetivo de este estudio es presentar y describir el diseño y desarrollo de una herramienta hipermedia llamada Hipatia. Los ambientes hipermedia son, por definición, sistemas adaptativos de aprendizaje que son habitualmente empleados para proporcionar ambientes personalizados de aprendizaje. Este trabajo describe los principios en los que se basa la herramienta hipermedia Hipatia, así como, una revisión de las tecnologías disponibles desarrollas en diferentes áreas académicas. Hipatia fue creada para potenciar la autorregulación del aprendizaje y desarrollar habilidades específicas matemáticas y la resolución de problemas. La herramienta está dirigida a estudiantes de quinto y sexto curso de Educación Primaria con y sin dificultades de aprendizaje en matemáticas. Tras el desarrollo de la Hipatia, se puede concluir que efectivamente subyace los principios dela aprendizaje autorregulado. En investigaciones futuras sera necesario poner a prueba la eficacia de la herramienta a través de metodologías empíricas.

**Palabras clave:** Hipermedia; pizarras interactivas; ambientes de aprendizaje; aprendizaje autorregulado; matemáticas.

]]>

**Introduction**

The process of student learning is influenced not only by students' cognitive skills but also by their affect and motivation (Barca-Lozano, Almeida, Porto-Rioboo, Peralbo-Uzquiano, & Brenlla-Blanco, 2012; Hintsanen et al., 2012; Lambic & Lipkovski, 2012). This influence holds true in the area of mathematics as well, where student performance is affected by different variables such as attitude, motivation and emotion. The latest reports on student achievement from the International Association for the Evaluation of Educational Achievement (IEA) and Pisa Projects (Organization for Economic Cooperation and Development, 2010) indicate particularly poor mathematics performance for students of Spain (IEA, 2011). In addition to these indicators of math difficulty for Spanish students across grade levels, research shows clear deficits in affective-motivational aspects as well (Cueli, González-Castro, Álvarez, García, & González-Pienda, 2014; Valle et al., 2009); thus, it is critical that we identify intervention tools that offer job-oriented instruction that not only develops knowledge and the acquisition of academic content, but also enhances strategic and self-regulated learning and increases student motivation and positive attitudes toward mathematics.

To reach a working methodology in mathematics aimed at achieving the above objectives, some research has highlighted the importance of using new technologies (Reed, Drijvers, & Kirschner, 2010). The advent of these new technologies, such as Interactive White Boards (IWBs) and hypermedia environments (e.g., Digital-Text; which is a universal school content base, presented as online multimedia textbooks, and specially designed to work with the new classroom technologies), has opened a new field of research that studies the effectiveness of these new learning environments and teaching methods (Engel & Onrubia, 2013; Macias-Ferrer, 2007; Ojeda, Perales, & Gutiérrez-Pérez, 2012). The advent of computers in schools occurred in the early 1980s; however, despite evidence that the use of digital technologies can enhance the teaching and learning of mathematics (Kaput & Hegedus, 2007; Lazakidou & Retalis, 2010, Reed et al., 2010), they are often not a mainstay in typical classroom instruction (Gross, 2002). For computer technology to be effective in classroom use, they must take into account the guidelines and activities necessary to fully support the educational process (Brown, 2009; Keengwe, Onchwari, & Wachira, 2008; Oncu, Delialioglu, & Brown, 2008; Purvis, Aspden, Bannister, & Helm, 2011; Tamar & Rivka, 2008).

Among these new technologies, research points to the use of electronic tools such as computer-based learning environments (CBLEs) on the IWBs and hypermedia environments. CBLEs are effective to the extent that they can adapt to the needs of individual learners by systematically and dynamically providing scaffolding of key learning processes during learning (Azevedo, Moos, Johnson, & Chauncey, 2010). IWBs are a large interactive display that combines an electronic touchable whiteboard connected to a network computer and a data projector (Al-Qirim, 2011), which projects the computer's desktop onto the board's surface where users control the computer using a pen, finger, stylus, or other device (Lee, Cheng, Rai, & Depickere, 2005). Hypermedia environments are, by definición, adaptive learning systems, which are usually web-based application programs that provide a personalized learning environment (Özyurt, Özyurt, Baki, Güven, & Karal, 2012). As will be described below, these instruments have been used with the aim of increasing problem-solving proficiency (for students without difficulties) or supporting the acquisition of mathematical skills (for students with learning difficulties). They have also been used to enhance students' self-regulated learning as well as their attitude toward mathematics. In this sense, learning in a hypermedia environment requires students to adjust and adapt their activities and strategies to achieve their goals, thereby self-regulating their learning. This is an active process in which subjects set goals that guide their learning, while attempting to monitor, regulate and control their cognition, motivation and behavior in order to succeed in a task (Rosário et al., 2012; Fernández et al., 2013). The topic of self-regulated learning in hypermedia learning environments is one that is being widely treated (Artino & Stephens, 2009; Azevedo & Aleven, 2013; Barnard, Lan, To, Paton, & Lai, 2009). However, other research, such as that conducted by Walker and colleagues (2012), has attempted to study the benefits of these tools not only academically, but also affective-motivationally. This study was conducted with a sample of 1247 students (ages 12 to 15) who completed pre/post questionnaires which contained seven self-report Likert scale items. Two items addressed student behavior, three addressed knowledge and two addressed attitude. Findings showed gains not only in terms of conceptual content acquisition, but also on a behavioral and attitudinal level.

In this sense, we can find different programs developed and research on various hypermedia environments. Following is the descripción of some of the programs designed to achieve the same objectives we outlined for Hipatia. We classified these programs based on the aim of the tool (i.e., work solving problems, develop self-regulating strategies, etc.), the technique used (heuristic learning, guided selfregulation learning, etc.), student grade, and the academic content area.

**Programs developed**

The following describes the programs developed in order to achieve an improvement in the self-regulatory skills development, content exposure, or practical exercises. Also, these can be classified based on the content or educational stage (course) for which they are intended. Table 1 shows the classification of these programs based on these aspects.

*Sharp Online*. Rodríguez, Gil, García and López (2008) presented the development of a web application called SHARP Online: An Adaptive Hypermedia System for solving math problems. The pedagogical foundation of this application is in the techniques of heuristic learning support in solving mathematical problems. Adaptability of the system is achieved through the use of an algorithm that allows the user to build the mathematical knowledge adaptively using training methods. This application also provides the teacher with the option to include content through specific modules. It was originally developed for educational contexts in the field of mathematics education so it includes a module for editing and visualizing mathematical formulas in a web environment.

*Web Teaching of Mathematics (WBMTS)*. Hypermedia environments have shown promise not only with acquisition of basic math skills and problem solving, but also with the acquisition of specific mathematical skills. Özyurt (2012) conducted a study with ten teachers and seventy high school sophomores with the goals of designing a system based on WBMTS for the learning of probability and then implementing and evaluating its effectiveness in tenth grade students. Data from the study were analyzed by analysis of covariance and showed that the system WBMTS had a positive effect on the academic performance of students in the skill tested.

*PIAC*. Andrade-Aréchiga, López and López-Morteo (2012) conducted a study in which an intervention was designed to help students overcome difficulties related to the concepts of calculus. Intended as a specific intervention for mathematics difficulties, they used an interactive platform for learning calculus, called PIAC, with a total of 102 students. The application allows students to manage, display and present a wide variety of content, including text, images, video, and interactive content. The use of PIAC to support to learning of calculus concepts was shown to be effective; further, results indicated positive response to the program and also showed that benefits occurred not only in the students' academic performance, but also on the motivational aspects of the learning process. Thus, they concluded that the technology-based intervention provides a positive influence on the learning process.

*MetaTutor*. Developed by Azevedo et al. (2012), MetaTutor is a learning tool designed to teach and train students to self-regulate. Moreover, it is a research tool used to select trace data on the cognitive, metacognitive, affective, and motivational processes that students employ as they learn. This learning tool is a multi-agent, adaptive hypermedia learning environment, designed to train, model, and foster students' SRL while learning about the human circulatory system. The primary goal underlying the design of MetaTutor is to investigate how advanced learning technologies (ALTs) can adaptively scaffold learners' SRL while they learn about complex biological topics (Azevedo et al., 2012). As a learning tool, MetaTutor has a host of features that embody and foster self-regulated learning. Additionally, MetaTutor collects information from user interactions with it to provide adaptive feedback on the deployment of students' SRL behaviors. This tool includes the avatar, or metatutor, which is an application of hypermedia environments that promotes student self-regulated learning through guidance and immediate feedback on answers (Cerezo et al., 2010).

*iSTART*. Interactive Strategy Training for Active Reading and Thinking is an intelligent tutoring system designed to improve students' reading comprehension skills (Jackson, Boonthum, McNamara, 2010). iSTART teaches students how to self-explain and which strategies will most effectively aid comprehension from moment to moment (Kurby et al., 2012). These authors used the Reading Strategy Assessment Tool (RSAT) to assess how iSTART changes the relation between important self-explanation reading strategies-bridging and elaboration-and online comprehension, and how often they are produced. iSTART is designed so that teachers and researchers may add their own texts into the system.

In short, as can be seen in table 1, the programs described are directed to stimulate various aspects through different content in a specific age range. However, there has not been found a program that combines the aims of all those reviewed above. Although it is true that many tools have been developed for learning academic content, it seems that the theoretical models upon which they are based are oriented more to the explanation of content and execution by the student than to the stimulation of self-regulation learning and affective-motivational variables. There are two programs that incorporate both of these components; however, these are aimed at learning the circulatory system (MetaTutor) and developing reading comprehension skills (iStart).

Given the potential of new technologies and the results provided by previous research that found positive effects of these tools in the teaching and learning process of the students, the objective of the current work is to design and develop a hypermedia tool, called *Hipatia*, based on the principles of self-regulated learning (similar to MetaTutor or iSTART but directed toward mathematical content). Further, it was important that the program be adaptative so that it can be used with students with various learning difficulties (similar to PIAC). Thus, Hipatia will combine in one tool the principles seen in the above literature: enhanced selfregulated learning, development of specific content skills, and effective problem solving (similar to Sharp, which focuses on problem solving). This technology is geared to students in fifth and sixth grades with and without learning difficulties in mathematics. It also includes the avatar, which has been mainly applied only in high school so far.

**Target Demographic**

The sample to be targeted by the intervention program consists of students in grades five and six. This level was selected because results from the Trends in International Mathematics and Science Study (IEA, 2011) showed below average academic achievement in mathematics for fourth grade students. Further, students at this age generally have sufficient computer resources (i.e., equipped with computers and have basic knowledge about handling them) but are still young enough that intervention may prevent the difficulties or shortcomings often experienced by secondary school students. Thus, the mathematical content of the hypermedia system described in the current study are adapted to the competences proposed by the administration of the Spanish education system for this stage of the curriculum. The following sections describe the tool, Hipatia, and its application to classroom instruction, as well as implications for future research.

**Theoretical Framework**

The designed instrument, Hipatia, is a hypermedia tool intended to improve math skills in fifth and sixth grades. The theoretical foundation of the content is based on Zimmerman's (2008) model of self-regulation, which states that students operate their self-regulated learning through the implementation of a number of strategies that activate and modify their cognition, metacognition and behavior. These strategies are variously applied before, during, and after the learning takes place; each follows the phases of planning, implementation and evaluation of the process (Figure 1).

]]>

Also, Hipatia is directed for students with and without learning disabilities in mathematics. Maccini, Gagnon and Hughes (2002) showed three practices for working with students with learning disabilities in mathematics: hypermedia software programs, contextualized learning, and multimedia software. Hipatia is hypermedia software that provides contextualized learning, as content is only shown after an example that activates prior knowledge. This is very relevant, especially considering that math skills evolve in a hierarchical and inclusive way (Kikas, Peets, Palu, & Afanasjev, 2009; Olkun, Altun, & Deryakulu, 2009). Moreover, Swanson (1999) reviewed 20 years of research on intervention with students with learning disabilities in mathematics and concluded that the two teaching practices with best results are direct instruction and cognitive strategies of self-regulation and control. These results were supported by the meta-analysis by Kroesbergen and van Luit (2003), which also indicates that the intervention strategies with improved outcomes for teaching students in elementary school with learning disabilities in mathematics were self-instruction and direct instruction of cognitive strategies. This is in the line of Hipatia, which uses direct instruction and includes the avatar for enhancing this point. If the student gives the wrong answer, the avatar provides prompts to determine which procedure to follow to self-correct (based on self-regulatory logic and direct instruction) in order to reach the correct answer.

**Description of the Program**

The program described below is an adaptation of the tool *Hypatia*, initially developed in Portugal (http://www.hypatiamat.com/). Hipatia is a researcher-developed hypermedia program that was created to support the development of students' self-regulatory skills and the acquisition of specific math skills. Because of the nature of the tool, one of the goals of Hipatia is to improve students' motivation toward math. As it is designed, the teacher and the student can work with the application both from the computer and from the whiteboard; thus, it is an in-class tool meant to supplement and reinforce whole-class instruction. Hipatia was created and established in a web space (www.institutouria.es/hyp), making it accessible to both the students and faculty. In this space, there are different sections or links. First, there is a section concerning the content, which lists each of the topics offered (loca, angles, polygons, areas, etc.). Second, there is a specific section for calculating activities, working this skill in a fun way through games. Third, there are sections describing the project and sections which give visitors the opportunity to collaborate. The application can be run from the student's own computer (at home or at school), from the teacher, or from the interactive whiteboard.

In this regard, students using Hipatia follow a predetermined series of tasks. First, they are presented a concept through an example (thus activating prior knowledge); then they process the content, first with simple tasks and then with progressively more difficult tasks. The underlying concepts of these initial phases are learning to learn and selfregulatory enhancement planning. Once students have acquired the knowledge, they practice with different activities (i.e., "learning to do," or execution) and the program gives students immediate feedback once they complete the task; this component of the tool supports affective-motivational development as it is an immediate and contingent reinforcement (Cameron, Pierce, Banko, & Gear, 2005). Feedback makes learning more active, autonomous, reflective, and critical (Martínez-Berruezo & García-Varela, 2013).

After feedback, each topic includes a final summary that lists the main ideas learned, thus facilitating the process of self-evaluation and monitoring of learning. Some of the mathematical content includes loci, polygons, perimeter, area, and angles. To more clearly describe the sequencing of the instrument's content, one of the lessons (on angles) is described below. It is important to note that all the proposed content follows the same dynamics as shown below.

]]>

All the topics are divided into 10 sections, within which appear different activities that present relevant concepts, exercises and problems. Students navigate through activities using the arrows (as evident in the figures). The Hipatia program has several tools but the following three are used most frequently: pencil, pen, and rubber/eraser. The pen allows students to write and to conduct operations while the pen allows them to point out or highlight data. Students use these tools to perform the requested activities, operate to solve a problem, outline the statement when necessary, and seek strategies to solve a problem. For this, they have to click on the tool, which appears at the top right of the screen. In addition, the teacher and the student have the option to change the data in the exercises by a specific button (shown at the top of the screen in some exercises). Using this option, the problem statement remains invariable while the numerical data change. This action facilitates the consolidation of knowledge needed to repeatedly perform the activity. Further, students can obtain a proposed correct solution, receive clarification on words (those underlined with a dotted line include a comment when you mouse over them), check their responses (through immediate feedback), and receive the guidance of the avatar or meta-tutor.

The avatar, which can be seen at the top right of Figure 3, acts as a guide in the learning process, emerging when the student makes a mistake or seeks to provide an answer before attempting the exercise. Based on student performance errors, the avatar gives specific instruction tailored to each response and, therefore, to the specific needs of each student. In this way, deficits related to specific learning difficulties in mathematics are addressed. Other tools offered by the program are the protractor, ruler, and compass, which are necessary for various activities.

The main way in which students are assessed on their learning is through questioning. There are two types of questions posed to students in Hipatia: theoretical open-ended questions where they must write the correct answer in the space provided, and multiple choice questions where the student chooses the answer in a set. The different question types demand a different cognitive load; whereas multiple-choice questions require students to identify the right answer from a finite list, open-ended questions require that students produce an answer that demonstrates the conceptual and relational underpinnings of the skill (García-Beltrán, Martínez, Jaén, & Tapia, 2006).

**Classroom Application**

**Summary**

The aim of this study was to present and describe the design and development of an hypermedia tool, Hipatia, which sought to boost self-regulated learning, develop specific math skills, and promote effective problem solving. It was targeted toward fifth and sixth grade students with and without learning difficulties in mathematics and it included the avatar to guide the teaching-learning process and selfregulation simultaneously. A thorough review of the literature revealed the benefits of different instruments for the development of mathematical competence (Özyurt, 2012) and problem solving (Koehler, 2002), guided self-regulated learning (Azevedo & Aleven, 2013), improving affective-motivational aspects (Walker et al., 2012), and intervention in specific difficulties in mathematics (Andrade-Aréchiga et al., 2012). However, no one tool combined all these variables; this was our goal with Hipatia. It can be concluded that it adapts to student proficiency with each skill and adjusts in each individual case to individual student needs. This is relevant in the context of diversity, especially because research makes clear that not all students learn the same way at the same speed (Lee et al., 2005).

The importance of the guide in the learning process has great relevance considering that students who performed better academically place more emphasis on the planning phase of self-regulated learning (Cueli, García, & González-Castro, 2013). Hence, it is very important to strengthen and practice this first phase with students who struggle. Overall, we have concluded that Hipatia is well aligned with the principles of self-regulated learning.

**Directions for Future Research**

The true benefits of Hipatia still need to be tested with an empirical methodology. Therefore, one of the future lines of research includes the implementation of the tool in the daily classroom routine in order to ascertain its impact compared to traditional teaching methods. To do this, the technology should be implemented over an extended time and there should be comparison groups who do not use this or other digital tools. To do so would require the consent of the centers as well as parents of students. In order to see the benefits of working with this tool, the researcher should apply at least one of the proposed themes and also compare the results of students with other groups of the same level of education who had worked the same subject following a traditional methodology in order to determine and then compare the rate and depth of acquisition of math skills through each method. The teacher must be trained in handling Hipatia and implement the schedule with fidelity. Also, to study the effects on self-regulation of learning, questionnaires may be used for self-regulation, which should be completed prior to and after the intervention.

In addition to assessing the effectiveness of Hipatia improving self-regulation, it is necessary to know its benefits on students' academic performance in this subject and on other affective-motivational variables related to mathematics such as anxiety, motivation or perceived competence. These variables, as well as self-regulation, would be assessed using self-report methods responded by a group of students who would work with the hypermedia tool and another group of students who would follow a traditional learning methodology. Furthermore, the questionnaires would be completed prior to and after the intervention. An expert would go to the schools to give the specific instructions and supervise the administration. At the same time, this process would be done by means of an online platform where the students would be required to enter with an individual username and password. However, other process-based assessment could be carried out, following protocols such as thinking aloud or triple task, as applications to the area of mathematics are already being initiated (García & González-Pienda, 2012).

On the whole, the line of future research proposed is to analyze the impact of the tool on three key areas: mathematical learning process, students' self-regulation in this subject and other affective-motivational variables. Taking the guidelines described here into account, a first empiric study was carried out with the aim of analyzing the benefits of this new technology in four affective-motivational variables (perceived usefulness, perceived competence, intrinsic motivation and anxiety towards mathematics) and determine if such benefits are related to the previous affective-motivational levels in these variables. To achieve this goal 425 fifth and sixth grade students received an intervention with Hipatia. This first application was based on the work with the topic "Loca" which students learned during a month three times per week. The affective -motivational levels of all students were collected before and after intervention using the Inventory of Attitudes towards Mathematics (González-Pienda et al., 2012; Rosário et al., 2007). The results of the t Student Test for related samples showed statistically significant differences in the post-test compared to pretest variables in perceived competence and math anxiety. In addition, the students with low prior affective- motivational levels obtained greater benefits from the intervention (Cueli, González-Castro, Rodríguez, Núñez, & González-Pienda, In press).

]]>**References**

1. Al-Qirim, N. (2011). Determinants of interactive white board success in teaching in higher education institutions. Computers & Education, 56(3), 827-838. doi: 10.1016/j.compedu.2010.10.024. [ Links ]

2. Andrade-Aréchiga, M., López, G., & López-Morteo, G. (2012). Assessing effectiveness of learning units under the teaching unit model in an undergraduate mathematics course. Computers & Education, 59(2), 594-606. doi: 10.1016/j.compedu.2012.03.010. [ Links ]

3. Artino A., & Stephens, J. (2009). Academic motivation and self-regulation: a comparative analysis of undergraduate and graduate students learning online. Internet and Higher Education, 12(3), 146-151. doi: 10.1016/j.iheduc.2009.02.001. [ Links ]

4. Azevedo, R., & Aleven, V. (Eds.). (2013). International handbook of metacognition and learning technologies. Amsterdam, The Netherlands: Springer. [ Links ]

]]>5. Azevedo, R., Moos, D.C., Johnson, A.M., & Chauncey, A.D. (2010). Measuring cognitive and metacognitive regulatory processes during hypermedia learning: Issues and challenges. Educational Psychologist, 45(4), 210-223. doi: 10.1080/00461520.2010.515934. [ Links ]

6. Azevedo, R., Witherspoon, A., Graesser, A. C., McNamara, D. S., Chauncey, A., Siler,... & Lintean, M. (2009). MetaTutor: Analyzing self-regulated learning in a tutoring system for biology. In V. Dimitrova, B. Mizoguchi, B. du Boulay y A.C. Graesser (Eds.). Artificial intelligence in education; Building learning systems that care; from knowledge representation to affective modeling (pp. 635-637). Amsterdam, The Netherlands: IOS Press. [ Links ]

7. Barca-Lozano, A., Almeida, L.S., Porto-Rioboo, A.M., Peralbo-Uzquiano, M.P., & Brenlla-Blanco, J.C. (2012). Motivación escolar y rendimiento: impacto de metas académicas, de estrategias de aprendizaje y autoeficacia. Anales de Psicología, 28(3), 848-859. doi: http://dx.doi.org/10.6018/analesps.28.3.156101. [ Links ]

8. Barnard, L., Lan, W.Y., To, Y.M., Paton, V., & Lai, S.H. (2009). Measuring self-regulation in online and blended learning environments. Internet and Higher Education, 12(1), 1-6. doi: 10.1016/j.iheduc.2008.10.005. [ Links ]

9. Brown, G. (2009). Review of education in mathematics, data science and quantitative disciplines. Report to the Group of Eight Universities. [ Links ]

]]>10. Cameron, J., Pierce, W.D., Banko, K.M., & Gear, A. (2005). Achievement-based rewards and intrinsic motivation: A test cognitive mediators. Journal of Educational Psychology, 97(4), 641-655. doi: 10.1037/0022-0663.97.4.641. [ Links ]

11. Cerezo, R., Núñez, J.C., Rosário, P., Valle, A., Rodríguez, S., & Bernardo, A.B. (2010). New media for the promotion of self-regulated learning in higher education. Psicothema, 22(2), 306-315. [ Links ]

12. Cueli, M., García, T., & González-Castro, P. (2013). Self-regulation and academic achievement in mathematics. Aula Abierta, 47(1), 39-48. [ Links ]

13. Cueli, M., González-Castro, P., Álvarez, L., García T. y González-Pienda, J.A. (2014). Variables afectivo-motivaciones y rendimiento en matemáticas: Un análisis bidireccional. Revista Mexicana de Psicología, 37(2), 153-163. [ Links ]

14. Cueli, M., González-Castro, P., Rodríguez, C., Núñez, J.C., & González-Pienda, J.A. (In press). Intervención sobre las variables afectivo-motivacionales relacionadas con el aprendizaje en matemáticas. Educación XX1. [ Links ]

]]>15. Engel, A., & Onrubia, J. (2013). Estrategias discursivas para la construccion colaborativa del conocimiento en entornos virtuales de aprendizaje. Cultura y Educación, 25(1), 77-94. doi: 10.1174/113564013806309082. [ Links ]

16. Fernández, E., Bernardo, A., Suárez, N., Cerezo, R., Núñez, J.C., & Rosário, P. (2013). Prediction of use self-regulation strategies in higher education. Anales de Psicología, 29(3), 865-875. doi: http://dx.doi.org/10.6018/analesps.29.3.139341. [ Links ]

17. García, T., & González-Pienda, J. A. (2012). Evaluación del proceso de aprendizaje autorregulado en el area de las matemáticas mediante pizarras digitales. En J. Dulac-Ibergallartu y C. Alconada-Fernández (Eds.), HI Congresopizarra digital: publicación de comunicaciones (pp.85-92). Madrid: Ediciones Pizarratic. [ Links ]

18. García-Beltrán, A., Martínez, R., Jaén, J.A., & Tapia, S. (2006). Self-assessment in virtual teaching and learning environments. Revista de Educación a Distancia, monográfico, M6, 1-14. Recuperado de http://www.um.es/ead/red/M6. [ Links ]

19. González-Pienda, J.A., Fernández-Cueli, M., García, T., Suárez, N., Tuero-Herrero, E., & Da Silva, E.H. (2012). Diferencias de genero en actitudes hacia las matemáticas en la enseñanza obligatoria. Revista Iberoamericana de Psicología y Salud, 3(1), 55-73. [ Links ]

]]>20. Gros, B. (2002). Knowledge construction and technology. Journal of Educational Multimedia and Hypermedia, 11 (4), 323-343. [ Links ]

21. Hintsanen, M., Alatupa, S., Jokela, M., Lipsanen, J., Hintsa, T., & Leino, M. (2012). Associations of temperament traits and mathematics grades in adolescents are dependent on the rater but independent of motivation and cognitive ability. Learning and Individual Differences, 722(4), 490-497. doi: 10.1016/j.lindif.2012.03.006. [ Links ]

22. International Association for the evaluation of educational achievement IEA. (2011). Resultados de las pruebas PIRLS y TIMSS de 2077 en España. Madrid, Ministerio de Educación, Cultura y Deporte. [ Links ]

23. Jackson, G.T., Boonthum, C., & McNamara, D.S. (2010). The Efficacy of Extended Practice with iSTART: Low Ability Students Catch up. In V. Aleven, J. Kay, & J. Mostow (Eds.), Intelligent Tutoring Systems. 70th International Conference part II (pp. 349-351). Pittsburgh: Springer. [ Links ]

24. Kaput, J., & Hegedus, S. (2007). Technology becoming infrastructural in mathematics education. In R. Lesh, E. Hamilton, y J. Kaput (Eds.), Proceedings of the foundations for the future in mathematics and science (pp. 173-192). Mahwah, NJ: Lawrence Erlbaum. [ Links ]

]]>25. Keengwe, J., Onchwari, G., & Wachira, P. (2008). The use of computer tools to support meaningful learning. Association for the Advancement of Computing in Education Journal, 16(1), 77-92. [ Links ]

26. Kikas, E., Peets, K., Palu, A., & Afanasjev, J. (2009). The role of individual and contextual factors in the development of math skills. Educational Psychology, 29(5), 541-560. doi: http://dx.doi.org/10.1080/01443410903118499. [ Links ]

27. Koehler, M.J. (2002). Designing Case-Based Hypermedia for Developing Understanding of Children's Mathematical Reasoning. Cognition & Instruction, 20(2), 151-195. doi: 10.1207/S1532690XCI2002_2. [ Links ]

28. Kroesbergen, E.H., & Van Luit, J.E.H. (2003). Mathematics interventions for children with special educational needs. Remedial and Special Education, 24(2), 97-114. [ Links ]

29. Kurby, C.A., Magliano, J.P., Dandotkar, S., Woehrle, J., Gilliam, S., & McNamara, D.S. (2012). Changing how students process and comprehend texts with computer-based self-explanation training. Journal of Educational Computing Research, 47(4), 429-459. doi: 10.2190/EC.47.4.e. [ Links ]

]]>30. Lambic, D., & Lipkovski, A. (2012). Measuring the influence of students' attitudes on the process of acquiring knowledge in mathematics. Croatian Journal of Education-Hrvatski Casopis za Odgoji Obrazovanje, 74(1), 187-205. [ Links ]

31. Lazakidou, G., & Retalis, S. (2010). Using computer supported collaborative learning strategies for helping students acquire self-regulated problemsolving skills in mathematics. Computers & Education, 54(1), 3-13. doi: 10.1016/j.compedu.2009.02.020. [ Links ]

32. Lee, C.H.M., Cheng, Y.W., Rai, S., & Depickere, A. (2005). What affect student cognitive style in the development of hypermedia learning system? Computers & Education, 45(1), 1-19. doi:10.1016/j.compedu.2004.04.006. [ Links ]

33. Maccini, P., Gagnon, J.C., & Hughes, C.A. (2002). Technology-based practices for secondary students with learning disabilities. Learning Desability Quarterly, 25(4), 247-261. doi: 10.2307/1511356. [ Links ]

34. Macias-Ferrer, D. (2007). Las nuevas tecnologías y el aprendizaje de las matemáticas. Revista Iberoamericana de Educación, 42(4), 1-17. [ Links ]

]]>35. Martínez-Berruezo, M., & García-Varela, A. (2013). Analysis of the impact of virtualization on motivation in first-year teaching students. Revista de Educación, 362, 42-68. doi: 0.4438/1988-592X-RE-2011-362-152. [ Links ]

36. Ojeda, F., Perales, F.J., & Gutiérrez-Pérez, J. (2012). Evaluación de la calidad de webs y blogs sobre Educación ecologica. Cultura y Educación, 24(1), 77-93. doi: 10.1174/113564012799740812. [ Links ]

37. Olkun, S., Altun, A., & Deryakulu, D. (2009). Development and evaluation of a case-based digital learning tool about children's mathematical thinking for elementary school teachers. European Journal of Teacher Education, 32(2), 151-165. doi: 10.1080/02619760902783875. [ Links ]

38. Oncu, S., Delialioglu, O., & Brown, C. (2008). Critical components for technology integration: how do instructors make decisions? Journal of Computers in Mathematics and Science Teaching, 27(1), 19-46. [ Links ]

39. Organización para la Cooperación y el Desarrollo Económico OCDE. (2010). PISA 2009 Results. Paris: OCDE. [ Links ]

]]>40. Özyurt, H. (2012). Implementation and evaluation of a web based mathematics teaching system enriched with interactive animations for the probability unit. Energy Education Science and Technology Part b-social and Educational Studies, 4(3), 1167-1180. [ Links ]

41. Özyurt, O., Özyurt, H., Baki, A., Guven, B., & Karal. (2012). Evaluation of an adaptive and intelligent educational hypermedia for enhanced individual learning of mathematics: A qualitative study. Expert Systems with Applications, 39(15), 12092-12104. doi: http://dx.doi.org/10.1016/j.eswa.2012.04.018. [ Links ]

42. Purvis, A., Aspden, L., Bannister, P., & Helm, P. (2011). Assessment strategies to support higher level learning in blended delivery. Innovations in Education and Teaching International, 48(1), 91-100. doi: 10.1080/14703297.2010.543767. [ Links ]

43. Reed, H., Drijvers, P., & Kirschner, P. (2010). Effects of attitudes and behaviours on learning mathematics with computer tools. Computers & Education, 55(1), 1-15. doi: 10.1016/j.compedu.2009.11.012. [ Links ]

44. Rodríguez, R., Gil, A.B., García, F.J., & López, R. (2008). SHARP Online: An Adaptive Hypermedia System Applied to Mathematical Problem Solving. Journal of Universal Computer Science, 14(19), 3099-3113. [ Links ]

]]>45. Rosário, P., Lourenço, A., Olímpia-Paiva, M., Núñez, J.C., González-Pienda, J.A., & Valle, A. (2012). Autoeficacia y utilidad percibida como condiciones necesarias para un aprendizaje académico autorregulado. Anales de Psicología, 28(1), 37-44. [ Links ]

46. Rosário, P., Mouräo, R., Núñez, J. C., González-Pineda, J., Solano, P. y Valle, A. (2007). Eficacia de un programa instruccional para la mejora de procesos y estrategias de aprendizaje en la enseñanza superior. Psicothema, 19(3), 422-427. [ Links ]

47. Swanson, H.L. (1999). Instructional components that predict treatment outcomes for student with learning disabilities: Support for a combined strategy and direct instruction model. Learning Disabilities Research and Practice, 14(3), 129-140. doi: 10.1207/sldrp1403_1. [ Links ]

48. Tamar, L., & Rivka, W. (2008). Teachers' views on factors affecting effective integration of information technology in the classroom: developmental scenery. Journal of Technology and Teacher Education, 16(2), 233-263. [ Links ]

49. Valle, A., Núñez, J.C., Cabanach, R.G., Rodríguez, S., González-Pienda, J.A., & Rosario, P. (2009). Perfiles motivacionales en estudiantes de secundaria: análisis diferencial en estrategias cognitivas, estrategias de autorregulacion y rendimiento academico. Revista Mexicana de psicología, 26(1), 113-124. [ Links ]

]]>50. Walker, A., Recker, M., Ye, L., Robertshaw, M.B., Sellers, L., & Leary, H. (2012). Comparing technology-related teacher professional development designs: a multilevel study of teacher and student impacts. Etryd-educational Technology Research and Development, 60(3), 421-444. doi: 10.1007/s11423-012-9243-8. [ Links ]

51. Zimmerman, B. J. (2008). Investigating self-regulation and motivation: Historical, background, methodological developments, and future prospects. American Educational Research Journal, 45(1), 166-183. doi: 10.3102/0002831207312909. [ Links ]

**Correspondence:**

Marisol Fernández Cueli.

University of Oviedo.

Department of Psychology. ]]>
Plaza Feijoó s/n.

CP, 33003, Oviedo (Spain).

E-mail: cuelimarisol@uniovi.es

Article received: 11-11-2013

revised: 16-06-2014

accepted: 13-09-2014