SciELO - Scientific Electronic Library Online

 
vol.21 issue5Learning together to work together. Comparison of academic achievement in students of human biology and medicine at Pompeu Fabra University¿Hay que revisar el currículo formativo de ginecología en lactancia materna? author indexsubject indexarticles search
Home Pagealphabetic serial listing  

My SciELO

Services on Demand

Journal

Article

Indicators

Related links

  • On index processCited by Google
  • Have no similar articlesSimilars in SciELO
  • On index processSimilars in Google

Share


FEM: Revista de la Fundación Educación Médica

On-line version ISSN 2014-9840Print version ISSN 2014-9832

FEM (Ed. impresa) vol.21 n.5 Barcelona Oct. 2018  Epub Aug 16, 2021

https://dx.doi.org/10.33588/fem.215.965 

ORIGINAL

Why 20% of the students fail in the oral exam 'fresh heart'?

¿Por qué el 20% de los alumnos suspenden el examen oral de 'corazón fresco'?

André Borges1  2  , José E Cavaco1 

1CICS-UBI - Health Sciences Research Centre; University of Beira Interior; Covilhã, Portugal

2Centro Hospitalar Lisboa Ocidental; Hospital de São Francisco Xavier; Lisboa, Portugal

ABSTRACT

Introduction:

In the 2nd grade of medical school in the University of Beira Interior, there is a 'heart' exam, the only oral exam of the course. The observation that about 1 out of 5 students failed the exam, propelled an investigation.

Subjects and methods:

We conducted two questionnaires, before and after the exam, that assessed multiple factors. Blood pressure and heart rate were recorded before and after the exam and in a non-stress situation. Two different teachers assessed students. Descriptive statistical tests, t -test, chi-square test and Mann-Whitney test were applied.

Results:

Of a total of 1042 students, between 2005 and 2014, 19.96% failed in the oral exam. In 2015 ( n = 144), there was a 100% response rate to the questionnaires. The male gender is associated with a higher failure rate ( p = 0.04). The parameters 'I was nervous for watching my colleague's exam' ( p = 0.041) and 'The presence of a colleague in the room left me nervous' ( p = 0.014) were associated to failure. The heart rate ( p = 0.028) and diastolic blood pressure ( p = 0.030) after the oral exam were related to failure.

Conclusions:

It is suggested that students wait outside the room during the exam. It is crucial to avoid differences between teachers, so it is suggested, an initial pre-training on the structure and parameters of evaluation.

Key words Heart; Medical education; Oral exam; Students; Viva voce

RESUMEN

Introducción:

En el segundo año de medicina en la Universidad de Beira Interior, se realiza un examen sobre el corazón, el único examen oral de la carrera. La observación de que uno de cada cinco estudiantes suspendía el examen fue la razón que impulso esta investigación.

Sujetos y métodos:

Se aplicaron dos cuestionarios, antes y después del examen, que evaluaron varios factores. La presión sanguínea y la frecuencia cardíaca se evaluaron antes y después del examen y también en una situación sin estrés. Los estudiantes fueron evaluados por dos profesores diferentes. Se aplicaron pruebas de estadística descriptiva, test t , chi al cuadrado y test de Mann-Whitney.

Resultados:

Del total de 1.042 estudiantes, entre los años 2005 y 2014, un 19,96% suspendieron el examen oral. En 2015 ( n = 144) hubo un 100% de respuesta a los cuestionarios. El sexo masculino se asoció con una mayor tasa de suspensos ( p = 0,04). Los parámetros 'Estaba nervioso por ver el examen de mi colega' ( p = 0,041) y 'La presencia de un colega en la sala me puso nervioso' ( p = 0,014) se asociaron con el suspenso. La frecuencia cardíaca ( p = 0,028) y la presión arterial diastólica ( p = 0,030) después del examen oral se relacionaron con los suspensos.

Conclusiones:

Se sugiere que los estudiantes esperen fuera de la sala durante el examen. Es crucial evitar las diferencias entre los profesores, por lo que se sugiere un preentrenamiento inicial sobre la estructura y los parámetros de la evaluación.

Palabras clave Alumnos; Corazón; Educación médica; Examen oral; Viva voz

Introduction

Oral exams (also known as ' viva voce ') were the first method of evaluation of medical students [ 1 , 2 ]. Students were worthy of certification after they have pleased a jury that has tested their skills through questions about specific knowledge [ 3 ]. For many years, this method was regarded as of extreme importance, with Plato referring to it as a better way of communication/evaluation when compared to written evaluations, once that the written part only can remind someone who already has knowledge, while the oral part is capable to give away knowledge about the subject in question [ 4 ]. However, because of the increase in book production, the need for oral exams has decreased [ 5 ]. In the cardio-respiratory block of the 2nd grade of the medicine course (Universidade da Beira Interior) it is performed the only oral exam that is called 'fresh heart'. The oral exam was introduced in 2005 and the coordinator of the cardio-respiratory block noticed that 1 out of 5 students would fail in the exam. It is important to understand the factors that affect the performance of the students. Being the performance a complex subject, several variables like students, teachers and university have an impact in the outcome. It is important to remember that the subjectivity involved in the oral exam can be intimidating for the student, once that can compromise all the neutrality of the process [ 2 ]. It is very easy to teachers make judgements about the person that stands before them, and this highlights the importance of having an impartial process [ 6 ].

The main objectives of this study are to statistically analyze the oral exam results from 2005 to 2014, and to evaluate the influence of the gender, evaluation design, teachers, blood pressure and heart rate in the performance.

Subjects and methods

Two populations were assessed in this study: from a retrospective point of view (2005 to 2014), data were collected from 1042 students of the 2nd grade of the medicine course that have been evaluated with the 'fresh heart' oral exam; the population of the study ( n = 144) was the 2nd grade of the medicine class of 2014/2015 of the Faculdade de Ciências da Saúde (FCS) of the Universidade da Beira Interior. Inclusion criteria were: filling both questionnaires, before and after the exam, and to register blood pressure and heart rate before and after the oral exam. Exclusion criteria were: partly filled questionnaires, and not having measured the blood pressure and heart rate, before and after the oral exam. The oral exam was on the December 10th of 2014 and the students were distributed in a list with a schedule. The students would wait in a room and then called to a room where they would fill the questionnaire before the oral exam (questionnaire A) and their blood pressure and heart rate would also be assessed. After this, two students would enter in the oral exam room, one student would stay near the door and the other student would do the oral exam in front of a table with fresh hearts and two teachers. After doing the oral exam, the student near the door would call another student to come in and the former would go to the table to start the oral exam. Each teacher was randomly switched. After having finished the exam, students would go to a room where they would fill the second questionnaire (questionnaire B) and their blood pressure and heart rate would be assessed again.

The oral exam consisted in five questions about anatomical structures which were previously discussed in classes with a practical component. The evaluation consisted in a set of questions distributed by a total of three envelopes with different colors which students could choose. The questions were based on three categories: anatomical orientation of the heart (one question), main structures (two questions) and secondary structures (two questions) by this particular order. The first three questions were crucial for approval, so if the student missed one of the first three questions (anatomical orientation of the heart or one of the two main structures of the heart) then would fail the exam. The two questionnaires were applied before and after the oral exam and the students filled them voluntarily and in a form of anonymity with a written consent approved by the ethics commission of the college. Both questionnaires, were translated and adapted from the study of Hashmat et al [ 7 ] and consisted of two groups. The first group consisted of demographic data of the students (age and gender). The second group consisted of two parts: the first part consisted in measuring blood pressure and heart rate; the second part assessed potential factors that may have affected the student's performance (questionnaire A: study method, workload and sleep; questionnaire B: room conditions and exam conditions) on the basis of a 5-level Likert scale (1: strongly disagree; 2: slightly disagree; 3: indifferent; 4: slightly agree; 5: strongly agree). Both questionnaires were tested in a restricted group of students with the purpose of verify their validity. The study was approved by the Ethics Commission of the FCS (Process ID: EC-FCS-2015-006). In order to establish a baseline of the blood pressure and heart rate in a non-stress situation, measurements were taken during the theoretical classes in order to allow a future comparative analysis with those obtained on the day of the oral exam. All statistical analyses were performed with SPSS v. 21. Firstly, in the questionnaires, the possible factors that could influence the performance of students were analyzed with internal consistency scales (Cronbach's α), leading to individually assess each item with Mann-Whitney. T -test and chi-square were applied to determine whether there was a significant difference between the expected frequencies and the observed frequencies in categories like gender, blood pressure, heart rate and student's performance.

Results

Between 2005-2014, the analysis of the data collected allowed to verify that, 1042 students did the oral exam. Of these, it was verified that 71.5% were female ( n = 745) and 28.5% were male ( n = 297). It was found that 19.96% had failed in the oral exam and 80.04% had approved. The overall percentage of failing in the exam was higher for female students (20.5%) and lower for male students (18.5%), however, this difference was not statistically significant (χ 2 = 0.541; p = 0.462). The 2nd grade of the medicine course of 2014/2015 had 144 students, of which 70.1% ( n = 101) were female and 29.9% ( n = 43) were male. Of the 144 students, 23 failed in the oral exam (15.9%). The overall percentage of failures was higher for male students (25.6%) and lower for the female students (11.9%), and this difference was statistically significant (χ 2 = 4.218; p = 0.040). It was not found any association between the gender of the teachers and the gender of the students (Teacher X: χ 2 = 2.769; p = 0.096 / Teacher Y: χ 2 = 1.266; p = 0.260). However, it was found that the rate of disapproval in the exam was higher for teacher Y, being this difference statistically significant (χ 2 = 4.226; p = 0.040). In questionnaire A, it was not found any relationship between the assessed factors and the final result of the oral exam. In questionnaire B, the parameters 'I was nervous for watching my colleague's exam' and 'The presence of a colleague in the room left me nervous' had more impact for those who had failed in the exam (Mann-Whitney: p = 0.041 and p = 0.014, respectively). It was not found any other association between the student's performance and other factors. It was also found a significant difference between the baseline and diastolic blood pressure after the exam (Student's t : p = 0.03) and the baseline and heart rate after the exam (Student's t : p = 0.028).

Discussion

Between 2005 and 2014, the percentage of students who failed the exam was 19.96%. Although the overall percentage of bad performance is higher for the female gender (20.5% versus 18.5% in the male gender), the differences observed were not statistically significant ( p > 0.05), so it is concluded that the performance in the exam between 2005 and 2014, has no relation to gender. It is known that several factors influence the academic performance of students in the pre-graduate education; nonetheless, oral exams have their own specificities, particularly because they are seen as an assessment method that triggers stress [ 8 ]. There was an association between the parameters 'I was nervous to watch my colleague's exam' and 'The presence of a colleague at the back of the room made me nervous' with higher frequency for those who failed ( p < 0.05). It has also been found, contrary to other studies [ 9 ], that vital parameters assessed before the test, such as blood pressure and heart rate, have no association with the exam's result. However, with regard to the vital parameters assessed after the exam, it was found that the difference between the baseline and the diastolic blood pressure and heart rate after the exam is higher for those who had failed in the exam ( p < 0.05). On the other hand, female gender is associated with higher stress levels in practical examinations [ 9 ], it was expected that the female gender would be associated with worse scores in this exam. However, it was found that during 2005-2014 there was no relationship between gender and the outcome and, in the school year of 2014-2015, the male gender was associated with worse outcomes. Similar results have also been found in other studies [ 10 ]. There may be personal prejudices influenced either by previous encounters between the teacher and the student, either by the student's look or even by the gender of the student and the teacher [ 3 ]. It was found that there was an association between teacher Y and a higher percentage of bad performances, however it was not found any association between student's gender and teacher's gender. In fact, although in previous studies has been found an association between worse performance between the pair female teacher/female student, in our study it was not the case [ 11 ].

Bibliografía

1. Selzer R, Ellen S, Rotstein L, Roseby R. Twelve tips for performing well in vivas. Med Teach 2015;37:428-32. [ Links ]

2. Shaikh ST. Objective structured viva examination versus traditional viva examination in evaluation of medical students. Anat Physiol 2015;5:175. [ Links ]

3. Bode C, Ugwu B, Donkor P. Viva voce in postgraduate surgical examinations in anglophone west Africa. J West Afr Coll Surg 2011;1:40-52. [ Links ]

4. Yunis H, ed. Plato: Phaedrus. New York: Cambridge University Press;2011. [ Links ]

5. Simpson RG, Ballard KD. What is being assessed in the MRCGP oral examination?. A qualitative study. Br J Gen Pract 2005;55:430-6. [ Links ]

6. Memon MA, Joughin GR, Memon B. Oral assessment and postgraduate medical examinations:establishing conditions for validity, reliability and fairness. Adv Health Sci Educ Theory Pract 2010;15:277-89. [ Links ]

7. Hashmat S, Hashmat M, Amanullah F, Aziz S. Factors causing exam anxiety in medical students. J Pak Med Assoc 2008;58:167-70. [ Links ]

8. Arndt CB, Guly UM, McManus IC. Preclinical anxiety:the stress associated with a viva voce examination. Med Educ 1986;20:274-80. [ Links ]

9. Sharma B, Wavare R, Deshpande A, Nigam R, Chandorkar R. A study of academic stress and its effect on vital parameters in final year medical students at SAIMS Medical College, Indore, Madhya Pradesh. Biomedical Research India 2011;22:361-5. [ Links ]

10. Hecimovich M, Maire J, Losco B. Effect of clinician feedback versus video self-assessment in 5th-year chiropractic students on an end-of-year communication skills examination. J Chiropr Educ 2010;24:165-74. [ Links ]

11. Niehaus DJ, Jordaan E, Koen L, Mashile M, Mall S. Applicability and fairness of the oral examination in undergraduate psychiatry training in South Africa. Afr J Psychiatry 2012;15:119-23. [ Links ]

Received: April 20, 2018; Accepted: May 09, 2018

Corresponding author: Andrés Borges MD. Faculdade de Ciências da Saúde. Universidade da Beira Interior. Avenida Infante D. Henrique. CP 6200-506. Covilhã, Portugal. E-mail: borges_al@hotmail.com

Competing interests: None declared.

Creative Commons License Este es un artículo publicado en acceso abierto bajo una licencia Creative Commons