SciELO - Scientific Electronic Library Online

 
vol.40 número2Mindfulness Rasgo y el potencial papel mediador de las estrategias de regulación emocional en el trastorno bipolarTerapia de Aceptación y Compromiso en conducta suicida: una revisión sistemática índice de autoresíndice de materiabúsqueda de artículos
Home Pagelista alfabética de revistas  

Servicios Personalizados

Revista

Articulo

Indicadores

Links relacionados

  • En proceso de indezaciónCitado por Google
  • No hay articulos similaresSimilares en SciELO
  • En proceso de indezaciónSimilares en Google

Compartir


Anales de Psicología

versión On-line ISSN 1695-2294versión impresa ISSN 0212-9728

Anal. Psicol. vol.40 no.2 Murcia may./sep. 2024  Epub 26-Sep-2024

https://dx.doi.org/10.6018/analesps.554261 

Psychology and COVID-19

Results of a brief online group application of the unified protocol for the prevention of emotional disorders in university students: a pilot study with multiple baseline experimental design

Resultados de una aplicación grupal breve en línea del protocolo unificado para la prevención de trastornos emocionales en estudiantes universitarios: un estudio piloto con diseño experimental de línea base múltiple

Jordi Socias-Soler1  2  , Laura Martínez-García1  2  , Óscar Peris-Baquero1  2  , Jorge Osma1  2  * 

1University of Zaragoza, Teruel (Spain)

2Research Health Institute of Aragon, Zaragoza (Spain)

Abstract:

Emotional disorders (EDs) are the most common disorders among the young population. The development of preventive programs for EDs is essential to avoid their possible appearance. Transdiagnostic prevention programs could present an advantage over existing ones to improve emotional regulation strategies. Thus, the objective of this study has been to determine the preliminary feasibility and effectiveness of a brief program based on the Unified Protocol (UP). The project consisted of a pilot study using a multiple baseline experimental design. Nine university students received a 5-session program based on the UP in online-group format. Significant differences were found after the intervention for emotion regulation, perceived social support and avoidance, with moderate-large effect sizes (Cohen's r = .49 - .59). These improvements showed increases at 1-month and 3-month follow-ups. Those results are in line with those showing that brief transdiagnostic preventive programs could be useful for the prevention of EDs in the university population.

Keywords: Prevention; Emotional disorders; University students; Unified protocol; Online; Group

Resumen:

Los trastornos emocionales (TEs) son los trastornos más comunes entre la población joven. El desarrollo de programas preventivos de los TEs es fundamental para evitar su posible aparición. Los programas de prevención transdiagnósticos podrían presentar una ventaja sobre los existentes para mejorar las estrategias de regulación emocional. Así, el objetivo de este estudio ha sido determinar la viabilidad y eficacia preliminar de un programa breve basado en el Protocolo Unificado (PU). El proyecto consistió en un estudio piloto utilizando un diseño experimental de línea base múltiple. Nueve estudiantes universitarios recibieron un programa de 5 sesiones basado en el PU en formato grupal online. Se encontraron diferencias significativas después de la intervención en la regulación de las emociones, el apoyo social percibido y la evitación, con tamaños del efecto moderados-grandes (r de Cohen = .49 - .59). Estas mejoras mostraron aumentos en los seguimientos al mes y a los 3 meses. Esos resultados están en línea con los que muestran que los programas preventivos transdiagnósticos breves podrían ser útiles para la prevención de los TEs en población universitaria.

Palabras clave: Prevención; Trastornos emocionales; Estudiantado universitario; Protocolo Unificado; Online; Grupo

Introduction

The university stage is considered a highly stressful lifetime, associated with important changes in lifestyle, transitioning roles and the appearance of new responsibilities that can affect quality of life, decrease academic achievement and increase interpersonal difficulties (Auerbach et al., 2019; Ribeiro et al., 2018). These factors can enlarge the risk of psychological distress and mental disorders (Bayram & Bilgel, 2008), being mood and anxiety disorders, also called emotional disorders (EDs; Bullis et al., 2019), the most prevalent disorders among university students in Spain (Labrador et al., 2016; Miranda‐Mendizabal et al., 2019). In fact, evidence has shown that most of EDs usually appear between the ages of 15 and 24 (Auerbach et al., 2019).

Despite the high prevalence rates in university students of EDs, very few students receive mental health attention, as shown by the results of the study carried out by Auerbach et al. (2016), where they found that of the students who presented an EDs in the last 12 months, only 16.4% had received some type of intervention. Furthermore, the treatment usually starts after several years of the beginning of the symptomatology, making it harder to treat (Bienvenu & Ginsburg, 2007). In fact, EDs tend to become chronic, with low spontaneous remission rates between 17% and 30% (Craske & Zucker, 2002).

Knowing that the onset of EDs is usually in youth, and that its chronification makes treatment difficult, the development of brief preventive interventions in university contexts is especially important. In this line, research suggests that current prevention programs can reduce subclinical symptoms or vulnerability factors and decrease incidence of disorder onset (Brent et al., 2015, Stockings et al., 2016). However, these programs are generally aimed at children and adolescents, and have a prevention-oriented approach to specific disorders, as happens with specific treatment protocols for specific disorders (Bentley et al., 2018). The validity of these discrete conceptualizations is questioned by the presence of overlap disorders in clinical populations (Brown et al., 2001), which are closely related, with odds ratio (OR) of simultaneous prevalence between 3.9 and 21.3 for mood and anxiety disorders (Saha et al., 2021).

Thus, prevention strategies based on transdiagnostic approaches for psychological intervention could present several advantages. Current evidence has identified common underlying factors shared between the EDs, such as neuroticism, negative affectivity, perfectionism or rumination (Barlow et al., 2014; Bullis et al., 2019), so prevention strategies could focus on enhancing quality of life and emotional management, rather than emphasizing treatment of specific disorder symptoms (Sauer-Zavala et al., 2017b). In addition, some specific skills, such as problem solving or assertiveness training, have been shown to be useful for improving life satisfaction and well-being in students (De Sousa & da Costa Padovani, 2021; Gál et al., 2022) and could be incorporated in transdiagnostic preventive programs.

In this line, the Unified Protocol for Transdiagnostic Treatment of Emotional Disorders (UP) is a transdiagnostic cognitive-behavioural evidence-based psychological treatment (Barlow et al., 2018). Its goals focus on improving emotional regulation strategies through 8 different modules: setting goals and staying motivated, understanding your emotions, emotional awareness, cognitive flexibility, opposing emotional behaviours, coping with unpleasant physical sensations, emotional exposure and recognizing your achievements and looking to the future (Barlow et al., 2018).

Only four studies have developed prevention programs based on the UP in university students. Two of them were carried out by Barlow's team at Boston University, and both consisted of a single preventive session. In the first study, with a sample of 115 students (n = 45 in the experimental group), a face-to-face 2-hour workshop was carried out in group format. After the session, statistically significant improvements were found in neuroticism, quality of life, and experiential avoidance in the experimental group, compared to the control group (Bentley et al., 2018). The second study included 223 participants (n = 120 in the experimental group), which participated in a two-hour in-person transdiagnostic prevention workshop based on the UP. No significant differences were obtained in the emotional variables (stress, negative affectivity, and quality of life) compared to the waitlist control group (Sauer-Zavala et al., 2021). The third study, which had a sample of 128 students (n = 56 participants in the experimental condition), was carried out at the public University of Bogotá. A brief UP-based program (6 group sessions, one each week, lasting 2 hours). Significant decreases in neuroticism, stress, anxiety, depression and improvements in mindfulness, perceived anxiety control, and emotional dysregulation were found at the end of the program (Castro-Camacho et al., 2021). The fourth study consisted on the online and group application of the eight UP treatment modules to 9 students attended at the psychological attention service of the University of Cadiz, Spain. The intervention was applied weekly and had a total of 12 sessions. After the intervention, significant differences were found between pre and post scores on negative affect and perception of autolytic and aggression to others risk (Arrigoni et al., 2021).

Considering all the above mentioned and due to the high prevalence of EDs in university students, it would be essential to keep designing and developing programs focused on prevention of EDs in this population. For all these reasons, the objective of the present study is to determine the preliminary feasibility and effectiveness of a brief program based on the UP for the prevention of emotional symptomatology and EDs in the university population in Spain, focusing specifically on improving participants' emotional regulation skills and improving symptoms of anxiety and depression.

Method

Design

Due to the small number of participants, a multiple baseline design was used, since it has great advantages for preliminary studies or studies with a limited sample. The design uses the participants as its own control because it presents the same participants in all conditions and, to improve its internal validity, it makes multiple observations for the same participant (Sauer-Zavala et al., 2017a).

Participants

Nine university students (two men and seven women) aged between 19 and 27 years (M = 22.33; SD = 2.50) participated in this study. Regarding the level of the studies cursed by participants, five were students of college degree, one participant was a postgraduate student, and three participants were PhD students. Of the nine participants, 7 were single and 2 had a partner. Four of the participants worked while they were studying.

Initially, 14 people contacted to participate in the study and all of them carried out the pre-program evaluation. All of them met the inclusion criteria, but of the 14 initial participants, only nine answered the contact emails to start the baseline. The remaining five participants did not reply to the contact emails and did not provide information about their abandonment. The nine participants who completed the baseline started the program and all finished it.

Measures

Primary outcomes

Overall Anxiety Severity and Impairment Scale (OASIS;Norman et al., 2006,Osma et al., 2019). Instrument used to assess the frequency, intensity, severity and deterioration of anxiety-related symptoms. The OASIS is a five-item rating scale scored on a scale of 0 to 4, where higher scores indicate higher levels of severity and impairment. The internal consistency of the Spanish validation was 0.87.

Overall Depression Severity and Impairment Scale (ODSIS;Bentley et al., 2014,Osma et al., 2019). Instrument used to assess the frequency, intensity, severity and deterioration of depressive-related symptoms. As the OASIS scale, the ODSIS is a five-item rating scale scored on a scale of 0 to 4, where higher scores indicate higher levels of severity and impairment. The internal consistency of the Spanish validation was .94.

The Multidimensional Emotional Disorder Inventory (MEDI;Rosellini & Brown, 2019,Osma et al., 2021). Evaluation through 49 items of the transdiagnostic profile of EDs, which is made up of nine dimensions: neurotic temperament, positive temperament, depressed mood, somatic anxiety, autonomic arousal, social worries, intrusive cognitions, traumatic re-experiencing, and avoidance. The items have a Likert format with scales from 0 (it is not characteristic of me) to 8 (totally characteristic of me). The Cronbach’s alphas of the Spanish validation were between .74 and .92.

Difficulties in Emotion Regulation Scale (DERS;Gratz & Roemer, 2008;Hervás & Jódar, 2008). This measure evaluates difficulties in emotional regulation through 28 items, scored on a scale of 1 (Hardly ever) to 5 (Almost always), with five different subscales: lack of control, rejection, interference, inattention, and emotional confusion. A Cronbach’s alpha of .93 was found for the global scale in the Spanish validation.

Baseline evaluation questionnaire. To make easier the daily evaluation of the baseline, we summarized the variable we wanted to evaluate in one item. To do this, we chose the item with the highest factorial load for each variable (Suso-Ribera et al., 2018). Specifically, the participants answered two questions of The Emotion Regulation Questionnaire (ERQ; Gross & John, 2003; Spanish adaptation by Cabello et al., 2013) to evaluate cognitive reappraisal and expressive suppression. Both dimensions shown a good internal consistency for its adaptation into Spanish, with Cronbach’s α coefficients of .79 and .75, respectively.

Secondary outcomes

Brief Symptoms Inventory-18 (BSI-18;Derogatis, 2001;Andreu et al, 2008). Evaluation through 18 items ranged 0-4 (0 = none, 4 = Al lot) of psychopathology in 4 subscales: somatization, depression, anxiety and panic. The Spanish version has shown a good reliability, with a range of .71 for the anxiety factor to .88 depression factor, reaching the total BSI score a Cronbach’s alpha of .89.

The Multidimensional Scale of Perceived Social Support (EMASP;Zimet et al., 1988;Landeta & Zumalde, 2002). This measured evaluates perceived social support in relation to three dimensions of the social structure: family, friends and relevant people. Items follow a Likert format, with a scale ranged 1-7 (1 = totally disagree, 7 = totally agree). The EMASP has a good reliability, with Cronbach’s alpha ranged between .87 to .91 for the subscales, and .88 for the total scale.

EuroQol (Brooks, 1996;Badía et al., 1999). Assessment of self-perceived health status. First, it assesses self-perceived health status in severity levels (three levels: no problems, some problems or moderate problems, and unable or extreme problems) for each of the following five dimensions: mobility, self-care, daily activities, pain/discomfort, and anxiety /depression. Second, it assesses the self-perceived global health status today on a vertical visual analogy scale (VAS), ranging from 0 (worst imaginable health state) to 100 (best imaginable health state). Lastly, it includes an index of social values that is obtained for each state of health generated by the instrument, which ranges between a value of 1 (better state of health) and 0 (death). Both formats showed good test-retest reliability, with scores ranged .81- .92 on the intraclass correlation coefficient (ICC).

Treatment Satisfaction Questionnaire (STQ; an adaptation of Client Satisfaction Questionnaire (CSQ-8) ofLarsen et al., 1979). Our adaptation includes 6 of the 8 items of the CSQ-8 (perceived quality, adaptation to previous expectations, recommendation of treatment to friends or relatives, usefulness of the techniques learned, general satisfaction with the intervention, and probability that they will choose an intervention again of this type) and an item related to the discomfort generated by the intervention. Likewise, a change has been made in the Likert response scale, going from 4 points in the original (0 = “Bad / Nothing” to 4 = “Excellent/Very much”) to 11 in the current one (0 = “Bad / Nothing to 10 = "Excellent/Very").

Evaluation questionnaire of trained emotional regulation skills. Ad hoc questionnaire made up of 9 questions; one of a general nature that evaluates the usefulness of the program to improve emotional regulation and eight specific ones that separately evaluate the usefulness of each of the techniques that are worked on in the different modules to better regulate emotions. The response scale is Likert-type and ranges from 0 (not at all) to 10 (very much). It also includes five open-response questions to assess the opinion on the number and duration of the sessions, the contents and length of the manuals and the opinion of the application format used.

Procedure

Recruitment was done through the social networks (Instagram, Facebook, and twitter) of the University of Zaragoza and the research group of Research Health Institute of Aragon. Emails were also sent through the list-server of each degree and PhD programs of the University. Posters were also distributed throughout the different centers of the university. All ways of communication included the aim of the study “to learn how to regulate their own emotions” and a QR with a link to the Google Form of the study.

Once the participants entered the form, they found a more detailed description of the study and its objectives. To participate, they had to fill the informed consent and the General Data Protection Regulation (GDPR), sociodemographic data and the pre-program assessment. The Eligibility criteria were: (1) Be a student of the University of Zaragoza (Degree, Postgraduate studies or PhD); (2) Be at least 18 years old; (3) Good written and spoken understanding of Spanish; (4) Reside during the academic year in Aragon; (5) Have Internet access; (6) Not currently receiving psychological or pharmacological treatment for a mental disorder; (7) Signature of the informed consent.

Students who did not meet the inclusion criteria because they were currently receiving psychological or pharmacological treatment for a mental disorder were notified of the reason for exclusion from the study. Thus, they were informed about the preventive nature of the program, from which they could not benefit as the specialized treatment they were receiving was more recommended. If participants had clinical symptoms, they were referred to the public mental health system or to the official college of psychologists, so that they can find a specialist according to their needs.

After the initial evaluation, the students were randomly assigned to one of the three conditions: 1) start of the program after 5 days of evaluation; 2) after 8 days of evaluation; 3) or after 10 days of evaluation. Randomization was performed using randomization software (www.rando-mizer.org). Once participants were randomized to one of the three conditions, the researchers contacted them by email to organize the prevention program groups and to send the corresponding baseline evaluation forms (Google Form). The participants were divided into two groups based on the time preference of the participants. One of the groups had five participants and the other had four. Once the baseline assessment was completed, the groups started the program.

The intervention consisted on the online application of a preventive group program based on the UP (Barlow et al., 2018) during 5 sessions of 2 hours each. The program involves learning and training one UP skill per session. In some modules, other useful techniques were added, such as assertiveness training and problem solving. The skills worked on in each module were: 1) psychoeducation on emotions and functional analysis; 2) Emotional awareness; 3) Thought's flexibility and problem solving; 4) Countering emotional behaviours; 5) Emotional copying and assertiveness training. The participants received a brief manual summarizing the important contents of each session and also the exercises to be carried out, with their corresponding records for practice between sessions.

All treatment sessions were carried out by the same therapists. One group program was carried out by a UP Level I trained therapist, and the other group program was carried out by an expert therapist with an UP-Level II training.

During the program, participants also completed weekly baseline evaluations. Once the program was over, the patients filled out the post-program protocol. Likewise, follow-up was carried out after the end of the program at one month and at 3 months, following the same procedure as the post-program and with the management of email reminders.

Data analysis

Statistical analyses were performed with the SPSS 21.0 (SPSS 21.0; IBM, 2012). First, descriptive statistical analyses were carried out to analyse the sociodemographic data of the sample.

Second, to determine if there were statistical differences depending on the assigned baseline, nonparametric analyses were performed at the different moments of evaluation of the baseline and of the evaluation prior to program through the Kruskal-Wallis test. To calculate differences between responder and non-responder participants we used the Mann-Whitney U test.

Next, data analysis was performed using the full sample. Due to the number of participants, a non-parametric comparison of means was performed using the Wilcoxon signed-rank test to analyse the effectiveness of the program and determine if there were statistically differences between the different pre-post program and follow-up conditions. The correction of Cohen's r test (Cohen, 1988) was used to calculate the effect size, where values from .30- .50 are considered medium-moderate effect sizes.

Results

Differences in the evolution on the use of emotional regulation strategies between the three baseline conditions

A visual analysis of the evolution of the emotion regulation strategies of cognitive reappraisal and emotional suppression throughout the different moments of evaluation in each of the baseline conditions was carried out. As can be seen on Figure 1, while the cognitive reassessment strategy tended to improve over time, emotional suppression decreased across assessments, regardless of whether participants were part of the 5, 8, or 10-day baseline condition.

Figure 1. Evolution of the strategies of cognitive reappraisal and emotional suppression for the 5-day baseline (n = 3), 8-day baseline (n = 3) and 10-day baseline (n = 3). 

Effectiveness of the program

Differences in scores between baseline conditions

Using the Kruskal-Wallis test, it was determined that there were no differences in the scores depending on the condition at any time during baseline data collection or in the pre-treatment evaluation for any of the variables (p < .05). Differences were only found on the somatic anxiety dimension of the MEDI (H(2) = 6.25, p =.04) at the pre-intervention assessment, showing the lowest scores in the group of 10 days baseline (means ranged 12.33-25.00). Differences by baseline group for the somatic anxiety dimension of the MEDI were not maintained on subsequent assessments. Because no other significant differences were found depending on the baseline condition, data analysis were performed using the full sample.

Pre-post treatment comparison

After the application of the program, significant differences (p < .05) were found in difficulties in emotion regulation (DERS) (W(8) = .00, p = .007, r = .59), perceived social support (EMASP) (W(8) = 5.00, p = .022, r = .49) and avoidance (MEDI’s dimension) (W(8) = .00, p = .007, r = .59), all three with moderate effect sizes. Although no more significant differences were found, we found medium effect sizes in other variables such as depressed mood (MEDI’s dimension) and depressive symptoms (ODSIS), neuroticism (MEDI’s dimension), intrusive cognitions (MEDI’s dimension) and somatic anxiety (MEDI’s dimension) (ranged .30- .37).

Table 1. Descriptive variables of the pre-program, post-program, 1 and 3-month follow-up conditions for the depressive and anxiety symptoms, difficulties in emotion regulation, general psychopathology, perceived social support, self-perceived health status and the nine dimensions of The Multidimensional Emotional Disorder Inventory (n = 9). 

Note.MA = mean; SDB. = standard deviation; MdnC = median; ODSISD = Overall Anxiety Severity and Impairment Scale; OASISE = Overall Depression Severity and Impairment Scale; DERSF = Difficulties in Emotion Regulation Scale; BSI-18G = Global Severity Index of the Brief Symptoms Inventory-18; EMASPH = The Multidimensional Scale of Perceived Social Support; EUROQOLI = EuroQol’s thermometer; NTJ = neurotic temperament dimension; PTK = positive temperament dimension; DML = depressed mood dimension; AAM = autonomic arousal dimension; ICN = intrusive cognitions dimension; SAO = somatic anxiety dimension; SWP = social worries dimension; TRQ = traumatic re-experiencing dimension; AVR = avoidance dimension.

Table 2. Wilcoxon signed rank test for pre-post treatment comparison, pre-treatment and 1 Month Follow-up comparison, and pre-treatment and 3 Month Follow-up comparison of depressive and anxiety symptoms, difficulties in emotion regulation, general psychopathology, perceived social support, self-perceived health status and the nine dimensions of The Multidimensional Emotional Disorder Inventory (n = 9). 

Note.WA = Wilcoxon Signed-Rank Test; CIB = Confidence interval; rC = Cohen's r test; ODSISD = Overall Anxiety Severity and Impairment Scale; OASISE = Overall Depression Severity and Impairment Scale; DERSF = Difficulties in Emotion Regulation Scale; BSI-18G = Global Severity Index of the Brief Symptoms Inventory-18; EMASPH = The Multidimensional Scale of Perceived Social Support; EUROQOLI = EuroQol’s thermometer; NTJ = neurotic temperament dimension; PTK = positive temperament dimension; DML = depressed mood dimension; AAM = autonomic arousal dimension; ICN = intru sive cognitions dimension; SAO = somatic anxiety dimension; SWP = social worries dimension; TRQ = traumatic re-experiencing dimension; AVR = avoid ance dimension;

*p < .05.

Pre-treatment and 1 month follow-up comparison

The significant differences found at the end of the treatment were maintained at one month of follow-up for difficulties in emotion regulation (W(8) = 7.00, p =.038, r = .43) and avoidance (W(8) = .00, p =.005, r = .63), also with moderate effect sizes. Other variables like depressive symptoms (W(8) = .00, p =.011, r = .55), neuroticism (W(8) = 8.00, p = .048, r = .40), intrusive cognitions (W(8) = 6.50, p =.033, r = .45) and somatic anxiety (W(8) = 5.50, p = .046, r = .41) had moderate-large effect sizes at the end of the program and presented significant differences at one month of follow-up, showing an improvement over time. The depressed mood variable kept moderate effect sizes (.32), and the perceived social support no longer present significant differences, but also kept moderate effect sizes over time (.31). In addition, the autonomic arousal (MEDI’s dimension) shown also an improvement on the month follow-up, presenting significant differences (W(8) = 5.00, p =.040, r = .43) with moderate effect size.

Pre-treatment and 3 months follow-up comparison

After three months, significant differences were maintained for the difficulties in emotion regulation (W(8) = 1.00, p = .004, r = .60), autonomic arousal (W(8) = 8.00, p = .048, r = .41), intrusive cognitions (W(8) = 7.00, p = .038, r = .43), somatic anxiety (W(8) = 3.00, p =.021, r = .49), and avoidance (W(8) = 6.50, p = .033, r = .45), all of them with moderate effect sizes. Depressive mood, which previously had shown considerable improvements, presented significant differences (W(8) = 6.00, p = .029, r = .46). Other variables, which had already shown improvement after the program or after one month's follow-up, continued to present moderate effect sizes, such as depressive symptoms and perceived social support (.30 - .32). In addition, new variables shown an improvement, such as general psychopathology (BSI-18) and traumatic re-experiencing (MEDI’s dimension), both with moderate affect sizes (ranged .31- .39).

Satisfaction with the program and application format and adherence

Satisfaction

As can be seen on Table 3, all participants shown a high satisfaction with the application format (online and group) (ranged 8-10), showing great acceptability and almost none discomfort caused. Regarding the contents of the program, all the modules were considered very useful for regulating emotions, with the first psychoeducation module being the best valued by the participants (ranged 5-10).

Table 3. Answers to our CSQ-8 adaptation and to the ad hoc questionnaire, including satisfaction with the program, contents and application format (n = 9). 

Note.MA = mean; SDB = standard deviation; 0 = No quality / Not at all useful / I would not recommend it at all / They have not helped me at all / Not sat isfied at all / Not at all uncomfortable / Not at all / Not at all; 10 = Maximum quality / Totally useful / I would highly recommend it / They have helped me a great deal / Totally satisfied / Maximum discomfort / Yes, without hesitation / Very much

Adherence

Of the 14 participants who carried out the pre-program evaluation, only 9 started the baseline forms and the preventive program. No differences were found (p > .05) between the pre-program scores in any instrument between the participants who dropped out and those who started the program, calculated by the Mann-Whitney U test. Despite the initial abandonment, all participants who started the program completed all the modules of the program along with all the evaluations established at the end of the program and in the corresponding follow-ups, counting the program with 100% adherence.

Discussion

In reference to the objectives of this study, we hypothesized that a brief program based on the UP for the prevention of emotional symptomatology would improve the emotional regulation strategies of the participants and improve symptoms of anxiety and depression. After the application of the program, results shown that it could be effective for the improvement of symptoms of anxiety and depression, as well as for the improvement of the emotion regulation strategies of the participants, which seem to be maintained and even getting better at three months follow-up assessment.

While variables such as perceived social support, avoidance and difficulties in emotional regulation already showed significant improvements after the preventive program, others, such as the dimensions of the MEDI, presented statistical differences during the follow-ups. This progressive improvement is also observable in Figure 1 for emotional suppression and cognitive reappraisal, evaluated in the baseline questionnaire, where an improvement in the expected direction of both strategies can be seen over time. This could be due to the fact that changes in some variables such as neuroticism, depressed mood or cognitive intrusions could require more practice and training in the skills learned during the program, therefore, the continuous practice of the skills could be the reason for the improvement during the follow-ups. Similar results were found by Sauer-Zavala et al. (2020), where the greatest changes in neuroticism occurred after 16 weeks.

This progressive improvement throughout the follow-ups could be related to the improvement of the emotional regulation strategies observed in the DERS scores, already observable after finishing the program, and in Figure 1 for cognitive reappraisal and emotional suppression. The application of preventive programs like this, capable of improving students' regulation strategies in a few sessions, could reduce the appearance of emotional problems and, consequently, reduce the personal and economic costs associated with EDs. The application of programs like this makes even more sense when vulnerability factors had achieved significant reductions after the application of the program, which also it’s maintained to a greater or lesser extent in the follow-ups, as is the case of avoidance and neuroticism.

Despite the methodology differences of the previous studies, these improvements in emotional regulation, avoidance, neuroticism, anxious symptomatology, and depressive mood are consistent with three of four previous studies on the implementation of UP-based preventive programs for EDs (Arrigoni et al., 2021; Bentley et al., 2018; Castro-Camacho, Díaz & Barbosa, 2021). To date, and considering the limitation of the sample of this pilot study, this is the shortest program that has obtained the best results. The exception is the intervention carried out in the pilot of Bentley et al. (2018), which consisted of a single two-hour session, and which obtained small effect sizes. When increasing the sample, no differences were found for a single session (Sauer-Zavala et al., 2021). In the case of the results obtain by Castro-Camacho, Díaz & Barbosa (2021), the effect sizes are similar but larger in our sample for the shared variables (DERS and neuroticism, positive affect and avoidance of the MEDI) except for neuroticism at 3-month follow-up, which is slightly lower in our study.

In terms of feasibility and acceptability, the patients showed a high predisposition and acceptance with the application format, which translated into 100% adherence to the program. All the participants positively valued the contents and quality of the program, as well as its usefulness to improve their emotional management. The training in problem solving and assertiveness, which is not generally included in other UP-based preventive programs for adults, were also positively valued by all participants. Regarding the open questions, all the participants thought that the duration of sessions and the contents explained in the manuals was adequate. Regarding the online format, the flexibility of the format was valued above all, being able to adapt the sessions more easily to their class schedules and internships at the university.

Despite the promising results, this study has some limitations to be considered. First, the small sample size. We decided to use a multiple baseline experimental design because this is the first study applying a brief online group UP based preventive program in a university context in Spain and because this methodology allow researchers to conduct pilot studies with small sample sizes maintaining some control standards (Sauer-Zavala et al., 2017a). Future studies must increase the sample size and use randomized control trials to test the long-term efficacy of this program. Second, a clinical interview was not conducted to detect whether any participant met criteria for any disorder. Instead, it was decided to ask participants about their past or current history of psychological or psychiatric treatment along with an assessment of general psychopathology using the BSI-18. The participants in our study had not received or were receiving treatment at the time of the program and showed non-clinical scores in general psychopathology. Third, as several participants commented, the number of instruments used was very large and could have been the reason for the initial abandonment. However, participants who completed the program were very satisfied with the format at the end of the program. The objective of the research team is to carry out a study where the sample is larger and where the changes or improvements produced by the prevention program can be better observed.

In summary, the results of this pilot study on the application of a brief transdiagnostic preventive program based on the UP have shown promising results, even achieving statistically significant improvements in this specific community population, university students. The transdiagnostic approach on group and online format allow greater flexibility and cost-efficiency than other intervention formats, making these brief prevention programs easier to be implemented in naturalistic community setting contexts such us primary prevention health services or in university psychological care services (Castro-Camacho et al., 2021; Ferreres-Galán, Quilez-Orden, & Osma, 2022; Martínez-Borba et al., 2022). However, it is necessary to continue investigating in this research line with a larger number of participants and long-term follow-up.

Ethical Approval and Consent to Participate

The study was conducted under ethic’s approval of Zaragoza University with number 23-/02-/2022.

References

Andreu, Y., Galdón, M. J., Dura, E., Ferrando, M., Murgui, S., García, A., Ibáñez, E., & Valencia, U. De. (2008). Psychometric properties of the Brief Symptoms Inventory-18 (Bsi-18) in a Spanish sample of outpatients with psychiatric disorders. Psicothema, 20(4), 844-850. [ Links ]

Arrigoni, F., Marchena-Consejero, E., & Navarro-Guzmán, J. (2021). Aplicación y evaluación de la eficacia del Protocolo Unificado transdiagnóstico con estudiantes universitarios españoles (Application and evaluation of the effectiveness of the Unified Transdiagnostic Protocol with Spanish university students). Revista Costarricense de Psicología, 40(2), 149-169. https://doi.org/10.22544/rcps.v40i02.05 [ Links ]

Auerbach, R. P., Alonso, J., Axinn, W. G., Cuijpers, P., Ebert, D. D., Green, J. G., Hwang, I., Kessler, R. C., Liu, H., y Mortier, P. (2016). Mental disorders among college students in the World Health Organization world mental health surveys. Psychological Medicine, 46(14), 2955-2970. https://doi.org/10.1017/S0033291716001665. [ Links ]

Auerbach, R., Mortier, P., Bruffaerts, R., Alonso, J., Benjet, C., Cuijpers, P., Demyttenaere, K., Ebert, D., Green, J., Murray, E., Nock, M., Pinder-amaker, S., Sampson, N., Stein, D., Vilagut, G., Zaslavsky, A., & Kessler, R. (2019). Student Project : Prevalence and Distribution of Mental Disorders. Journal of Abnormal Psychology, 127(7), 623-638. https://doi.org/10.1037/abn0000362. [ Links ]

Badia Llach, X., Monserrat, S., Roset, M., & Herdman, M. (1999). Feasibility, validity and test-retest reliability of scaling methods for health states: The visual analogue scale and the time trade-off. Quality of Life Research, 8(4), 303-310. https://doi.org/10.1023/A:1008952423122 [ Links ]

Barlow, D. H., Ellard, K. K., Sauer-Zavala, S., Bullis, J. R., & Carl, J. R. (2014). The Origins of Neuroticism. Perspectives on Psychological Science, 9(5), 481-496. https://doi.org/10.1177/1745691614544528 [ Links ]

Barlow, D.H., Farchione, T. J., Sauer-Zavala, S., Murray-Latin, H., Ellard, K. K., Bullis, J. R., ... Cassiello-Robbins, C. (2018). Unified Protocol for Transdiagnostic Treatment of Emotional Disorders: Therapist Guide (2nd ed.). Oxford University Press. [ Links ]

Bayram, N., & Bilgel, N. (2008). The prevalence and socio-demographic correlations of depression, anxiety and stress among a group of university students. Social Psychiatry and Psychiatric Epidemiology, 43(8), 667-672. https://doi.org/10.1007/s00127-008-0345-x [ Links ]

Bentley, K. H., Boettcher, H., Bullis, J. R., Carl, J. R., Conklin, L. R., Sauer-Zavala, S., Pierre-Louis, C., Farchione, T. J., & Barlow, D. H. (2018). Development of a Single-Session, Transdiagnostic Preventive Intervention for Young Adults at Risk for Emotional Disorders. Behavior Modification, 42(5), 781-805. https://doi.org/10.1177/0145445517734354 [ Links ]

Bentley, K. H., Gallagher, M. W., Carl, J. R., & Barlow, D. H. (2014). Development and validation of the Overall Depression Severity and Impairment Scale. Psychological Assessment, 26(3), 815-830. https://doi.org/10.1037/a0036216 [ Links ]

Brent, D. A., Brunwasser, S. M., Hollon, S. D., Weersing, V. R., Clarke, G. N., Dickerson, J. F., Garber, J. (2015). Effects of cognitive-behavioral prevention program on depression 6 years after implementation among at-risk adolescents: A randomized clinical trial. JAMA Psychiatry, 72(11), 1110-1118. https://doi.org/10.1001/jamapsychiatry. 2015.1559 [ Links ]

Brown, T. A., Campbell, L. A., Lehman, C. L., Grisham, J. R., & Mancill, R. B. (2001). Current and lifetime comorbidity of the DSM-IV anxiety and mood disorders in a large clinical sample. Journal of Abnormal Psychology, 110(4), 585-599. https://doi. org/10.1037//0021-843X.110.4.585. [ Links ]

Bullis, J. R., Boettcher, H., Sauer-Zavala, S., Farchione, T. J., & Barlow, D. H. (2019). What is an emotional disorder? A transdiagnostic mechanistic definition with implications for assessment, treatment, and prevention. Clinical Psychology: Science and Practice, 26(2), 1-19. https://doi.org/10.1111/cpsp.12278 [ Links ]

Bienvenu, O. J., & Ginsburg, G. S. (2007). Prevention of anxiety disorders. International Review of Psychiatry, 19(6), 647-654. https://doi.org/10.1080/09540260701797837 [ Links ]

Brooks, R. (1996). EuroQol: the current state of play. Health Policy, 37(1), 53-72. https://doi.org/10.1016/0168-8510(96)00822-6 [ Links ]

Cabello, R., Salguero, J. M., Fernández-Berrocal, P., & Gross, J. J. (2013). A Spanish adaptation of the emotion regulation questionnaire. European Journal of Psychological Assessment, 29(4), 234. https://doi.org/10.1027/1015-5759/a000150 [ Links ]

Castro-Camacho, L., Díaz, M.M., & Barbosa, S. (2021). Effect of a group prevention program based on the unified protocol for college students in Colombia: A quasi-experimental study. Journal of Behavioral and Cognitive Therapy, 32(2), 111-123. https://doi.org/10.1016/j.jbct.2021.04.001 [ Links ]

Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences (2nd ed.). Lawrence Erlbaum Associates, Publishers. [ Links ]

Craske, M. G., & Zucker, B. G. (2002). Prevention of anxiety disorders: A model for intervention. Applied and Preventive Psychology, 10(3), 155-175. https://doi.org/10.1016/S0962-1849(01)80012-3 [ Links ]

Derogatis, L.R. (2001). Brief Symptom Inventory (BSI)-18. Administration, scoring and procedures manual. NCS Pearson, Inc. [ Links ]

De Sousa, C. R., & da Costa Padovani, R. (2021). Assertive skills: A comparison of two group interventions with brazilian university students. Psicologia: Reflexao e Critica, 34, 27. https://doi.org/10.1186/s41155-021-00188-7 [ Links ]

Ferreres-Galán,, V., Quilez-Orden, A., & Osma, J. (2022). Application of the unified protocol for transdiagnostic treatment of emotional disorders in post-bariatric surgery patients: an effectiveness and feasibility study in group format. Annals of Psychology/Anales de Psicología, 38(2), 219-231. https://doi.org/10.6018/analesps.482301 [ Links ]

Gál, Z., Kasik, L., Jámbori, S., Fejes, J. B., & Nagy, K. (2022). Social problem-solving, life satisfaction and well-being among high school and university students. International Journal of School and Educational Psychology, 10(1), 170-180. https://doi.org/10.1080/21683603.2020.1856249 [ Links ]

Gratz, K. L., & Roemer, L. (2008). Multidimensional assessment of emotion regulation and dysregulation: Development, factor structure, and initial validation of the difficulties in emotion regulation scale. Journal of Psychopathology and Behavioral Assessment, 30(4), 315. https://doi.org/10.1007/s10862-008-9102-4 [ Links ]

Gross, J. J., & John, O. P. (2003). Individual differences in two emotion regulation processes: implications for affect, relationships, and well-being. Journal of Personality and Social Psychology, 85(2), 348-362. https://doi.org/10.1037/0022-3514.85.2.348 [ Links ]

Hervás, G., & Jódar, R. (2008). Adaptación al castellano de la Escala de Dificultades en la Regulación Emocional (Spanish adaptation of the Difficulties in Emotional Regulation Scale). Clínica y Salud, 19(2), 139-156. [ Links ]

IBM Corp. Released (2012). IBM SPSS Statistics for Windows (Version 21.0) (software computer). Armonk, NY: IBM Corp. [ Links ]

Labrador, F.J., Bernaldo-de-Quirós, M., García-Fernández, G., Estupiñá, F., Fernández-Arias, I., Labrador-Méndez, M. (2016). Characteristics of demand and psychological treatments in a university clinic. Clínica y Salud, 27(1), 7-14. https://doi.org/ 10.1016/j.clysa.2016.01.002 [ Links ]

Landeta, O., & Zumalde, E. C. (2002). Adaptación y validación de la escala multidimensional de apoyo social percibido (Adaptation and validation of the multidimensional scale of perceived social support). Ansiedad y estrés, 8(2), 173-182. https://doi.org/10.4321/S0211-57352017000200006 [ Links ]

Larsen, D. L., Atkinson, C. C., Hargreaves, W. A., y Nguyen, T. D. (1979). Assessment of client/patient satisfaction: Development of a general scale. Evaluation and Program Planning, 2(3), 197-207. https://doi.org/10.1016/0149-7189(79)90094-6 [ Links ]

Martínez-Borba, V., Osma, J., Crespo-Delgado, E., Andreu-Pejo, L., & Monferrer-Serrano, A. (2022). Prevention of Emotional Disorders and Symptoms Under Health Conditions: a Pilot Study using the Unified Protocol in a Fertility Unit. Annals of Psychology/Anales de Psicología, 38(1), 25-35. https://doi.org/10.6018/analesps.462331 [ Links ]

Miranda-Mendizabal, A., Castellví, P., Parés-Badell, O., Alayo, I., Almenara, J., Alonso, I., Blasco, M. J., Cebrià, A., Gabilondo, A., Gili, M., Lagares, C., Piqueras, J. A., Rodríguez-Jiménez, T., Rodríguez-Marín, J., Roca, M., Soto-Sanz, V., Vilagut, G., & Alonso, J. (2019). Gender differences in suicidal behavior in adolescents and young adults: systematic review and meta-analysis of longitudinal studies. International Journal of Public Health, 64(2), 265-283. https://doi.org/10.1007/s00038-018-1196-1 [ Links ]

Norman, S. B., Hami Cissell, S., Means-Christensen, A. J., & Stein, M. B. (2006). Development and validation of an Overall Anxiety Severity and Impairment Scale (OASIS). Depression and Anxiety, 23(4), 245-249. https://doi.org/10. 1002/da.20182 [ Links ]

Osma, J., Quilez-Orden, A., Suso-Ribera, C., Peris-Baquero, O., Norman, S. B., Bentley, K. H., & Sauer-Zavala, S. (2019). Psychometric properties and validation of the Spanish versions of the overall anxiety and depression severity and impairment scales. Journal of Affective Disorders, 252, 9-18. https://doi.org/10.1016/j.jad.2019.03.063 [ Links ]

Osma, J., Martínez-Loredo, V., Quilez-Orden, A., Peris-Baquero, Ó., & Suso-Ribera, C. (2021). Validity evidence of the multidimensional emotional disorders inventory among non-clinical spanish university students. International Journal of Environmental Research and Public Health, 18(16). https://doi.org/10.3390/ijerph18168251 [ Links ]

Ribeiro, I., Pereira, R., Freire, I., de Oliveira, B., Casotti, C., Boery, E. (2018). Stress and Quality of Life Among University Students: A Systematic Literature Review. Health Professions Education, 4(2), 70-77. https://doi.org/10.1016/j.hpe.2017.03.002. [ Links ]

Rosellini, A. J., & Brown, T. A. (2019). The Multidimensional Emotional Disorder Inventory (MEDI): Assessing transdiagnostic dimensions to validate a profile approach to emotional disorder classification. Psychological Assessment, 31(1), 59-72. https://doi.org/10.1037/pas0000649 [ Links ]

Saha, S., Lim, C. C. W., Cannon, D. L., Burton, L., Bremner, M., Cosgrove, P., Huo, Y., & J. McGrath, J. (2021). Co-morbidity between mood and anxiety disorders: A systematic review and meta-analysis. Depression and Anxiety, 38(3), 286-306. https://doi.org/10.1002/da.23113 [ Links ]

Sauer-Zavala, S., Cassiello-Robbins, C., Conklin, L. R., Bullis, J. R., Thompson-Hollands, J., & Kennedy, K. A. (2017a). Isolating the Unique Effects of the Unified Protocol Treatment Modules Using Single Case Experimental Design. Behavior Modification, 41(2), 286-307. https://doi.org/10.1177/0145445516673827 [ Links ]

Sauer-Zavala, S., Gutner, C. A., Farchione, T. J., Boettcher, H. T., Bullis, J. R., & Barlow, D. H. (2017b). Current Definitions of “Transdiagnostic” in Treatment Development: A Search for Consensus. Behavior Therapy, 48(1), 128-138. https://doi.org/10.1016/j.beth.2016.09.004 [ Links ]

Sauer-Zavala, S., Tirpak, J. W., Eustis, E. H., Woods, B. K., & Russell, K. (2021). Unified Protocol for the Transdiagnostic Prevention of Emotional Disorders: Evaluation of a Brief, Online Course for College Freshmen. Behavior Therapy, 52(1), 64-76. https://doi.org/10.1016/j.beth.2020.01.010 [ Links ]

Sauer-Zavala, S., Fournier, J. C., Jarvi Steele, S., Woods, B. K., Wang, M., Farchione, T. J., & Barlow, D. H. (2020). Does the unified protocol really change neuroticism? Results from a randomized trial. Psychological Medicine, 51(14), 2378-2387. https://doi.org/10.1017/S0033291720000975 [ Links ]

Suso-Ribera, C., Castilla, D., Zaragozá, I., Ribera-Canudas, M. V., Botella, C., & García-Palacios, A. (2018). Validity, reliability, feasibility, and usefulness of pain monitor. The Clinical Journal of Pain, 34(10), 900-908. https://doi.org/ 10.1097/AJP.0000000000000618 [ Links ]

Stockings, E. A., Degenhardt, L., Dobbins, T., Lee, Y. Y., Erskine, H. E., Whiteford, H. A., y Patton, G. (2016). Preventing depression and anxiety in young people: a review of the joint efficacy of universal, selective and indicated prevention. Psychological Medicine, 46(1), 11-26. https://doi.org/10.1017/S0033291715001725. [ Links ]

Zimet, G. D., Dahlem, N. W., Zimet, S. G., & Farley, G. K. (1988). The Multidimensional Scale of Perceived Social Support. Journal of Personality Assessment, 52(1), 30-41. https://doi.org/10.1207/s15327752jpa5201_2 [ Links ]

Financial supportGovernment of Aragon (Department of Science, University and Knowledge Society) (Grant Number Research Team S31_23R).

Received: January 17, 2023; Revised: August 02, 2023; Accepted: August 25, 2023

* Correspondence address [Dirección para correspondencia]: Jorge Osma. Email: osma@unizar.es

Conflict of interest

The authors declare no conflict of interest.

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License