SciELO - Scientific Electronic Library Online

 
vol.35 número4¿Es culpa del niño? Atribuciones maternas en el abuso y la negligencia infantilEficacia del EMDR en el trastorno de estrés post-traumático: una revisión sistemática y meta-análisis de ensayos clínicos aleatorizados índice de autoresíndice de assuntospesquisa de artigos
Home Pagelista alfabética de periódicos  

Serviços Personalizados

Journal

Artigo

Indicadores

Links relacionados

  • Em processo de indexaçãoCitado por Google
  • Não possue artigos similaresSimilares em SciELO
  • Em processo de indexaçãoSimilares em Google

Compartilhar


Psicothema

versão On-line ISSN 1886-144Xversão impressa ISSN 0214-9915

Psicothema vol.35 no.4 Oviedo Nov. 2023  Epub 29-Jan-2024

https://dx.doi.org/10.7334/psicothema2022.416 

Articles

Patients' and therapists' reports of psychotherapy outcomes: similarities and differences

Informes de pacientes y terapeutas sobre el resultado de la psicoterapia: similitudes y diferencias

Concepción Fernández-Rodríguez (orcid: 0000-0002-6041-8930)*1  , Víctor Loredo-Martínez (orcid: 0000-0002-0403-5273)2  , Rocío Coto-Lesmes (orcid: 0000-0002-2756-8961)1 

1Universidad de Oviedo (Spain)

2Universidad de Zaragoza (Spain)

Abstract:

Background:

Discrepancies between therapists' and patients' measures regarding therapeutic results indicate the need to analyze which symptoms and processes are being taken into consideration when reporting clinical change. This study analyzes the concordance between patient and therapist, at pre- and post-treatment, when reporting about anxiety, depression, Experiential Avoidance (EA), Cognitive Fusion (CF) and Activation (A).

Method:

Convergence was examined between information obtained by means of standardized measures and visual analogical scales (VAS) in 94 patients with anxiety and/or depression who participated in a controlled clinical study (TRANSACTIVA study).

Results:

Statistically significant correlation (p<.05) was found between all the measures of anxiety and depression, regardless of the source, timepoint, and measures procedure at 95% confidence. In the VAS, patient and therapist agreed (p<.05) in their evaluation of specific symptoms. For EA, CF and A, the therapists' measures demonstrated stronger correlations than those of the patients, although, in each condition, all the patients' measures correlated with each other (p<.05).

Conclusions:

Suitable agreement was found between therapist and patient when reporting clinical change. One-item VAS appeared to b suitable for identifying anxiety, depression and the transdiagnostic patterns of EA, CF and A.

Keywords: Emotional disorders; Activation; Experiential avoidance; Cognitive fusion; Visual analogical scale

Resumen:

Antecedentes:

Las discrepancias entre terapeutas y pacientes sobre los resultados terapéuticos indican la necesidad de analizar qué síntomas y procesos se tienen en cuenta al evaluar el cambio clínico. Se analizó la correspondencia entre paciente y terapeuta, en pre y post tratamiento, al informar sobre ansiedad, depresión, Evitación Experiencial (EA), Fusión Cognitiva (FC) y Activación (A).

Método:

Se examinó la convergencia entre la información obtenida mediante cuestionarios estandarizados y escalas analógicas visuales (EVA) en 94 pacientes con ansiedad y/o depresión que participaron en un estudio clínico controlado (estudio TRANSACTIVA).

Resultados:

Se encontró correlación significativa (p <.05) entre todas las medidas de ansiedad y depresión, independientemente de la fuente, momento y procedimiento de medida al 95% de confianza. En la EVA, paciente y terapeuta coincidieron (p <.05) al valorar síntomas específicos. Respecto a EA, CF y A, las medidas del terapeuta mostraron correlaciones más altas y significativas que las del paciente, aunque, en cada condición, todas las medidas del paciente se correlacionaron entre sí (p <.05).

Conclusiones:

Se observó adecuada correspondencia entre terapeuta y paciente al informar sobre el cambio clínico. La EVA de un ítem parece adecuada para identificar ansiedad, depresión y patrones transdiagnósticos de EA, CF y A.

Palabras clave: Trastornos emocionales; Activación; Evitación experiencial; Fusión cognitiva; Escala analógica visual

Self-report instruments are habitually used as measures of diagnostic assessment, for evaluation of clinical results, and for research, as they comply with scientific standards and provide psychometric assurances. This means that the effect size of the differences between scores has been adopted as a result criterion. Furthermore, there is adequate correspondence between data offered by patient self-reports and therapists', suggesting that the two measures could be interchangeable when evaluating mental disorders, functionality and quality of life (Guo et al., 2015; Hershenberg et al., 2020; Zimmerman et al., 2018). Nevertheless, there are also cases where the two differ, differences which are believed to be related to educational attainment, personality factors, and patients' understanding of their disorder (Cuijpers et al., 2010; Franklin & Raines, 2019; Hershenberg et al., 2020; Kendrick et al., 2016).

Patients are often asked for information about clinical improvement by means of one-item analogical scales. Although therapist-patient agreement is also assumed to be acceptable in this measure, the degrees of agreement and the calculations of sensitivity to change are influenced both by the interventions and by events in the patient's life between evaluations (Hobbs et al., 2021; Price et al., 2022; Robinson et al., 2017). In particular, patients' responses and their favorable progression could largely be explained by changes in quality of life, social support, and/or particular life events occurring at the same time as the treatment (Bandelow et al., 2018; Bowling et al., 2012).

These differences between sources make it necessary to ask whether a statistically significant difference in a given clinical condition adequately reflects the client's insight into improvement or deterioration. This is an important question, since the clinical significance of the results is not merely a statistical one, but also has important implications regarding therapeutic decisions (Bauer-Staeb et al. 2021; Hopko et al., 2000; Malpass et al., 2016; Robinson et al., 2017). Furthermore, any reference to therapeutic effects alludes directly to a measure of the therapeutic ingredients. Consequently, discrepancies between evaluators indicate (amongst other things) the need to identify the extent to which, when reporting clinical change, patient and therapist are referring specifically to changes in those conditions and/or processes the therapy focuses on.

To be able to identify the mechanisms through which psychological treatments produce results is important for the empirical validation of the therapies and is essential in order to validate the explanatory model proposed by each therapy regarding the nature of psychological problems. Transdiagnostic approaches are currently investigating precisely those common conditions which could play a part in the onset and maintenance of the psychological disorders. Using a contextual transdiagnostic approach, therapies such as the Acceptance and Commitment Therapy (ACT, Hayes et al., 2011) and Behavioral Activation (BA, Martell et al., 2013) have demonstrated their efficiency and effectivity, both in reducing symptoms and in changing transdiagnostic mechanisms. In controlled clinical studies and, more recently, in mediation studies, evidence has been found to show that clinical results are consistent with the model of psychological flexibility proposed by ACT (Coto-Lesmes et al., 2020a; Gloster et al., 2020; González-Fernández & Fernández-Rodríguez, 2019; Stockton et al., 2019) and with the model of activation defended by BA (Coto-Lesmes et al., 2020b; González-Fernández et al., 2019; Martin & Oliver, 2019; Santos et al., 2017). However, before these conclusions can be confirmed it is necessary to ensure that the measures of evaluation are accurate and the most appropriate ones for examining the processes to which the clinical change is attributed.

The psychometric robustness of the questionnaires to measure the model of Activation developed by BA (for a review, see Manos et al., 2010) and the patterns of psychological inflexibility focused on by ACT (for a review, see Barney et al., 2019; Cherry et al., 2021) justifies their use as result measures for these therapies. They are instruments which measure the frequency or intensity of behaviors, interpersonal actions and/or specific events, and which, in accordance with previous correlational studies, make it possible to understand these data as indicative of transdiagnostic processes. Nevertheless, the suitability of these standardized instruments as measures of the processes of change depends on their capacity to explain the functionality of the behavior. From a contextual point of view, a functional analysis of the relationships of the person with others and with him/herself is essential in explaining the functionality of the problem. Indeed, both BA and ACT base the design of the intervention on a functional analysis of the behavior of each patient carried out by the therapist (with the involvement of the patient) and which requires observations of the behavior in the contexts in which this takes place over a period of time. This is obviously difficult to standardize but is feasible with measures of symptoms or of constructs (Ong et al., 2020; Rogge et al., 2019). In the light of these idiosyncrasies, knowing the degree of congruence between the patient's self-report (whether through standardized measures or analogical scales) and the therapist's report (as an expert) regarding the processes and conditions on which the contextual therapy focuses, could shed light on the suitability of the patient's assessments as measures of the processes of change and, consequently, as result criteria of the therapies.

TRANSACTIVA (Fernández-Rodríguez et al., 2022a) is a controlled trial study with the objective of comparing the post-treatment and follow-up effects of BA, ACT and Cognitive-Behavioral Transdiagnostic Therapy (TD-CBT) on emotional symptomatology, and analyses the role played by Experiential Avoidance, Cognitive Fusion, Activation and Emotion Regulation in the clinical change. With this objective in mind, measures of the therapeutic processes and of the results of the therapy were obtained through standardized measures and visual analogical scales (EVA), completed by both the patient and the therapist at different moments of the intervention. In this research context, this study seeks to analyze the correspondence between all the measures of the patient and therapist both prior to and following the intervention. Ultimately, it is hoped that these data will contribute to improving our knowledge regarding the conditions associated with the therapeutic process and clinical change associated with the transdiagnostic therapies tested in the TRANSACTIVA study.

Method

Participants

Of the 128 who fulfilled the inclusion criteria (i.e., being of 18-65 years of age and scoring ≥ 10 in either subscale of the Hospital Anxiety and Depression Scale), the current study includes 94 patients, of whom 73 (77.66%) completed the treatment. The exclusion criteria were: (a) receiving another type of psychological therapy; (b) suffering physical or cognitive deterioration which might hinder participation in the therapy; (c) presenting either a substance use disorder, a severe mental disorder or communication problems.

Instruments

Hospital Anxiety and Depression Scale (HADS) (Zigmond & Snaith, 1983; Spanish adaptation, Quintana et al., 2003). The HADS is a 14-item scale with 2 subscales, Anxiety (HADS-A: α = .64-.87) and Depression (HADS-D: α = .80-.86), with subscales ranging from 0 to 21. The internal consistency was good at both assessments (anxiety: α = .64-.87; depression: α = .80-.86).

Generalized Anxiety Disorder-scale 7 (GAD-7) (Spitzer et al., 2006; Spanish adaptation, García-Campayo et al., 2010). The GAD-7 assesses symptoms of generalized anxiety disorder as referred to in the DSM-IV. Total scores range from 0 to 21. The GAD-s's internal consistency in the present sample ranged .79-.89.

Short form of the 1978 Beck Depression Inventory (BDI-IA-SCA) (Beck & Steer, 1993; Spanish adaptation, Sanz & García-Vera, 2007). It consists of the first thirteen items of the BDI-IA, referring to affective-cognitive symptoms of depression. The internal consistency in the study sample range was very good (α =.84-.92).

Environmental Reward Observation Scale (EROS) (Armento & Hopko, 2007; Spanish adaptation, Barraca & Pérez-Álvarez, 2010). It consists of 10 items assessing the quantity and availability of reinforcement received from the patient's environment. The internal consistency in the study was good (α= .76-.87).

Acceptance and Action Questionnaire-II (AAQ-II) (Bond et al., 2011; Spanish adaptation, Ruiz et al., 2013). The AAQ-II measures experiential avoidance and psychological inflexibility using 7 Likert-type items. The reliability as estimated by internal consistency was adequate (α= .86-.93).

Cognitive Fusion Questionnaire (CFQ) (Gillanders et al., 2014; Spanish adaptation, Romero-Moreno et al., 2014). The CFQ is a seven-item scale assessing cognitive fusion. The internal consistency in the study sample ranges from .86 to .95.

Visual Analogue Scale (VAS) Designed ad hoc to enable patients (PAVAS) and therapists (TEVAS) to assess frequency during the preceding week of anxiety, depression, A, EA and CF by means of 10-centimetre horizontal lines, the two ends of which represent the two extremes of the condition being evaluated. In each case, the evaluator is asked to “mark on the line the point which best corresponds to the situation being evaluated”. Patients fulfilled the PAVAS weekly. For each pattern of behavior/condition, the measure corresponding to the first session is taken as the pre-treatment measure and that of the last session as the post-treatment measure. Therapists completed the TEVAS in the first, mid (session four) and last sessions. In the present study, and with the aim of comparing patients' and therapists' VAS, only pre- and post-treatment measures are used. The measure is based on the physical distance of the mark from the lines' left extreme (from 0 to 10).

Patient Visual Analogue Scale (PAVAS) PAVAS1(A): My activity level was… PAVAS2(CF): My worries interfered with the things that I wanted to do. PAVAS3(EA): I stopped/avoided doing things so as not to feel bad. PAVAS4(anxiety): I felt nervous. PAVAS5(depression): I felt sad.

Therapist Visual Analogue Scale (TEVAS) TEVAS1(A): The patient's day-to-day occupation in relevant activities was … TEVAS2(EA): The patient avoided activities as a strategy of fear/worry-control. TEVAS3(A): Friends and family maintained anxiety/depression behaviors in the patient. TEVAS4(A): Friends and family encouraged healthy behaviors in the patient. TEVAS5(EA): The patient avoided thoughts and emotions as a strategy for controlling distress. TEVAS6(EA): The patient's attempts to control/avoid worries interfered with the maintaining of his/her relevant activities. TEVAS7(CF): Rumination interfered in the patient's involvement in relevant activities. TEVAS8(CF): The patient's behavior remained focused on the present. TEVAS9(anxiety): Patient's anxiety. TEVAS10(depression): Patient's depression.

Procedure

This secondary study includes participants assigned to any of the experimental groups of the parent study (Fernández-Rodríguez et al., 2022a), which examined the efficacy of the abovementioned treatments for emotional disorders. Those who met study criteria were requested to fill out the informed consent form. Each person filled out the measures individually in an independent room without the presence of the researchers (see Table 1 for sample characteristics). The study was approved by Research Ethics Committee of the Principality of Asturias (Ref. 208/18).

Table 1. Sample Characteristics. 

Variables Total sample (n = 94) BA (n = 34) ACT (n = 27) CBT (n = 33) χ 2/F
n (%) n (%) n (%) n (%)
Sex 2.29
Females 78 (83.0) 27 (79.4)a 21 (77.8)a 30 (90.9)a
Males 16 (17.0) 7 (20.6)a 6 (22.2)a 3 (9.1)a
Agea 40.96 (12.34) 45.12 (12.15)a 42.44 (10.89)a 35.45 (11.93)b 5.99
Marital status 7.08
Single 49 (52.1) 14 (41.2) 13 (48.1) 22 (66.7)
Married/couple 28 (29.8) 11 (32.4) 9 (33.3) 8 (24.2)
Divorced 14 (14.9) 7 (20.6) 5 (18.5) 2 (6.1)
Widowed 3 (3.2) 2 (5.9) 0 (0.0) 1 (3.0)
Employment status 9.65
Working 47 (50.0) 19 (55.9) 14 (51.9) 14 (42.4)
TD 7 (7.4) 3 (8.8) 1 (3.7) 3 (9.1)
PD 2 (2.1) 2 (5.9) 0 (0.0) 0 (0.0)
Unemployed 35 (37.2) 8 (23.5) 11 (40.7) 16 (48.5)
Retired 3 (3.2) 2 (5.9) 1 (3.7) 0 (0.0)
Educational level 4.56
Master/PhD 9 (9.6) 2 (5.9) 3 (11.1) 4 (12.1)
University 51 (54.3) 20 (58.8) 14 (51.9) 17 (51.5)
Vocational 20 (21.3) 5 (14.7) 7 (25.9) 8 (24.2)
High school 8 (8.5) 3 (8.8) 2 (7.4) 3 (9.1)
Elementary 6 (6.4) 4 (11.8) 1 (3.7) 1 (3.0)
HADSa
Anxiety 15.3 (3.13) 15.21 (3.31) 15.44 (3.92) 15.30 (2.16) 0.03
Depression 11.87 (3.99) 12.82(3.87)a 12.74(3.61)a 10.18(3.96)b 4.96
BDIa 15.40 (6.25) 14.35 (5.44) 16.96 (6.26) 15.21(6.93) 1.35
GADa 14.33 (4.29) 13.65 (3.94) 13.92 (5.77) 12.48 (4.19) 0.43
EROSa 20.12 (5.19) 19.88 (5.28) 20.56 (5.02) 20 (5.38) 0.14
AAQ-IIa 36.60 (8.52) 36.82 (9.25) 36.81 (8.50) 36.18 (8.00) 0.06
CFQa 39.59 (6.99) 39.38 (7.25) 41.48 (6.42) 38.18 (7.01) 1.70

Note.a mean (standard deviation). Subscripts indicate between-group differences. Groups with the same subscript did not differ significantly from each other

BA: Behavioural Activation; ACT: Acceptance and Commitment Therapy; CBT: Cognitive-Behavioural Therapy; TD: Temporary disability; PD: Permanent disability; HADS:

Hospital Anxiety and Depression Scale; BDI: Beck's Depression Inventory; GAD: Generalized Anxiety Disorder scale; EROS: Environmental Reinforcement Schedule; AAQ-II:

Acceptance and Action Questionnaire; CFQ: Cognitive Failures Questionnaire

Data Analysis

Of the initial 94 patients, eight participants (8.51%) presented missing data in the VAS at all sessions. Of the 73 participants completing the treatment, one (1.35) presented missing data in the VAS at all sessions, two (2.70) at session three, one (1.35) at session three and two (2.70) in PAVAS and TEVAS at session four. Due to the lack of differences in efficacy between treatments in the short-term (Fernández-Rodríguez et al., 2022a) and the study aims, the analyses were performed without differentiating between groups. To test the convergence measurement instruments both at the baseline and post-treatment, Pearson zero-order correlations (95% confidence interval) were performed between all three sources (including the items of the questionnaires). Discrimination indices of those items were calculated to explore the contribution of those items significantly correlated with the corresponding PAVAS/TEVAS to the total score. To test evidences of validity, Non-parametric 2-paired test were performed between pre- and post-treatment PAVAS/TEVAS.

Results

Relationship Between Measurement Instruments

Activation

Two out of three activation-related TEVAS ENT#091;1(occupation) and 4(healthy behaviors)ENT#093; and PAVAS1(A) at baseline were significantly correlated with EROS total score (all p <.05; see Table 2). Although the PAVAS1(A) was significantly correlated only with TEVAS1(Occupation), the latter and the TEVAS4(healthy behaviors) were highly correlated. Regarding specific items and besides other statistically significant associations, the three clinical measures at baseline were significantly correlated with items 1 and 3 from the EROS. Correlations between the PAVAS and other measures at post-treatment increased their magnitude dramatically (see Table 2 for all correlations at 95% confidence interval).

Experiential Avoidance. Although both TEVAS2(avoid activities) and TEVAS6(control/avoid worries) were statistically significant correlated with AAQ at baseline (all p <.05), only the latter was correlated with PAVAS3(EA) (see Table 2). Regarding the AAQ items, TEVAS6(control/avoid worries) showed the highest correlation with items 1 and 2, while PAVAS3(EA) presented the highest correlations with items 7, 3 and 5 (all p <.001). Correlations at post-treatment followed the same pattern as in the case of activation.

Cognitive Fusion

CFQ total score correlated significantly with all clinical measures at baseline (all p <.05; see Table 2). Nonetheless, only TEVAS7(Rumination) was significantly correlated with PAVAS2(EA). Regarding the CFQ items, TEVAS7(Rumination) showed the highest correlation with items 6 (p <.001), 2 (p <.05) and 1 (p <.05), while PAVAS2(EA) presented the highest correlations with items 3, 5, and 4 and 7 (all p <.05). At post-treatment, correlations between PAVAS2(EA) and other measures increased their magnitude (see Table 2).

Anxiety

HADS-A and GAD were significantly associated with PAVAS4(anxiety) and TEVAS9(anxiety) (all p <.05; see Table 2). Both PAVAS4 and TEVAS9 were also statistically significant associated. Regarding specific items, the PAVAS4 presented the highest association with item 5 from the HADS-A, and item 1 (all p <.05) from the GAD. On the other hand, TEVAS9 was significantly associated with all items from both questionnaires, presenting the highest correlations with 13, 3, and 11 and from the HADS-A, and items 1, 3, and 2 (all p <.05) from the GAD. As shown in Table 2, PAVAS4 at post-treatment showed greater correlation with TEVAS9, HADS-A and GAD than at baseline.

Depression

As in the case of anxiety, both HADS-D and BDI were significantly associated with PAVAS5(depression) and TEVAS10(depression) (all p <.05; see Table 2), and PAVAS5 and TEVAS10 were also significantly associated. Regarding specific items, the PAVAS5 presented the highest correlations with items 8, 6 and 12 from the HADS-D, and significant correlations with items 1, 10, 2 and 3 (all p <.05) from the BDI-IA-SCA. Regarding TEVAS10, the highest correlations with items from the HADS-D were shown for items 12, 6 and 10, and items 9, 12 and 7 (all p <.001) from the BDI-IA-SCA. As in other cases at post-treatment, PAVAS5 showed higher convergence with TEVAS10 and both questionnaires.

Table 2. Correlations Between Clinical Measures and Validated Questionnaires per Transdiagnostic Component. 

Activation
PAVAS1 TEVAS1 TEVAS3 TEVAS4 EROS
PAVAS1 1 .249* .059 .178 .250*
TEVAS1 .487** 1 .024 .626** .380**
TEVAS3 -.284* -.408** 1 -.090 -.137
TEVAS4 .394** .641** -.310** 1 .254*
EROS .412** .598** -.169 .559** 1
Experiential avoidance
PAVAS3 TEVAS2 TEVAS5 TEVAS6 AAQ
PAVAS3 1 .144 .073 .212* .405**
TEVAS2 .405** 1 .396** .502** .346*
TEVAS5 .336* .533** 1 .346** .182
TEVAS6 .481** .841** .581* 1 .305**
AAQ .475** .583* .330* .570** 1
Cognitive fusion
PAVAS2 TEVAS7 TEVAS8 CFQ -
PAVAS2 1 .323** -.171 .309** -
TEVAS7 .465** 1 -.340** .402** -
TEVAS8 -.488** -.795** 1 -.358** -
CFQ .508** .622** -.588** 1 -
Anxiety
PAVAS4 TEVAS9 HADS-A GAD -
PAVAS4 1 .299** .286** .276* -
TEVAS9 .534** 1 .591** .661** -
HADS-A .594** .693** 1 .657** -
GAD .563** .675** .764** 1 -
Depression
PAVAS5 TEVAS10 HADS-D BDI -
PAVAS5 1 .299** .362** .283** -
TEVAS10 .542** 1 .694** .595** -
HADS-D .560** .788** 1 .550** -
BDI .567** .668** .719** 1 -

Note.Figures above the diagonal represent correlations at baseline and figures below the diagonal represent correlations at post-treatment.

PAVAS: Patient Visual Analogue Scale; TEVAS: Therapist Visual Analogue Scale; EROS: Environmental Reward Observation Scale; AAQ: Acceptance and Action Questionnaire; CFQ: Cognitive Fusion Questionnaire; HADS-A: Hospital Anxiety and Depression Scale-Anxiety; GAD: Generalized Anxiety Disorder scale; HADS-D: Hospital Anxiety and Depression Scale-Depression; BDI: Beck Depression Inventory

*p <.05

**p <.001

Table 3 shows items' discrimination indices of each related PAVAS/TEVAS. Those items presenting significant correlations with each PAVAS/TEVAS showed one of the highest discrimination values, hence further supporting the validity of the proposed PAVAS/TEVAS for assessing each process. All PAVAS/TEVAS significantly changed in the therapeutic direction after treatment (all p <.001), consistently with changes reported in questionnaires (Fernández-Rodríguez et al., 2022a).

Table 3. Questionnaires' Items Discrimination Indices. 

Items ID
Environmental Reward Observation Scale
A lot of activities… .520
Lately I have found that… .418
In general, I am very satisfied… .509
It is easy for me to find… .440
Other people seem to have… .458
Activities that used... .308
I wish that I could find more hobbies… .458
I am satisfied with my accomplishments .441
My life is boring .411
The activities I engage in usually… .184
Acceptance and Action Questionnaire
1. My paintful experiences… .728
2. I'm afraid of my feelings .618
3. I'm worry about not being able… .720
4. My painful memories prevent me from… .699
5. Emotions cause…. .774
6. It seems like most people… .646
7. Worries get in… .659
Cognitive Fusion Questionnaire
1. My thoughts cause… .779
2. I get so caught up in my thoughts… .661
3. I over-analyse situations to the point… .585
4. I struggle with my thoughts .597
5. I get upset with… .658
6. I tend to get very entangled… .746
7. Its such a struggle to let go… .688
Generalized Anxiety Disorder scale
1. Feeling nervous, anxious or on edge .675
2. Not being able to stop or control worrying .664
3. Worrying too much about different things .700
4. Trouble relaxing .628
5. Being so restless… .609
6. Becoming easily… .400
7. Feeling afraid as… .365
Hospital Anxiety and Depression Scale-Anxiety
1. I feel tense… .509
3. I get sort of frightened… .302
5. Worrying thoughts… .422
7. I can sit at ease… .420
9. I get sort of frightened… .414
11. I feel restless… .422
13. I get sudden… .477
Beck Depression Inventory
1. Sadness .511
2. Pessimism .555
3. Past failure .630
4. Loss pleasure .367
5. Guilt feelings .614
6. Punishment feel .387
7. Self-dislike .537
8. Self-critical .589
9. Suicidal .402
10. Crying .405
11. Irritability .191
12. Loss interest .434
13. Indecisive .484
Hospital Anxiety and Depression Scale-Depression
2. I still enjoy… .510
4. I can laugh… .581
6. I feel cheerful .562
8. I feel as if… .475
10. I have lost interest… .478
12. I look forward…. .661
14. I can enjoy… .567

Note.ID: Discrimination index; Discrimination indices of items significant correlated with both EVA/TERA shown in bold

Discussion

In clinical studies, the scientific and psychometric guarantees of the psychological measurement instruments employed justify adopting, as criteria of therapeutic results, the statistical significance of change and effect size. However, this supposition would only allow us to attribute the results obtained to the treatment if the variables measured are those which are responsible for the therapeutic change and not simply measures of effects which could potentially be attributed to the treatment. A greater insight into the correspondence between the different sources (therapist and patient), procedures and moments of assessment during the therapeutic process would facilitate the calibration of the specificity of the measures and the reliability of the instruments. This secondary paper finds correspondence between the measures of the therapist and those of the patient. This occurs both regarding the measures of the psychological processes on which the therapies focus (and which are proposed as therapeutic ingredients) and to the measures of anxiety and depression which are conventionally taken as effect and criterion of clinical change.

Significant correlation is observed between all the measures of anxiety, regardless of the source of information, moment and measures procedure. The same is true for the measures of depression. The correspondence between the data obtained through standardized measures and the assessment of anxiety and depression carried out by the therapist is taken for granted. Some studies even consider the possibility of the two measures being interchangeable (Corruble et al., 1999; Guo et al., 2015; Hershenberg et al., 2020, Zimmerman et al., 2018). However, the question is whether the therapist's assessment of anxiety and depression using VAS and that of the patient can also be considered interchangeable. The same was the case with the measures of depression. It was, however, the relationship between the items of the standardized anxiety and depression measures and the observations made through a VAS that highlighted those symptoms in which there existed the greatest concordance between the two evaluators. In the case of anxiety, when informing through a VAS, patient and therapist appear to coincide in references to trouble relaxing, feeling nervous or on edge, sudden feelings of panic and not being able to stop or control worrying. In the case of depression, both appear to refer to the presence or absence of sadness, pessimism, past failure, crying or joy and optimism. However, only the therapist, when employing a VAS, appears to take into consideration all the conditions included in the standardized measures. Consequently, the information provided by the patient through the VAS does not appear to be sufficient to be used as a diagnostic criterion of anxiety/depression. However, since patient and therapist do show a significant coincidence in their assessment of manifestations/symptoms which are specific to and define both disorders, these scales can be considered useful as criteria of clinical change. These findings are of great importance given the therapeutic implications of these measurement procedure.

Regarding Activation, the pretreatment measures showing the highest correlations are those offered by the therapist regarding the level of the patient's daily participation in relevant activities ENT#091;TEVAS1(occupation)ENT#093; and the frequency with which friends and family promote antidepressive behaviors ENT#091;(TEVAS4(healthy behaviors)ENT#093;. All the measures of A reported by the patient relate to each other and to the TEVAS1(occupation). An evaluation of the EROS items' discrimination indices and the correlations between these and the PAVAS1(A) and the TEVAS1(occupation) and 4 suggests that, when patient and therapist assess A using a VAS, what they principally pay attention to is satisfaction with how time has been occupied and how rewarding those occupations have been. In other words, both coincide in focusing on two of the principal conditions which define Activation (Manos et al, 2010), although the therapist, predictably given his/her expertise in the area, would pay attention to all the conditions/situations described in the EROS. The pretreatment data appear to support the suitability of self-report measures using VAS in the assessment of A.

At post-treatment, the measures of A show even greater significant correlations with each other, they continue to group together around a single dimension and do so with excellent consistency. This result can be attributed to the therapeutic process to which the group was subjected (Fernández-Rodríguez, 2022a). It is foreseeable that, during an intervention, the patient learns to discriminate the conditions focused on (Flückiger et al., 2018; Gelso et al., 2018; Meidlinger & Hope, 2017; Norcross & Lambert, 2018). In particular, the participants in this study who underwent a therapy of BA or ACT had the opportunity to learn to discriminate their Activation patterns. Both therapies focus on increasing this condition, although they each do so in a different way (Kanter et al., 2006). The results of the TRANSACTIVA study showed a statistically significant improvement of all the therapeutic groups at the end of the treatment. Furthermore, the results showed that the increase in relevant activities and in the degree of day-to-day rewards was a determining condition of the therapeutic benefit (Fernández-Rodríguez et al., 2022a). Activation as a process associated with therapeutic benefit has been widely reported in different populations (Fernández-Rodríguez et al., 2018; Jacobson et al., 2001; O'Mahen et al., 2017, Santos et al., 2017, 2019). This fact explains both the increase in the correlations in the post-treatment between all the measures of Activation.

However, what interests us here about this correspondence between measures is that it allows us to affirm that, when patients inform about their day-to-day activity using the PAVAS1(A), what is provided is reliable information regarding their satisfaction with those activities and with their rewards. Consequently, this single-item measure could be considered another additional reliable measure in the evaluation of the Activation response pattern (Manos et al, 2010). This procedure, despite being extremely useful, could by no means replace the functional analysis of behavior in the design and control of the therapeutic process. Indeed, we believe that functional analysis (used in the TRANSACTIVA study) was key in the discrimination of the A patterns. This would explain the fact that, in the post-treatment, there was a statistically significant relationship between the patient's measure and the expert criterion of the therapist. Consequently, the PAVAS1(A) would also be a reliable measure of clinical change.

Regarding to EA, a greater relationship between pretreatment measures can also be observed between all those carried out by the therapist. That is, between the therapist's assessment of the frequency with which the patient avoids activities (TEVAS2) and/or thoughts/emotions (TEVAS5) as a strategy to control distress, the effects of that thought control in the maintaining of activities (TEVAS6), and also the total score of the AAQ-II, as would be expected given the therapist's expertise. There also exists significant correlation between all the EA measures informed by the patient, although the two patient measures only correlate significantly with the TEVAS6(control/avoid worries). In any case, the discrimination indices of these four measures ENT#091;PAVAS3(EA), TEVAS2(avoid activities), TEVAS6(control/avoid worries) and AAQ-IIENT#093; allow us to affirm that they all reliably measure the same condition. That condition is taken to be EA (Hayes et al, 1996). Indeed, the relationships between the responses to the items of the AAQ-II and all those provided through the VAS, would indicate that, when informing through a VAS, both the patient and the therapist are principally assessing how worries, memories and painful emotions prevent the person from leading the life that they would like to lead (AAQ-II, items 1,2, 4,6). This correspondence supports the suitability of VAS as complementary measures of EA.

All posttreatment measures of EA, regardless of the source of information, are significantly related to each other and in a more discriminating way around one single condition his result, as in the case of Activation, can be seen as an effect of the intervention which the participants underwent, and which led to greater discrimination and change regarding this behavioral pattern and clinical improvement in the posttreatment.

Regarding CF and following the same line of results and discussion, it is important to note that, at pretreatment, there was once again extremely significant correlation between all the therapist's measures and also between these and the standardized CF measure. The same occurs between all the patient's measures. The frequency with which patients inform of worries/thoughts which interfere with things that they wanted to do ENT#091;PAVAS2(CF)ENT#093;, correlate significantly with the observations of the therapist regarding patient rumination (TEVAS7), but not with the therapist's assessment of the patient's attention to the present (TEVAS8). Based on the discrimination indices of those items of the CFQ which correlate most closely with the VAS (CFQ items 1, 3, 4, 5 and 7), it would appear that, when assessing CF through a VAS, both patient and therapist are providing reliable information about entrapment and a struggle with thoughts. These correlations between all the observations of the patient and the therapist increase in the post-treatment, even in the case of the TEVAS8(focused on present). Their participation in the TRANSACTIVA study provided this sample with the opportunity to practice focusing attention on the present and improved their ability to discriminate (and change) patterns of CF. As for the rest of the variables, the data support the value of VAS as a complementary measure of CF and as a results measure since CF has demonstrated its transdiagnostic and therapeutic value, in association with EA in particular (Bardeen & Fergus, 2011; Cookson et al., 2020).

It is of particular interest to highlight how patients, when informing about CF and EA through the PAVAS2(CF) and 3(EA), show excellent discrimination of these behaviors when they interfere with the maintaining of their activities, as can be seen in Table S2. The reliability of the patients' self-report observations regarding their EA and CF responses would appear to be greater when they perceive that these behaviors result in a lesser Activation. This could be attributed to participants' clinical characteristics, all patients with a clinical symptomatology of anxiety and depression. There exists specific research which gives evidence of the positive relationship and interaction between EA and CF and anxiety and depression and points to avoidance as a determining factor in the transit from anxiety to depression (Chawla & Ostafin, 2007; Cheng et al., 2022; Fergus, 2015; Fernández Rodríguez, et al., 2022b; Spinhoven, et al., 2017). Since avoidance provides short-term relief from worrying or stressing situations, it can become a rigid behavioral pattern. In this scenario, the person becomes distanced from self-relevant conditions of life and loses contact with the life contingencies or circumstances in which change could occur, thus being unlikely to resolve the worry, stress or overdemanding situations and, conversely, the distress will probably increase. These situations and their associated responses are generally characterized as anxiety. As the experiential avoidance strategy becomes the best resource the person has at his/her disposal to combat distress, the person will withdraw from his/her life context. As activities/experiences/relationships are reduced, the effects that maintain them will no longer be produced, leading progressively to a vicious circle of reduction of activity and loss of rewards. These situations and their associated responses are generally characterized as depression. To sum up, what is highlighted is not only the relationship between EA/CF and emotional distress, but the interaction between EA, CF and A. When investigating how these three response patterns modulate emotional distress, Fernández-Rodríguez et al. (2022b) found that the interaction EAxCF modulates the intensity of the symptomatology of anxiety but is not significant when trying to explain the symptomatology of depression, whereas (a decrease in) Activation is.

The study presents some limitations. Although there exist numerous references confirming the measures guarantees offered by the instruments used in this study, the evaluation of the transdiagnostic patterns examined is not problem-free (Armento, & Hopko, 2007; Manos et al,, 2010; Ong, et al., 2020), particularly due to the many difficulties involved in evaluating behavioral processes which are, by definition, dynamic and changing. Also, the interpretations of results should be considered exploratory, noting the limited sample size. Nonetheless, the consistency between analyses and with theoretical interpretations supports their adequacy. Finally, although the analyses were performed without considering treatment options due to their similar efficacy, future studies should address this issue by exploring between treatment differences in self-reported clinical evolution. Nevertheless, we suggest that the inclusion of new measures like the VAS used in this study could make an economic and simple contribution towards improving the reliability of response pattern measure, the change in which, to a large extent, explains the efficacy of a therapy.

In conclusion, one-item VAS is suitable to identify specific patterns of anxiety, depression, CF, EA and A. These measures are simple to apply during the whole therapeutic process and could consequently be of enormous use as complementary results criteria in psychological treatments.

Acknowledgements

Ministry of Education of the Spanish Government (Ref. MECD-18-FPU17/01181), and University of Oviedo, Spain (Ref. PAPI-21-GR-2015-0005).

References

Armento, M. E., & Hopko, D. R. (2007). The Environmental Reward Observation Scale (EROS): Development, validity, and reliability. Behavior Therapy, 38 (2), 107-119. https://doi.org/10.1016/j.beth.2006.05.003Links ]

Bandelow, B., Sagebiel, A., Belz, M., Görlich, Y., Michaelis, S., & Wedekind, D. (2018). Enduring effects of psychological treatments for anxiety disorders: meta-analysis of follow-up studies. The British Journal of Psychiatry, 212 (6), 333-338. https://doi.org/10.1192/bjp.2018.49Links ]

Bardeen, J. R., & Fergus, T. A. (2011). The interactive effect of cognitive fusion and experiential avoidance on anxiety, depression, stress and posttraumatic stress symptoms. Journal of Contextual Behavioral Science, 5(1), 1-6. https://doi.org/10.1016/j.jcbs.2016.02.002Links ]

Barney, J. L., Lillis, J., Haynos, A. F., Forman, E., & Juarascio, A. S. (2019). Assessing the valuing process in Acceptance and Commitment Therapy: Experts' review of the current status and recommendations for future measure development. Journal of Contextual Behavioral Science, 12, 225-233. https://doi.org/10.1016/j.jcbs.2018.08.002Links ]

Barraca, J., & Pérez-Álvarez, M. (2010). Adaptación española del Environmental Reward Observation Scale (EROS) ENT#091;Spanish adaptation of the Environmental Reward Observation Scale (EROS)ENT#093;. Ansiedad y Estrés, 16 (1), 95-107. [ Links ]

Bauer-Staeb, C., Kounali, D. Z., Welton, N. J., Griffith, E., Wiles, N. J., Lewis, G., Faraway, J. J., & Button, K. S. (2021). Effective dose 50 method as the minimal clinically important difference: Evidence from depression trials. Journal of Clinical Epidemiology, 137, 200-208. https://doi.org/10.1016/j.jclinepi.2021.04.002Links ]

Beck, A. T., & Steer, R. A. (1993). Beck Depression Inventory manual. The Psychological Corporation. [ Links ]

Bond, F. W., Hayes, S. C., Baer, R. A., Carpenter, K. M., Guenole, N., Orcutt, H. K., Waltz, T., & Zettle, R. D. (2011). Preliminary psychometric properties of the Acceptance and Action Questionnaire-II: A revised measure of psychological inflexibility and experiential avoidance. Behavior Therapy, 42(4), 676-688. https://doi.org/10.1016/j.beth.2011.03.007Links ]

Bowling, A., Rowe, G., Lambert, N., Waddington, M., Mahtani, K. R., Kenten, C., Howe, A., & Francis, S. A. (2012). The measurement of patients' expectations for health care: A review and psychometric testing of a measure of patients' expectations. Health Technology Assessment, 16 (30). https://doi.org/10.3310/hta16300Links ]

Chawla, N., & Ostafin, B. (2007). Experiential avoidance as a functional dimensional approach to psychopathology: An empirical review. Journal of Clinical Psychology, 63 (9), 871-890. https://doi.org/10.1002/jclp.20400Links ]

Cheng, Q., Shi, C., Yan, C., Ren, Z., Chan, S. H. W., Xiong, S., Zhang, T., & Zheng, H. (2022). Sequential multiple mediation of cognitive fusion and experiential avoidance in the relationship between rumination and social anxiety among Chinese adolescents. Anxiety, Stress, & Coping, 35 (3), 354-364. https://doi.org/10.1080/10615806.2021.1955864Links ]

Cherry, K. M., Vander Hoeven, E., Patterson, T. S., & Lumley, M. N. (2021). Defining and measuring “psychological flexibility”: A narrative scoping review of diverse flexibility and rigidity constructs and perspectives. Clinical Psychology Review, 84, Article 101973. https://doi.org/10.1016/j.cpr.2021.101973Links ]

Cookson, C., Luzon, O., Newland, J., & Kingston, J. (2020). Examining the role of cognitive fusion and experiential avoidance in predicting anxiety and depression. Psychology and Psychotherapy: Theory, Research and Practice, 93 (3), 456-473. https://doi.org/10.1111/papt.12233Links ]

Corruble, E., Legrand, J. M., Zvenigorowski, H., Duret, C., & Guelfi, J. D. (1999). Concordance between self-report and clinician's assessment of depression. Journal of Psychiatric Research, 33 (5), 457-465. https://doi.org/10.1016/s0022-3956(99)00011-4Links ]

Coto-Lesmes, R., Fernández-Rodríguez, C., & González-Fernández, S. (2020a). Acceptance and Commitment Therapy in group format for anxiety and depression. A systematic review. Journal of Affective Disorders, 263, 107-120. https://doi.org/10.1016/j.jad.2019.11.154Links ]

Coto-Lesmes, R., Fernández-Rodríguez, C., & González-Fernández, S. (2020b). Activación Conductual en formato grupal para ansiedad y depresión. Una revisión sistemática ENT#091;Behavioral Activation in group format for anxiety and depression. A systematic reviewENT#093;. Terapia Psicológica, 38 (1), 63-84. https://doi.org/10.4067/S0718-48082020000100063Links ]

Cuijpers, P., Li, J., Hofmann, S. G., & Andersson, G. (2010). Self-reported versus clinician-rated symptoms of depression as outcome measures in psychotherapy research on depression: A meta-analysis. Clinical Psychology Review, 30 (6), 768-778. https://doi.org/10.1016/j.cpr.2010.06.001Links ]

Fergus, T. A. (2015). I really believe I suffer from a health problem: Examining an association between cognitive fusion and healthy anxiety. Journal of Clinical Psychology, 71 (9), 920-934. https://doi.org/10.1002/jclp.22194Links ]

Fernández-Rodríguez, C., Paz-Caballero, D., González-Fernández, S., & Pérez-Álvarez, M. (2018). Activation vs. experiential avoidance as a transdiagnostic condition of emotional distress: An empirical study. Frontiers in Psychology, 9, Article 1618. https://doi.org/10.3389/fpsyg.2018.01618Links ]

Fernández Rodríguez, C., Coto Lesmes, R., Martínez Loredo, V., & Cuesta Izquierdo, M. (2022b). Psychological inflexibility, anxiety and depression: The moderating role of cognitive fusion, experiential avoidance and activation. Psicothema. 34 (2), 240-248. https://doi.org/10.7334/psicothema2021.344Links ]

Fernández-Rodríguez, C., Coto-Lesmes, R., Martínez-Loredo, V., González-Fernández, S., & Cuesta, M. (2022a). Is activation the active ingredient of transdiagnostic therapies? A randomized clinical trial of behavioral activation, acceptance and commitment therapy, and transdiagnostic cognitive-behavioral therapy for emotional disorders. Behavior Modification, 47 (1), 3-45. https://doi.org/10.1177/01454455221083309. [ Links ]

Flückiger, C., Del Re, A. C., Wampold, B. E., & Horvath, A. O. (2018). The alliance in adult psychotherapy: A meta-analytic synthesis. Psychotherapy, 55 (4), 316-340. https://doi.org/10.1037/pst0000172Links ]

Franklin, C. L., & Raines, A. M. (2019). The overlap between OCD and PTSD: Examining self-reported symptom differentiation. Psychiatry Research, 280, Article 112508. https://doi.org/10.1016/j.psychres.2019.112508Links ]

García-Campayo, J., Zamorano, E., Ruiz, M. A., Pardo, A., Pérez-Páramo, M., López-Gómez, V., Freire, O., & Rejas, J. (2010). Cultural adaptation into Spanish of the Generalized Anxiety Disorder-7 (GAD-7) Scale as a screening tool. Health and Quality of Life Outcomes, 8(1), 1-11. https://doi.org/10.1186/1477-7525-8-8Links ]

Gelso, C. J., Kivlighan Jr, D. M., & Markin, R. D. (2018). The real relationship and its role in psychotherapy outcome: A meta-analysis. Psychotherapy, 55 (4), 434-444 https://doi.org/10.1037/pst0000183Links ]

Gillanders, D. T., Bolderston, H., Bond, F. W., Dempster, M., Flaxman, P. E., Campbell, L., Kerr, S., Tansey, L., Noel, P., Ferenbach, C., Masley, S., Roach, L., Lloyd, J., May, L., Clarke, S., & Remington, B. (2014). The development and initial validation of the Cognitive Fusion Questionnaire. Behavior Therapy , 45 (1), 83-101. https://doi.org/10.1016/j.beth.2013.09.001Links ]

Gloster, A. T., Walder, N., Levin, M. E., Twohig, M. P., & Karekla, M. (2020). The empirical status of acceptance and commitment therapy: A review of meta-analyses. Journal of Contextual Behavioral Science, 18, 181-192. https://doi.org/10.1016/j.jcbs.2020.09.009Links ]

González-Fernández, S., & Fernández-Rodríguez, C. (2019). Acceptance and commitment therapy in cancer: Review of applications and findings. Behavioral Medicine, 45 (3), 255-269. https://doi.org/10.1080/08964289.2018.1452713Links ]

González Fernández, S., Fernández Rodríguez, C., Padierna Sánchez, C., Besteiro González, J. L., & Pérez Álvarez, M. (2019). Behavioral activation in cancer: Review of treatments and evidences. Revista Argentina de Clínica Psicológica, 28 (2), 140-153. https://doi.org/10.24205/03276716.2018.1087Links ]

Guo, T., Xiang, Y. T., Xiao, L. E., Hu, C. Q., Chiu, H. F., Ungvari, G. S., Correll, C. U., Lai, K. Y. C., Feng, L., geng, Y., Feng, Y., & Wang, G. (2015). Measurement-based care versus standard care for major depression: A randomized controlled trial with blind raters. American Journal of Psychiatry, 172 (10), 1004-1013. https://doi.org/10.1176/appi.ajp.2015.14050652Links ]

Hayes, S. C., Strosahl, K. D., & Wilson, K. G. (2011). Acceptance and Commitment Therapy: The process and practice of mindful change. Guilford Press. [ Links ]

Hayes, S. C., Wilson, K. G., Gifford, E. V., Follette, V. M., & Strosahl, K. (1996). Experimental avoidance and behavioral disorders: A functional dimensional approach to diagnosis and treatment. Journal of Consulting and Clinical Psychology, 64 (6), 1152-1168. https://doi.org/10.1037/0022-006X.64.6.1152Links ]

Hershenberg, R., McDonald, W. M., Crowell, A., Riva-Posse, P., Craighead, W. E., Mayberg, H. S., & Dunlop, B. W. (2020). Concordance between clinician-rated and patient reported outcome measures of depressive symptoms in treatment resistant depression. Journal of Affective Disorders, 266, 22-29. https://doi.org/10.1016/j.jad.2020.01.108Links ]

Hobbs, C., Lewis, G., Dowrick, C., Kounali, D., Peters, T. J., & Lewis, G. (2021). Comparison between self-administered depression questionnaires and patients' own views of changes in their mood: A prospective cohort study in primary care. Psychological Medicine, 51 (5), 853-860. https://doi.org/10.1017/S0033291719003878Links ]

Hopko, D. R., Bourland, S. L., Stanley, M. A., Beck, J. G., Novy, D. M., Averill, P. M., & Swann, A. C. (2000). Generalized anxiety disorder in older adults: Examining the relation between clinician severity ratings and patient self-report measures. Depression and Anxiety, 12 (4), 217-225. [ Links ]

Jacobson, N. S., Martell, C. R., & Dimidjian, S. (2001). Behavioral activation treatment for depression: Returning to contextual roots. Clinical Psychology: Science and Practice, 8(3), 255-270. https://doi.org/10.1093/clipsy.8.3.255Links ]

Kanter, J. W., Baruch, D. E., & Gaynor, S. T. (2006). Acceptance and commitment therapy and behavioral activation for the treatment of depression: Description and comparison. The Behavior Analyst, 29 (2), 161-185. https://doi.org/10.1007/BF03392129Links ]

Kendrick, T., El-Gohary, M., Stuart, B., Gilbody, S., Churchill, R., Aiken, L., Bhattacharya, A., Gimson, A., Brütt, A. L., de Jong, K., & Moore, M. (2016). Routine use of patient reported outcome measures (PROMs) for improving treatment of common mental health disorders in adults. Cochrane Database of Systematic Reviews, (7), Article CD011119. https://doi.org/10.1002/14651858.CD011119.pub2. [ Links ]

Malpass, A., Dowrick, C., Gilbody, S., Robinson, J., Wiles, N., Duffy, L., & Lewis, G. (2016). Usefulness of PHQ-9 in primary care to determine meaningful symptoms of low mood: A qualitative study. British Journal of General Practice, 66 (643), e78-e84. https://doi.org/10.3399/bjgp16X683473Links ]

Manos, R. C., Kanter, J. W., & Busch, A. M. (2010). A critical review of assessment strategies to measure the behavioral activation model of depression. Clinical Psychology Review, 30 (5), 547-561. https://doi.org/10.1016/j.cpr.2010.03.008Links ]

Martell, C. R., Dimidjian, S., & Herman-Dunn, R. (2013). Behavioral activation for depression: A clinician's guide. Guilford Press [ Links ]

Martin, F., & Oliver, T. (2019). Behavioral activation for children and adolescents: A systematic review of progress and promise. European Child & Adolescent Psychiatry, 28 (4), 427-441. https://doi.org/10.1007/s00787-018-1126-zLinks ]

Meidlinger, P. C., & Hope, D. A. (2017). The new transdiagnostic cognitive behavioral treatments: Commentary for clinicians and clinical researchers. Journal of Anxiety Disorders, 46, 101-109. https://doi.org/10.1016/j.janxdis.2016.11.002Links ]

Norcross, J. C., & Lambert, M. J. (2018). Psychotherapy relationships that work III. Psychotherapy, 55 (4), 303-315. https://doi.org/10.1037/pst0000193Links ]

O'Mahen, H. A., Wilkinson, E., Bagnall, K., Richards, D. A., & Swales, A. (2017). Shape of change in internet based behavioral activation treatment for depression. Behaviour Research and Therapy, 95, 107-116. https://doi.org/10.1016/j.brat.2017.05.011Links ]

Ong, C. W., Pierce, B. G., Petersen, J. M., Barney, J. L., Fruge, J. E., Levin, M. E., & Twohig, M. P. (2020). A psychometric comparison of psychological inflexibility measures: Discriminant validity and item performance. Journal of Contextual Behavioral Science, 18, 34-47. https://doi.org/10.1016/j.jcbs.2020.08.007Links ]

Price, D., Edwards, M., Davies, F., Cooper, A., McFadzean, J., Carson-Stevens, A., Cooke, M., Dale, J., Evans, B. A., Harrington, B., Hepburn, J., Siriwardena, A. N., Snooks, H., & Edwards, A. (2022). Patients' experiences of attending emergency departments where primary care services are located: Qualitative findings from patient and clinician interviews from a realist evaluation. BMC Emergency Medicine, 22 (1), 1-12. https://doi.org/10.1186/s12873-021-00562-9Links ]

Quintana, J. M., Padierna, A., Esteban, C., Arostegui, I., Bilbao, A., & Ruiz, I. (2003). Evaluation of the psychometric characteristics of the Spanish version of the Hospital Anxiety and Depression Scale. Acta Psychiatrica Scandinavica, 107 (3), 216-221. https://doi.org/10.1034/j.1600-0447.2003.00062.xLinks ]

Robinson, J., Khan, N., Fusco, L., Malpass, A., Lewis, G., & Dowrick, C. (2017). Why are there discrepancies between depressed patients' Global Rating of Change and scores on the Patient Health Questionnaire depression module? A qualitative study of primary care in England. BMJ open, 7(4), Article e014519. https://doi.org/10.1136/bmjopen-2016-014519Links ]

Rogge, R. D., Daks, J. S., Dubler, B. A., & Saint, K. J. (2019). It's all about the process: Examining the convergent validity, conceptual coverage, unique predictive validity, and clinical utility of ACT process measures. Journal of Contextual Behavioral Science, 14, 90-102. https://doi.org/10.1016/j.jcbs.2019.10.001. [ Links ]

Romero-Moreno, R., Márquez-González, M., Losada, A., Gillanders, D., & Fernández-Fernández, V. (2014). Cognitive fusion in dementia caregiving: Psychometric properties of the Spanish version of the "Cognitive Fusion Questionnaire". Behavioral Psychology/Psicología Conductual, 22 (1), 117-132. [ Links ]

Ruiz, F. J., Langer, A. I., Luciano, C., Cangas, A. J., & Beltrán, I. (2013). Measuring experiential avoidance and psychological inflexibility: The Spanish version of the Acceptance and Action Questionnaire - II. Psicothema, 25 (1), 123-129. https://doi.org/10.7334/psicothema2011.239Links ]

Santos, M. M., Rae, J. R., Nagy, G. A., Manbeck, K. E., Hurtado, G. D., West, P., Santiago-Rivera, A., & Kanter, J. W. (2017). A client-level session-by-session evaluation of behavioral activation's mechanism of action. Journal of Behavior Therapy and Experimental Psychiatry, 54, 93-100. https://doi.org/10.1016/j.jbtep.2016.07.003Links ]

Santos, M. M., Ullman, J., Leonard, R. C., Puspitasari, A. J., Cook, J., & Riemann, B. C. (2019). Behavioral activation as a mechanism of change in residential treatment for mood problems: A growth curve model analysis. Behavior Therapy , 50 (6), 1087-1097. https://doi.org/10.1016/j.beth.2019.05.004Links ]

Sanz, J., & García-Vera, M. P. (2007). Análisis psicométrico de las versiones breves del Inventario para la Depresión de Beck de 1978 (BDI-IA) ENT#091;A psychometric analysis of the short forms of the 1978 version of the Beck Depression Inventory (BDI-IA)ENT#093;. Psicología Conductual, 15 (4), 191-214. [ Links ]

Spinhoven, P., van Hemert, A. M., & Penninx, B. W. (2017). Experiential avoidance and bordering psychological constructs as predictors of the onset, relapse and maintenance of anxiety disorders: One or many? Cognitive Therapy and Research, 41 (6), 867-880. https://doi.org/10.1007/s10608-017-9856-7Links ]

Spitzer, R. L., Kroenke, K., Williams, J. B., & Löwe, B. (2006). A brief measure for assessing generalized anxiety disorder: the GAD-7. Archives of Internal Medicine, 166 (10), 1092-1097. https://doi.org/10.1001/archinte.166.10.1092Links ]

Stockton, D., Kellett, S., Berrios, R., Sirois, F., Wilkinson, N., & Miles, G. (2019). Identifying the underlying mechanisms of change during acceptance and commitment therapy (ACT): A systematic review of contemporary mediation studies. Behavioural and Cognitive Psychotherapy, 47 (3), 332-362. https://doi.org/10.1017/S1352465818000553Links ]

Zimmerman, M., Walsh, E., Friedman, M., Boerescu, D. A., & Attiullah, N. (2018). Are self-report scales as effective as clinician rating scales in measuring treatment response in routine clinical practice? Journal of Affective Disorders, 225, 449-452. https://doi.org/10.1016/j.jad.2017.08.024Links ]

Zigmond, A. S., & Snaith, R. P. (1983). The hospital anxiety and depression scale. Acta Psychiatrica Scandinavica, 67 (6), 361-370. https://doi.org/10.1111/j.1600-0447.1983.tb09716.xLinks ]

Cite as:Fernández-Rodríguez, C., Loredo-Martínez, V., & Coto-Lesmes, R. (2023). Patients' and therapists' reports of psychotherapy outcomes: Similarities and differences. Psicothema, 35 (4), 374-384. https://doi.org/10.7334/psicothema2022.416

Received: October 10, 2022; Accepted: January 25, 2023

Autor y e-mail de correspondencia: Concepción Fernández-Rodríguez, frconcha@uniovi.es

The first two authors contributed equally to this study.

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License