SciELO - Scientific Electronic Library Online

 
vol.39 número1Un estudio piloto de intervención breve basada en mindfulness para gestionar las emociones en pacientes con psoriasisUn estudio clínico aleatorizado en un contexto de sanidad pública: inclusión de técnicas emocionales en una terapia grupal para trastornos de ansiedad índice de autoresíndice de assuntospesquisa de artigos
Home Pagelista alfabética de periódicos  

Serviços Personalizados

Journal

Artigo

Indicadores

Links relacionados

  • Em processo de indexaçãoCitado por Google
  • Não possue artigos similaresSimilares em SciELO
  • Em processo de indexaçãoSimilares em Google

Compartilhar


Anales de Psicología

versão On-line ISSN 1695-2294versão impressa ISSN 0212-9728

Anal. Psicol. vol.39 no.1 Murcia Jan./Abr. 2023  Epub 16-Out-2023

https://dx.doi.org/10.6018/analesps.499371 

Clinical and Health Psychology

What do we know about highly effective therapists? A systematic review

Gladis-Lee Pereira1  *  , Carolina Trujillo-Sánchez1  , Jesús Alonso-Vega2  , Daniel Echevarría-Escalante1  , María-Xesús Froxán-Parga1 

1Universidad Autónoma de Madrid: Biological and Health Psychology Department, Madrid (Spain)

2Universidad Europea de Madrid: Faculty of Biomedical and Health Sciences (Spain)

Abstract

Highly effective therapists are clinicians who systematically achieve excellent therapeutic outcomes. Although these types of therapists can be found among different therapies, the variables that could explain their performance remain uncertain. Therefore, to clarify these variables, analyze their definition, their objective measures, and the extent to which they measure what they claim, a systematic review (SR) was conducted. Publications between 2000 and 2020 -from Scopus, MEDLINE/PubMed, Web of Science, PsycInfo, Google Scholar and ProQuest Research Library databases- were included. After analyzing 2784 empirical works, 31 studies have met the inclusion criteria. The results made it possible to identify, summarize and define almost 50 predictor variables of therapist effect. The need to increase construct validity, to improve empirical designs and to measure therapist-client interaction is discussed.

Keywords: Highly effective therapist; Therapist effect; Systematic review; Effective therapist; Therapeutic experience

Introduction

Therapist’s performance in psychological interventions is a key factor to both research and clinical practice (Beutler et al., 2004; Dinger et al., 2008; Norcross & Lambert, 2011; Ricks, 1974). In fact, from a common factor’s perspective, metanalysis conducted over the years found higher effect sizes for therapist than for therapy, showing up to 21% of effect size in natural clinical settings (Baldwin & Imel, 2013; Crits-Christoph et al., 1991; Johns et al., 2019; Wampold & Imel, 2015). Although there are controversies about the accuracy of common factors studies for these kind of outcome comparisons (e.g., Siev & Chambless, 2007), what studies on the specific common factor therapist effect show is that, regardless the therapeutic model or client’s problematic, there are therapists who are systematically better than others (Johns et al., 2019; Miller et al., 2008).

However, knowing that some therapists have higher performance does not settle the question of what exactly they do. Studying outcome and connecting it with the therapist effect is relevant to assess and detect this type of therapist but is not substantial in terms of improving psychotherapies and explaining which behaviors are connected to the highly effective therapists (Miller et al., 2008; Nissen-Lie et al., 2010; Saxon et al., 2017).

With that in mind, many authors correlate psychological, chronological, and demographic variables with the therapist effect to understand why these therapists are so effective (e.g., Anderson et al., 2009; Barkham et al., 2017; Goldberg et al., 2016b; Saxon et al., 2017). Among the results found, the therapeutic framework from the therapist, for example, is often dismissed as a significative variable (e.g., psychodynamic framework versus behavioral) (Anderson et al., 2009; Chow, 2014; Nissen-Lie et al., 2013). Likewise, the therapeutic experience does not seem to show significative correlation either (Cologon et al., 2017; Delgadillo et al., 2020). For example, Lutz and colleagues (2007) found that experience measured in years did not predict outcome among different health interventions (e.g., medical care) and that this type of measurement (years) was not accurate to operationalize experience. Also, variables such as age, gender, personality features or academic titles was not found significative either. That is, if all these personal variables were not correlated with highly effective therapists, which variables were? Are non-personal variables, such as type of intervention (e.g., psychotherapy versus psychiatric), modality (group versus individual), type of the clinical center (public versus private) or therapy length, relevant to the therapist effect? In sum, the correlations found in this field still unclear and the therapist effect, even being a great topic of interest, does not seem to be fully explained (Speers et al., 2022).

To understand why these questions are inconclusive, some authors point out that the theoretical framework and methodology used in these studies are mainly responsible for their limitations (Barker & McFall, 2014; Berglar et al., 2016; Dinger et al., 2008; Fonagy & Clark, 2015). In order to understand behaviors, not only must the rejection of the null hypothesis be considered, but also the theoretical approach on which it is based and the methodology behind the findings. For example, different operationalizations of outcomes may lead to different results, so it is necessary to comprehensively define what is outcome and what is reliability and validity of the instruments for its measurement (Green et al., 2014; Weinberger, 2014). Likewise, the theoretical approach behind the research could also affect its conclusions (Froxán-Parga et al., 2006; González-Blanch & Carral-Fernández, 2017). Isolating traits without their context can lead to different results and interpretations of the same phenomenon (Zilcha-Mano & Fisher, 2022), just as descriptive labels for predictive variables create tautological reasoning (Núñez de Prado-Gordillo et al., 2020). In short, the conclusions from a methodology such as the one discussed above could be normative (Sellars, 1956), and the findings, although significant, could have little or no practical utility.

Summarizing, there is a lack of information and precision regarding the explanatory variables of the effect between therapists. Although there are authors studying predictors factors of therapist effect, the findings are not organized, and current systematic reviews focus exclusively on measuring statistical indices of effect size. There is no unanimity or consensus in the current findings on the variables underlying highly effective therapist, whether replicable behavioral measures are used, or whether construct validity is adequate. Therefore, the aim of the present work is to systematically identify and bring together the available information on the variables that explain the therapist effect, considering the main methodological issues underlying these explanations.

Method

Study selection criteria

Following the PRISMA protocol (Preferred Reporting Items for Systematic Reviews), the research question for this SR is: ‘what are the variables associated with highly effective therapists in outpatient psychological therapy’ (outpatient interventions being understood as those carried out in both public and private facilities, but never in hospital or inpatient settings). Therefore, the aim is to classify the predictive variables and to identify how they have been operationalized and the type of instruments used. Due to the broad review scope of the research question (rather than a narrow scope), it is important to highlight that our interest is transversal to the specific interventions, i.e., what is sought is precisely to identify characteristics of different types of intervention, so therefore the research question does not necessarily make a specific prediction about a given variable.

Regarding to PICO (participants, interventions, comparisons, and SR outcome measures), the participants belong to private and public non-hospital centers; the interventions are from multiple types (as the therapy could be a predictor variable); the comparisons are made between therapist effects; the results are significant predictor of outcome variables; and the design is exclusively quantitative (the study focuses on outcome measures). The inclusion and exclusion criteria of the articles are presented in Table 1.

Tabla 1. Inclusion and exclusion criteria. 

Identification of studies

The studies were collected from Scopus (Elsevier), MEDLINE/PubMed, Social Sciences Citation Index (Web of Science), PsycInfo, Google Scholar and ProQuest Research Library. The time interval was 2000 to 2020. Guided by previous systematic reviews (Baldwin & Imel, 2013; Johns, 2019), the search criteria were "therapist AND effects," "highly AND effective AND therapist," "supershrink," "therapist AND expert," "therapist AND highly AND effective," and "effect AND of AND therapist." The outcome criteria were "scientific article” AND "peer-reviewed publications". The languages were "English" and "Spanish", and the filter for the participants’ age was "over 18 years of age". The specific data can be found in Figure 1.

Figure 1. PRISMA diagram of study selection process. 

2,784 articles were first identified. Eight articles were added to these after searching the documentation from the previous metanalyses. The first screening was made throughout the titles and abstracts of the filtered documents. This entire process was carried out by the main reviewer, and 52 articles were included for complete reading. In this new phase, two reviewers made decisions regarding the inclusion and exclusion criteria. The main reviewer fully-read the 52 articles included while the second reviewer, by randomized selection, read 40, the minimum number necessary to ensure correct reliability according to Sánchez-Meca and Botella (2010). In order to avoid possible bias when selecting the articles (Heckman, 1990), the additional reviewer was unaware of the research question. Finally, to measure the degree of agreement, a simple kappa statistic was calculated (Higgins & Deeks, 2011). Considering that kappa values between .4 and .59 reflect moderate agreement, .6 and .74, as fair to good agreement, and .75 or more, excellent agreement (Orwin, 1994 in Higgins & Deeks, 2011), the kappa index for the eligibility of the present SR is "excellent" (.9).

Data extraction

The data extraction was performed by two reviewers. After a 10 pilot articles training, an extraction guide and an extraction form were developed. Both, guide and form, can be found in the Open Science Framework (access link https://osf.io/c87zd/?view_only=52ec7f341d00486498c703f9cf08aa49). Table 2 shows their classifications based on the specific categories proposed by Sánchez-Meca & Botella (2010). In order to obtain the kappa index, the eligibility criteria and the extraction of variables from each report were performed separately and in duplicate in 40 articles.

Table 2. Categories and extraction variables coding. 

Note. aSubstantive variables are the ones related to the aim of the review;

bExtrinsic variables refer to characteristics that should not be related to the scientific process a priori but could affect the results (Sánchez-Meca & Botella, 2010).

Results

Extrinsic, treatment, and participant variables

Regarding the extrinsic characteristics (variables that are not related to the main purpose of the study but may have an influence on it according to Sánchez-Meca and Botella (2010), 84% of the therapists, 76% of the clients and 22.5% of the first authors are women. The authors and the goals of each article are listed in Table 3.

Table 3. Included studies and their respective main objectives. 

Note.TE = therapist effect; EFT = effectiveness among therapists

Regarding to the characteristics of the participants, anxiety is the most prevalent behavioral problem among clients (24 studies) and psychodynamic is the most prevalent therapeutic framework (14). In addition, although psychotherapy is the most prevalent treatment (20), interventions to mental health problems were also performed by non-psychologists, such as physical therapists, social workers, or computer devices. The complete characteristics of all participants can be found in Open Science Framework (access link https://osf.io/c87zd/?view_only=52ec7f341d00486498c703f9cf08aa49).

Methodological and substantive variables

90.3% of the articles define outcome as reduction of symptoms, 16.1% as therapeutic alliance, 12.9% as psychological well-being, 6.4% as vital functioning and 3.2% as therapeutic adherence (notice that some articles used more than one definition). The most used outcome instrument is self-report, specifically, the Symptom Checklist-90 (SCL-90; Derogatis & Melisaratos, 1983) (13 articles). Even though the self-report was used in every article included, some of them combined different methodology of data collection (e.g., observation or interview).

Most studies exclusively focused on psychological variables as predictor factors, however, 12 articles (out of 31) also combined them with demographical, structural, and chronological variables, such as age, gender, years of experience, ethnic, treatment length and/or academical titles. From all these studies, only three found significative correlations regarding these variables, specifically, age, years of experience and academic titles (Anderson et al., 2009; Berglar et al., 2016; Hersoug et al., 2009).

Combining all the variables studied, a total of 46 therapist effect predictive variables were compiled of which 41 were significant (Figure 2). Figure 2 also shows which variables were the most replicable and which were significant. Of those authors who operationalized their variables of interest, Table 4 contains a textual compilation of the definitions used for each predictive variable. It should be noted that, due to the characteristics of this SR, the effect size is not estimated at these levels of significance; it is simply highlighted whether or not the results were found to be significant in the study in question.

Figure 2. Predictor variables of the therapist effect by number of publications. 

Table 4. Predictor variables of the therapeutic effect for the included studies. 

Table 4 (Cont.). Predictor variables of the therapeutic effect for the included studies. 

Table 4 (Cont.). Predictor variables of the therapeutic effect for the included studies. 

Note.AAI = Adult Attachment Interview; CD-RISC = The Connnor and Davidson Resilience Scale; CPPS = Comparative Psychotherapy Process Scale; CTS-R = Revised Conflict Tactic Scale; DPCCQ = Development of Psychotherapists' Common Core Questionnaire; ECR = Experiences in Close Relationships Scale; ESQ = Empathy and Sociability Questionarie; FIS = Facilitative Interpersonal Skills; GAS = Global Assesment Scale; HEXACO-H = Honestyhumility, Emotionality, Extraversion, Agreeableness, Conscientiousness and Openness to Experience; HSQ = Humor Style Questionnaire; HSQ = Humor Style Questionnaire; MAAS = Mindfulness Attention Awareness Scale; MITI 2.0 = Motivational Interview Treatment Integrity 2.0; NEO PI-R = Personality Inventory; N.A. = Not applicable; PBI = Parental Bonding Instrument; PIES = The Psychosocial Inventory of Ego Strengths; PSA = Playfulness Scale for Adults; RAPIDpractice = Retrospective Analysis of Psychotherapists’ Involvement in Deliberate Practice; REI = The Rational-Experiential Inventory measures Intuition; RFS = Reflective Functioning Scale; SSI = Social Inventory; THCLVT = Traditional high contact low volume therapists; TRIB-G = Therapy-Related Interpersonal Behaviors; TRIB-I = Therapy-Related Interpersonal Interview; WAI-C/T = Working Alliance Inventory – Client/Therapist;

aCompass Assesment is an instrument that allows to combine patients with similar clinic and demographic characteristics within a same case group of a given therapist in order to assess whether the second patient treated within a same combination shows better results compared to the first.

Discussion

The aim of this study was to systematically identify and organize the currently available information on the variables that explain the therapist effect. Based on the data found, we can draw different conclusions.

First, after a detailed analysis of the variables, the overall conclusion lies upon the 41 predictor variables extracted; although they were found significative to explain therapist effect, we still do not know the exact behaviors of the highly effective therapist and/or how to teach the lowest effective therapists to be better. From our perspective and after analyzing the data, this could be happening due different reasons.

The methodology used was controversial, especially the construct validity. Numerous variables pose an underlying problem: the construct is defined by another construct which is, in turn, defined by another construct that never is fully operationalized (e.g., “work engagement”, which is defined by “therapeutic connection” which is defined by “therapeutic alliance” that is never defined); also, several variables refer to the past of the therapist (e.g., type of attachment, maternal care), which means that they are immutable and therefore, unteachable. In addition, sometimes the variables can be independent and dependent at the same time (e.g., therapeutic alliance as independent and dependent variable). Considering these results, we can conclude that the practical applications of the conclusions of the studies reviewed in this research are very limited, since the variables that have been shown to be relevant are not defined as behaviors that can be trained.

On the other hand, approximately 90% of the variables collected turned out to be different from each other, exemplifying the current problem of hypothesis confirmation and replicability in psychology (Pérez-Álvarez, 2018; Spellman, 2015). Each author has his or her own impermeable theory and seeks to confirm his or her prediction, regardless of whether it is tautological, trivial, practical, or contributes to the fragmentation of psychology. Furthermore, the fact that all studies included in this SR showed, at least, one significant data, points to a possible publication bias effect (Dickersin et al., 1994).

The methodology used also does not allow studying the client's role moment by moment during therapy. The logic of correlation in aggregate studies prevents the identification of the interaction in session (Stiles, 1999). That is, even if the labels were correctly operationalized, correlating the therapist's data without taking into account what the client did before or after his or her performance would imply erratic behavior on his or her part.

About the characteristics of the studies, we have found several interesting aspects to highlight.

On the one hand, most of the leading researchers are identified as males. Although in recent years the gender equity of the first authors’ publications seems to be increasing (González-Sala & Osca-Lluch, 2018), the data found in this SR point in the opposite direction.

Regarding the characteristics of the participants and the sample, it is striking that physical therapists work with a population diagnosed with a mental disorder (and also present systematically high efficacy). This could support that, although variables like therapeutic model were the most replicated among studies (perhaps because of the ease of access and accuracy in measuring age, gender, and years providing therapy), they were precisely the only ones non-significant to the therapist effect. In addition, it is particularly interesting that experience does not correlate with outcome. This makes sense if we consider that time is not necessarily the explanation for being skillful, but rather the behaviors that one does while time is passing (Leon et al, 2005; Santacreu & Hernández, 2019); which brings back the ambiguity in the philosophical assumptions of the investigations. Do they consider the time as an independent variable? Or as the condition that allows the development of a certain type of learning (which undoubtedly should be considered for a study), but should not be the predictor variable?

About the instruments used to measure the variables, all 31 studies used questionnaires and/or scales of symptom reduction. This fact exemplifies the current predominance of self-reports in psychology (Santacreu & García-Leal, 2000). Although self-reports with equal measures of efficacy contribute to homogeneity, generalization of data and inter-therapeutic comparison, taking them as a unanimous measure also assumes a series of repeated limitations (Nissen-Lie et al., 2013).

Finally, it is important to emphasize that the aim of this study is ambitious, so it would be crucial to carry out other SR like the present one to reach more solid conclusions. Among the main limitations, we must highlight the complexity of comparing variables with different measurement parameters (e.g., "years of experience" in some studies is operationalized by the mean and in others, by the number of cases carried by each therapist or range of years by sample grouping). Secondly, not all the information was available. Empirical studies usually devote little space to clarify the construct validity of the variables and procedures carried out to specify the behaviors measured. Finally, it should be noted that the research question of this study is formulated under a broad scope. That is, the variables extracted seek to summarize the evidence in a global manner, focusing the findings on generalizable conclusions. Thus, its main strength is also its weakness, as it makes it difficult to interpret the results, hinders the work of the review team, and to assess the data (Higgins & Deeks, 2011).

In sum, the data found invites us to reflect about the present and future of therapist effect research; now that we organized and identified relevant predictors of therapist effect, what is its practical use? Could we create an "exceptional therapist" protocol and start teaching "regular therapists" how to behave? Does it make sense to continue confirming hypotheses and keep finding more predictor variables under the same methodology? With the data found in this study and from our perspective, the answer to these questions is no. Although nuances are found in the degree of operationalization of the different variables, none is sufficiently clear to be defined in replicable parameters and most importantly, is defined based on the therapeutic interaction (therapist's actions as reactions to the client's actions). All this points, once again, to the methodological obstacles of studying change processes in therapy (Callaghan & Follette, 2020), and that the research design of these studies could not be detecting the behaviors patterns that explain higher outcomes between therapists.

References

*Ali, S., Littlewood, E., McMillan, D., Delgadillo, J., Miranda, A., Croudace, T., & Gilbody, S. (2014). Heterogeneity in patient-reported outcomes following low-intensity mental health interventions: a multilevel analysis. PLoS One, 9(9). https://doi.org/10.1371/journal.pone.0099658 [ Links ]

*Anderson, T., Crowley, M. E. J., Himawan, L., Holmberg, J. K., & Uhlin, B. D. (2016). Therapist facilitative interpersonal skills and training status: A randomized clinical trial on alliance and outcome. Psychotherapy Research, 26(5), 511-529. https://doi.org/10.1080/10503307.2015.1049671 [ Links ]

*Anderson, T., McClintock, A. S., Himawan, L., Song, X., & Patterson, C. L. (2015). A prospective study of therapist facilitative interpersonal skills as a predictor of treatment outcome. Journal of Consulting and Clinical Psychology, 84(1), 57-66. [ Links ]

*Anderson, T., Ogles, B. M., Patterson, C. L., Lambert, M. J., & Vermeersch, D. A. (2009). Therapist effects: Facilitative interpersonal skills as a predictor of therapist success. Journal of Clinical Psychology, 65(7), 755-768. https://doi.org/10.1002/jclp.20583 [ Links ]

*Berglar, J., Crameri, A., von Wyl, A., Koemeda-Lutz, M., Köhler, M., Staczan, P., & Tschuschke, V. (2016). Therapist effects on treatment outcome in psychotherapy: A multilevel modelling analysis. International Journal of Psychotherapy, 20(2), 61-80. https://digitalcollection.zhaw.ch/handle/11475/3307Links ]

*Brown, G. S., Lambert, M. J., Jones, E. R., & Minami, T. (2005). Identifying highly effective therapists in a managed care environment. American Journal of Managed Care, 11, 513-520. [ Links ]

*Chow, D. L., Miller, S. D., Seidel, J. A., Kane, R. T., Thornton, J. A., & Andrews, W. P. (2015). The role of deliberate practice in the development of highly effective psychotherapists. Psychotherapy, 52(3), 337-345. https://doi.org/10.1037/pst0000015 [ Links ]

*Cologon, J., Schweitzer, R. D., King, R., & Nolte, T. (2017). Therapist reflective functioning, therapist attachment style and therapist effectiveness. Administration and Policy in Mental Health and Mental Health Services Research, 44(5), 614-625. https://doi.org/10.1007/s10488-017-0790-5 [ Links ]

*Delgadillo, J., Branson, A., Kellett, S., Myles-Hooton, P., Hardy, G. E., & Shafran, R. (2020). Therapist personality traits as predictors of psychological treatment outcomes. Psychotherapy Research, 1-14. https://doi.org/10.1080/10503307.2020.1731927 [ Links ]

*Firth, N., Barkham, M., Kellett, S., & Saxon, D. (2015). Therapist effects and moderators of effectiveness and efficiency in psychological wellbeing practitioners: A multilevel modelling analysis. Behaviour Research and Therapy, 69, 54-62. https://doi.org/10.1016/j.brat.2015.04.001 [ Links ]

*García, F., & Fernández-Álvarez, H. (2007). Investigación empírica sobre el Estilo Personal del Terapeuta: una actualización (Empirical research on therapist’s personal style: an update). Revista Argentina de Clínica Psicológica, XVI(2), 121-128. https://www.redalyc.org/articulo.oa?id=2819/281921793002Links ]

*Goldberg, S. B., Hoyt, W. T., Nissen-Lie, H. A., Nielsen, S. L., & Wampold, B. E. (2016). Unpacking the therapist effect: Impact of treatment length differs for high-and low-performing therapists. Psychotherapy Research, 28(4), 532-544. https://doi.org/10.1080/10503307.2016.1216625 [ Links ]

*Goldberg, S. B., Rousmaniere, T., Miller, S. D., Whipple, J., Nielsen, S. L., Hoyt, W. T., & Wampold, B. E. (2016). Do psychotherapists improve with time and experience? A longitudinal analysis of outcomes in a clinical setting. Journal of counseling psychology, 63(1), 1-11. https://doi.org/10.1037/cou0000131 [ Links ]

*Green, H., Barkham, M., Kellett, S., & Saxon, D. (2014). Therapist effects and IAPT Psychological Wellbeing Practitioners (PWPs): A multilevel modelling and mixed methods analysis. Behaviour Research and Therapy, 63, 43-54. https://doi.org/10.1016/j.brat.2014.08.009 [ Links ]

*Hayes, J. A., McAleavey, A. A., Castonguay, L. G., & Locke, B. D. (2016). Psychotherapists’ outcomes with White and racial/ethnic minority clients: First, the good news. Journal of Counseling Psychology, 63(3), 261. https://doi.org/10.1037/cou0000098 [ Links ]

*Hersoug, A.G., Høglend, P., Havik, O., von der Lippe, A. & Monsen, J. (2009). Therapist characteristics influencing the quality of alliance in long-term psychotherapy. Clinical Psychoogy Psychotherapy, 16, 100-110. https://doi.org/10.1002/cpp.605 [ Links ]

*Imel, Z. E., Baldwin, S. A., Baer, J. S., Hartzler, B., Dunn, C., Rosengren, D. B., & Atkins, D. C. (2014). Evaluating therapist adherence in motivational interviewing by comparing performance with standardized and real patients. Journal of consulting and clinical psychology, 82(3), 472. https://doi.org/10.1037/a0036158 [ Links ]

*Leon, S. C., Martinovich, Z., Lutz, W., & Lyons, J. S. (2005). The effect of therapist experience on psychotherapy outcomes. Clinical Psychology & Psychotherapy: An International Journal of Theory & Practice, 12(6), 417-426. https://doi.org/10.1002/cpp.473 [ Links ]

*Lutz, W., Leon, S. C., Martinovich, Z., Lyons, J. S., & Stiles, W. B. (2007). Therapist effects in outpatient psychotherapy: A three-level growth curve approach. Journal of Counseling Psychology, 54(1), 32. https://doi.org/10.1037/0022-0167.54.1.32 [ Links ]

*Lutz, W., Rubel, J., Schiefele, A.K., Zimmermann, D., Böhnke J. R. & Wittmann, W. W. (2015) Feedback and therapist effects in the context of treatment outcome and treatment length. Psychotherapy Research, 25(6), 647-660. https://doi.org/10.1080/10503307.2015.1053553 [ Links ]

*Nissen-Lie, H. A., Havik, O. E., Høglend, P. A., Monsen, J. T., & Rønnestad, M. H. (2013). The contribution of the quality of therapists’ personal lives to the development of the working alliance. Journal of counseling psychology, 60(4), 483-495. https://doi.org/10.1037/a0033643 [ Links ]

*Nissen-Lie, H. A., Monsen, J. T., & Rønnestad, M. H. (2010). Therapist predictors of early patient-rated working alliance: A multilevel approach. Psychotherapy research, 20(6), 627-646. https://doi.org/10.1080/10503307.2010.497633 [ Links ]

*Nissen‐Lie, H. A., Rønnestad, M. H., Høglend, P. A., Havik, O. E., Solbakken, O. A., Stiles, T. C., & Monsen, J. T. (2017). Love yourself as a person, doubt yourself as a therapist?. Clinical psychology & psychotherapy, 24(1), 48-60. https://doi.org/10.1002/cpp.1977 [ Links ]

*Okiishi, J. C., Lambert, M. J., Eggett, D., Nielsen, L., Dayton, D. D., & Vermeersch, D. A. (2006). An analysis of therapist treatment effects: Toward providing feedback to individual therapists on their clients' psychotherapy outcome. Journal of clinical psychology, 62(9), 1157-1172. https://doi.org/10.1002/jclp.20272 [ Links ]

*Okiishi, J., Lambert, M. J., Nielsen, S. L., & Ogles, B. M. (2003). Waiting for supershrink: An empirical analysis of therapist effects. Clinical Psychology & Psychotherapy: An International Journal of Theory & Practice, 10(6), 361-373. https://doi.org/10.1002/cpp.383 [ Links ]

*Owen, J., Drinane, J. M., Kivlighan III, M., Miller, S., Kopta, M., & Imel, Z. (2019). Are high-performing therapists both effective and consistent? A test of therapist expertise. Journal of consulting and clinical psychology, 87(12), 1149-1156. https://doi.org/10.1037/ccp0000437 [ Links ]

*Owen, J. & Hilsenroth, M. J. (2014). Treatment adherence: the importance of therapist flexibility in relation to therapy outcomes. Journal of counseling psychology, 61(2), 280. https://doi.org/10.1037/a0035753 [ Links ]

*Pereira, J. A., Barkham, M., Kellett, S., & Saxon, D. (2016). The role of practitioner resilience and mindfulness in effective practice: A practice-based feasibility study. Administration and Policy in Mental Health and Mental Health Services Research, 44(5), 691-704. https://doi.org/10.1007/s10488-016-0747-0 [ Links ]

*Saxon, D., & Barkham, M. (2012). Patterns of therapist variability: Therapist effects and the contribution of patient severity and risk. Journal of Consulting and Clinical Psychology, 80(4), 535. https://doi.org/10.1037/a0028898 [ Links ]

*Schöttke, H., Flückiger, C., Goldberg, S., Eversmann, J. & Lange, J. (2017) Predicting psychotherapy outcome based on therapist interpersonal skills: A five-year longitudinal study of a therapist assessment protocol. Psychotherapy Research, 27(6), 642-652. https://doi.org/10.1080/10503307.2015.1125546 [ Links ]

*Yonatan-Leus, R., Tishby, O., Shefler, G. & Wiseman, H. (2017). Therapists’ honesty, humor styles, playfulness, and creativity as outcome predictors: A retrospective study of the therapist effect. Psychotherapy Research, 28(5), 793-802. https://doi.org/10.1080/10503307.2017.1292067 [ Links ]

Baldwin, S. A., & Imel, Z. E. (2013). Therapist effects: Findings and methods. Bergin and Garfield’s handbook of psychotherapy and behavior change, 6, 258-297. [ Links ]

Barker, T. & McFall, R. (2014). The promise of science-based training and application in psychological clinical science. Psychotherapy (Chic), 51, 482-486. [ Links ]

Barkham, M., Lutz, W., Lambert, M. J., & Saxon, D. (2017). Therapist effects, effective therapists, and the law of variability. In L. G. Castonguay & C. E. Hill (Eds.), How and why are some therapists better than others?: Understanding therapist effects (p. 13-36). American Psychological Association. https://doi.org/10.1037/0000034-002 [ Links ]

Beutler, L. E., Malik, M., Alimohamed, S., Harwood, T. M., Talebi, H., Noble, S., et al. (2004). Therapist variables. In M. J. Lambert (Ed.), Bergin & Garfield’s handbook of psychotherapy and behavior change (5th ed., pp. 227-306). Wiley https://psycnet.apa.org/doi/10.1093/clipsy.bph076 [ Links ]

Callaghan, G. M., & Follette, W. C. (2020). Interpersonal Behavior Therapy (IBT), functional assessment, and the value of principle-driven behavioral case conceptualizations. The Psychological Record, 70(4), 625-635. https://doi.org/10.1007/s40732-020-00395-1 [ Links ]

Chow, D. (2014). The study of supershrinks: Development and deliberate practices of highly effective psychotherapists (Doctoral dissertation, Curtin University). [ Links ]

Crits-Christoph, P., Baranackie, K., Kurcias, J., Beck, A., Carroll, K., Perry, K., Luborsky, L., Woody, A. M., Thompson, L., Gallagher, D., 6 Zitrin, C. (1991). Meta‐analysis of therapist effects in psychotherapy outcome studies. Psychotherapy research, 1(2), 81-91. https://doi.org/10.1080/10503309112331335511 [ Links ]

Derogatis, L. R. & Melisaratos, N. (1983). The brief symptom inventory: an introductory report. Psychological medicine, 13(3), 595-605. https://doi.org/10.1017/S0033291700048017 [ Links ]

Dickersin, K., Scherer, R., & Lefebvre, C. (1994). Systematic reviews: identifying relevant studies for systematic reviews. Bmj, 309(6964), 1286-1291. https://doi.org/10.1136/bmj.309.6964.1286 [ Links ]

Dinger, U., Strack, M., Leichsenring, F., Wilmers, F., & Schauenburg, H. (2008). Therapist effects on outcome and alliance in inpatient psychotherapy. Journal of clinical psychology, 64(3), 344-354. https://doi.org/10.1037/a0035753 [ Links ]

Fonagy, P., & Clark, D. M. (2015). Update on the improving access to psychological therapies programme in England: commentary on… children and young People's improving access to psychological therapies. BJPsych bulletin, 39(5), 248-251. https://doi.org/10.1192/pb.bp.115.052282 [ Links ]

Froxán-Parga, M. X., Ruiz, E., Fidalgo-Montaño, R. & Calero-Elvira, A. (2006). ¿Por qué la gente cambia en terapia? Un estudio preliminar. (Why do people change in therapy? A preliminary study). Psicothema, 18(4), 797-803. [ Links ]

González-Blanch, C. & Carral-Fernández, L. (2017). ¡Enjaulad a Dodo, por favor! El cuento de que todas las psicoterapias son igual de eficaces. (Cage Dodo, please! The tale that all psychotherapies are equally effective). Papeles del Psicólogo, 38(2), 94-106 https://www.redalyc.org/articulo.oa?id=77851775003Links ]

González-Sala, F., & Osca-Lluch, J. (2018). Desigualdad de género en órganos directivos y producción científica de las revistas iberoamericanas de psicología de mayor visibilidad internacional. (Gender inequality in directive bodies and scientific production on the Ibero-American psychology journals with greater international visibility). Revista Española de Documentación Científica, 41(3): e21. https://doi.org/10.3989/redc.2018.3.1506 [ Links ]

Heckman, J. J. (1990). Selection bias and self-selection. In J. Eatwell, M. Milgate & P. Newman (Eds.), Econometrics (pp. 201-224). Palgrave Macmillan. https://doi.org/10.1007/978-1-349-20570-7_29 [ Links ]

Higgins, J.P.T. & Deeks J.J. (editors). (2011) Chapter 7: Selecting studies and collecting data. In: Higgins JPT, Green S. (editors), Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 (updated March 2011). The Cochrane Collaboration, 2011. https://www.cochrane-handbook.org. [ Links ]

Johns, R. G., Barkham, M., Kellett, S., & Saxon, D. (2019). A systematic review of therapist effects: A critical narrative update and refinement to review. Clinical Psychology Review, 67, 78-93. https://doi.org/10.1016/j.cpr.2018.08.004 [ Links ]

Miller, S. D., Hubble, M., & Duncan, B. (2008). Supershrinks: What is the secret of their success. Psychotherapy in Australia, 14(4), 14-22. [ Links ]

Norcross, J. C. & Lambert, M. J. (2011). Psychotherapy relationships that work II. Psychotherapy, 48, 4-8. https://doi.org/10.1037/a0022180 [ Links ]

Núñez de Prado-Gordillo, M., Ábalo-Rodríguez, I., Estal-Muñoz, V., Froxán-Parga, M.X. (2020). Cuestiones filosóficas en torno al análisis de la conducta (Phiilosophical questions around behavior analysis). In M.X. Froxán-Parga (Ed.), Análisis Funcional de la conducta humana: concepto, metodología y aplicaciones (Functional analysis of human behavior: concept, methodology and aplications) (1st ed., pp. 51-81). Ediciones Pirámide. [ Links ]

Pérez-Álvarez, M. (2018). La Psicología más allá del dualismo y el cerebrocentrismo. (The psychology beyond the dualism and braincentrism). Apuntes de Psicología, 36(1-2), 7-20. https://apuntesdepsicologia.es/index.php/revista/article/view/705/497Links ]

Ricks, D. F. (1974). Supershrink: Methods of a therapist judged successful on the basis of adult outcomes of adolescent patients. In D.F., Ricks, M., Roff, & A., Thomas (Eds.), Life history research in psychopathology, 3, 275-297. University of Minnesota Press. [ Links ]

Sánchez-Meca, J. & Botella, J. (2010). Revisiones sistemáticas y meta-análisis: Herramientas para la práctica profesional. (Systematic reviews and meta-analyses: Tools for profesional practice). Papeles del psicólogo, 31(1), 7-17. https://www.redalyc.org/articulo.oa?id=77812441002Links ]

Santacreu, J. & García-Leal, O. (2000). La utilización de tests comportamentales informatizados en el estudio de la personalidad: la evaluación de la persistencia. (The use of computerized behavioral tests in the study of personality: the assessment of persistence). Psicothema, 12(1), 93-98. Recuperado a partir de https://reunido.uniovi.es/index.php/PST/article/view/7792Links ]

Santacreu, J. & Hernández, J. M. (2019). Reflexiones finales: Lograr un psicólogo clínico experto. (Final reflextions: Achieving an expert clinical psychologist). In Santacreu, J. y Hernández, J., (Eds.), La Clínica Universitaria del Centro de Psicología Aplicada de la Universidad Autónoma de Madrid (CPA-UAM) (The univeristy clinic of the center for applied psychology of Autonomous University of Madrid). (1ed., pp 119-129). UAM Ediciones. [ Links ]

Saxon, D., Firth, N., & Barkham, M. (2017). The relationship between therapist effects and therapy delivery factors: Therapy modality, dosage, and non-completion. Administration and Policy in Mental Health and Mental Health Services Research, 44(5), 705-715. https://doi.org/10.1007/s10488-016-0750-5 [ Links ]

Sellars, W. (1956). Empiricism and the Philosophy of Mind. Minnesota studies in the philosophy of science, 1(19), 253-329. [ Links ]

Siev, J., & Chambless, D. L. (2007). Specificity of treatment effects: cognitive therapy and relaxation for generalized anxiety and panic disorders. Journal of consulting and clinical psychology, 75(4), 513. https://doi.org/10.1037/0022-006X.75.4.513 [ Links ]

Speers, A. J., Bhullar, N., Cosh, S., & Wootton, B. M. (2022). Correlates of therapist drift in psychological practice: A systematic review of therapist characteristics. Clinical Psychology Review, 10, 21-32. https://doi.org/10.1016/j.cpr.2022.102132 [ Links ]

Spellman, B. A. (2015). A short (personal) future history of revolution 2.0. Perspectives on Psychological Science, 10, 886-899. http://dx.doi.org/101177/1745691615609918 [ Links ]

Stiles, W. B. (1999). Signs and voices in psychotherapy. Psychotherapy Research, 9(1), 1-21. https://doi.org/10.1080/10503309912331332561 [ Links ]

Wampold, B. E., & Imel, Z. E. (2015). The great psychotherapy debate: The evidence for what makes psychotherapy work. Routledge. https://doi.org/10.4324/9780203582015 [ Links ]

Weinberger, J. (2014). Common factors are not so com- mon and specific factors are not so specified: toward an inclusive integration of psychotherapy research. Psychotherapy (Chic), 51, 514-518. https://doi.org/10.1037/a0037092 [ Links ]

Zilcha-Mano, S., & Fisher, H. (2022). Distinct roles of state-like and trait-like patient-therapist alliance in psychotherapy. Nature Reviews Psychology, 1-17. [ Links ]

Financial support:No funding.

Received: November 08, 2021; Revised: June 05, 2022; Accepted: June 22, 2022

*Correspondence address (Dirección para correspondencia): Gladis Lee Pereira. Universidad Autónoma de Madrid: Biological and Health Psychology Department. Madrid (Spain). E-mail: gladis.pereira@uam.es

Conflict of interest:

The authors of this article declare no conflict of interest.

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License