https://doi.org/10.4081/ripppo.2021.513
Psychometric analysis of the Dutch language Facilitative Interpersonal Skills (FIS) video clips
Submitted: December 17, 2020
Accepted: March 13, 2021
Published: April 8, 2021
Accepted: March 13, 2021
Abstract Views: 1413
PDF: 806
HTML: 19
HTML: 19
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.
Authors
With the motivation of investigating the replicability and transferability of the findings employing the Facilitative Interpersonal Skills (FIS) performance task beyond Anglophone countries, a set of Dutch FIS clips have been scripted and recorded. In this study the psychometric properties of the Dutch clips was tested. Furthermore, an additional set of FIS clips portraying a non-challenging client-therapist interaction was tested. 369 psychology students rated the interpersonal impact (IMI-C) and the affect (positive and negative affect schedule) displayed by the hypothetical client. Thirteen out of sixteen FIS clips were located in the same IMI-C quadrant as the US clips, indicating good content validity for all sets of FIS clips. Inter-rater reliability was reasonable for one set of Dutch language FIS clips (k=0.416). Visual inspection of quadrants showed the different character of the non-challenging set of FIS clips. The Dutch FIS clips are directly applicable for educational and research purposes.
Altman, D. G. (1999). Practical statistics for medical research. New York, NY: Chapman & Hall/CRC Press.
Anderson, T., Crowley, M. E., Himawan, L., Holmberg, J. K., & Uhlin, B. D. (2016). Therapist facilitative interpersonal skills and training status: a randomized clinical trial on alliance and outcome. Psychotherapy Research, 26, 511-529.
DOI: https://doi.org/10.1080/10503307.2015.1049671
Anderson, T., McClintock, A. S., Himawan, L., Song, X., & Patterson, C. L. (2016). A prospective study of therapist facilitative interpersonal skills as a predictor of treatment outcome. Journal of Consulting and Clinical Psychology, 84(1), 57-66.
DOI: https://doi.org/10.1037/ccp0000060
Anderson, T., Ogles, B. M., Patterson, C. L., Lambert, M. J., & Vermeersch, D. A. (2009). Therapist effects: Facilitative interpersonal skills as a predictor of therapist success. Journal of Clinical Psychology, 65(7), 755-768.
DOI: https://doi.org/10.1002/jclp.20583
Anderson, T., Patterson, C., McClintock, A. S., McCarrick, S. M., Song, X., & The Psychotherapy and Interpersonal Lab Team. (2018). Facilitative Interpersonal Skills Task and Rating Manual. Unpublished Rating Manual. Athens, OH: Ohio University.
Baldwin, S. A., & Imel, Z. E. (2013). Therapist effects: Findings and methods. In: M.J. Lambert (Ed.), Bergin and Garfield’s handbook of psychotherapy and behavior change, 6 (pp. 258-297). New York, NY: Wiley.
Barkham, M., Lutz, W., Lambert, M. J., & Saxon, D. (2017). Therapist effects, effective therapists, and the law of variability. In L. G. Castonguay & C. E. Hill (Eds.), How and why are some therapists better than others?: Understanding therapist effects (pp. 13-36). Washington, DC: American Psychological Association.
Bjaastad, F.J., Wergeland, H.G. J., Haugland, M. B. S., Gjestad, R., Havik, O. E., Heiervang, E. R., & Öst, L. G. (2018). Do clinical experience, formal cognitive behavioural therapy training, adherence, and competence predict outcome in cognitive behavioural therapy for anxiety disorders in youth? Clinical psychology & psychotherapy, 25(6), 865-877.
DOI: https://doi.org/10.1002/cpp.2321
Conger, A. J. (1980). Integration and generalization of kappas for multiple raters. Psychological Bulletin, 88(2), 322.
DOI: https://doi.org/10.1037/0033-2909.88.2.322
Engelen, U., De Peuter, S., Victoir, A., Van Diest, I., & Van den Bergh, O. (2006). Verdere validering van de Positive and Negative Affect Schedule (PANAS) en vergelijking van twee Nederlandstalige versies. Gedrag en gezondheid, 34(2), 61-70.
Eubanks, C. F., Muran, J. C., & Safran, J. D. (2018). Alliance rupture repair: a meta-analysis. Psychotherapy, 55(4), 508.
DOI: https://doi.org/10.1037/pst0000185
Fleiss, J. L. (1971). Measuring nominal scale agreement among many raters. Psychological Bulletin, 76(5), 378.
DOI: https://doi.org/10.1037/h0031619
Gelso, C. J., & Hayes, J. (2007). Countertransference and the therapist’s inner experience: Perils and possibilities. New York, NY: Routledge.
DOI: https://doi.org/10.4324/9780203936979
Gould, D. (1996) Using vignettes to collect data for nursing research studies: How valid are the findings? Journal of Clinical Nursing, 5, 207-212
DOI: https://doi.org/10.1111/j.1365-2702.1996.tb00253.x
Gummer, T., Roßmann, J., & Silber, H. (2018). Using instructed response items as attention checks in web surveys: properties and implementation. Sociological Methods & Research, 0049124118769083.
DOI: https://doi.org/10.1177/0049124118769083
Hafkenscheid, A. (2003). Objective countertransference: do patients’ interpersonal impacts generalize across therapists?. Clinical Psychology & Psychotherapy: An International Journal of Theory & Practice, 10(1), 31-40.
DOI: https://doi.org/10.1002/cpp.349
Hafkenscheid, A., & Rouckhout, D. (2013). The impact message inventory-circumplex (IMI-C): A replication study of its circumplex structure in a dutch sample. Journal of personality assessment, 95(4), 417-422.
DOI: https://doi.org/10.1080/00223891.2013.765883
Hall, J. A., Gunnery, S. D., & Horgan, T. G. (2016). Gender differences in interpersonal accuracy. In J. A. Hall, M. Schmid Mast, & T. V. West (Eds.), The social psychology of perceiving others accurately (pp. 309-327). Cambridge, UK: Cambridge University Press.
Hatcher, R. L. (2015). Interpersonal competencies: responsiveness, technique, and training in psychotherapy. American Psychologist, 70(8), 747.
DOI: https://doi.org/10.1037/a0039803
Hayes, J. A., Gelso, C. J., Goldberg, S., & Kivlighan, D. M. (2018). Countertransference management and effective psychotherapy: meta‐analytic findings. Psychotherapy, 55, 496-507.
DOI: https://doi.org/10.1037/pst0000189
Heinonen, E., & Nissen-Lie, H. A. (2019). The professional and personal characteristics of effective psychotherapists: a systematic review. Psychotherapy Research, 1-16.
Hillen, M. A., van Vliet, L. M., de Haes, H. C., & Smets, E. M. (2013). Developing and administering scripted video vignettes for experimental research of patient-provider communication. Patient Education and Counseling, 91(3), 295-309.
DOI: https://doi.org/10.1016/j.pec.2013.01.020
Holmqvist, R., Armelius, B.A. (1996). Sources of therapists’ countertransference feelings. Psychotherapy Research, 6(1), 70-78.
DOI: https://doi.org/10.1080/10503309612331331588
Huppert, J. D., Bufka, L. F., Barlow, D. H., Gorman, J. M., Shear, M. K., & Woods, S. W. (2001). Therapists, therapist variables, and cognitive-behavioral therapy outcome in a multicenter trial for panic disorder. Journal of Consulting and Clinical Psychology, 69(5), 747.
DOI: https://doi.org/10.1037/0022-006X.69.5.747
Johns, R. G., Barkham, M., Kellett, S., & Saxon, D. (2019). A systematic review of therapist effects: A critical narrative update and refinement to review. Clinical Psychology Review, 67, 78-93.
DOI: https://doi.org/10.1016/j.cpr.2018.08.004
Kiesler, D. J. & Schmidt, J. A. (2006). The Impact Message Inventory-Circumplex (IMI-C) Manual: Sampler set, manual, test booklet, scoring key, work sheets. Redwood City, CA: Mind Garden.
Kim, D. M., Wampold, B. E., & Bolt, D. M. (2006). Therapist effects in psychotherapy: a random-effects modeling of the National Institute of Mental Health Treatment of Depression Collaborative Research Program data. Psychotherapy Research, 16(02), 161-172.
DOI: https://doi.org/10.1080/10503300500264911
Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159-174.
DOI: https://doi.org/10.2307/2529310
McHugh, M. L. (2012). Interrater reliability: the kappa statistic. Biochemia medica: Biochemia medica, 22(3), 276-282.
DOI: https://doi.org/10.11613/BM.2012.031
Munder, T., Schlipfenbacher, C., Toussaint, K., Warmuth, M., Anderson, T., & Gumz, A. (2019). Facilitative interpersonal skills performance test: Psychometric analysis of a German language version. Journal of Clinical Psychology, 75(12), 2273-2283.
DOI: https://doi.org/10.1002/jclp.22846
Okiishi, J., Lambert, M.J., Eggett, D., Nielsen, L., Dayton, D.D., & Vermeersch, D.A. (2006). An analysis of therapist treatment effects: Toward providing feedback to individual therapists on their clients’ psychotherapy outcome. Journal of Clinical Psychology, 62(9), 1157–1172.
DOI: https://doi.org/10.1002/jclp.20272
Owen, J., Wampold, B. E., Kopta, M., Rousmaniere, T., & Miller, S. D. (2016). As good as it gets? Therapy outcomes of trainees over time. Journal of Counseling Psychology, 63(1), 12.
DOI: https://doi.org/10.1037/cou0000112
Rouquette, A., & Falissard, B. (2011). Sample size requirements for the internal validation of psychiatric scales. International Journal of Methods in Psychiatric Research, 20(4), 235-249.
DOI: https://doi.org/10.1002/mpr.352
Steggles, K., & de Jong, K. (2018). Does therapist emotion regulation moderate their facilitative interpersonal skills? Paper presented at the 49th International Society for Psychotherapy Researh International Annual Meeting, Amsterdam, The Netherlands.
Strupp, H. H. (1993). The Vanderbilt psychotherapy studies: synopsis. Journal of Consulting and Clinical Psychology, 61(3), 431-433.
DOI: https://doi.org/10.1037/0022-006X.61.3.431
Wampold, B. E. (2015). How important are the common factors in psychotherapy? An update. World Psychiatry, 14(3), 270-277.
DOI: https://doi.org/10.1002/wps.20238
Wampold, B. E., & Brown, G. S. J. (2005). Estimating variability in outcomes attributable to therapists: a naturalistic study of outcomes in managed care. Journal of Consulting and Clinical Psychology, 73(5), 914.
DOI: https://doi.org/10.1037/0022-006X.73.5.914
Wampold, B. E., Baldwin, S. A., Holtforth, M. g., & Imel, Z. E. (2017). What characterizes effective therapists? In L. G. Castonguay & C. E. Hill (Eds.), How and why are some therapists better than others?: Understanding therapist effects (pp. 37-53). Washington, DC: American Psychological Association.
Wampold, B. E., & Imel, Z. E. (2015). The great psychotherapy debate: The evidence for what makes psychotherapy work. New York, NY: Routledge.
DOI: https://doi.org/10.4324/9780203582015
Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: the PANAS scales. Journal of Personality and Social Psychology, 54(6), 1063.
DOI: https://doi.org/10.1037/0022-3514.54.6.1063
How to Cite
van Thiel, S., Joosen, M. C., Joki, A.-L., van Dam, A., van der Klink, J. J., & de Jong, K. (2021). Psychometric analysis of the Dutch language Facilitative Interpersonal Skills (FIS) video clips. Research in Psychotherapy: Psychopathology, Process and Outcome, 24(1). https://doi.org/10.4081/ripppo.2021.513
PAGEPress has chosen to apply the Creative Commons Attribution NonCommercial 4.0 International License (CC BY-NC 4.0) to all manuscripts to be published.
Similar Articles
- Jordan Bate, Angelica Tsakas, Facilitative interpersonal skills are relevant in child therapy too, so why don’t we measure them? , Research in Psychotherapy: Psychopathology, Process and Outcome: Vol. 25 No. 1 (2022)
- Gaia Albano, Arianna Teti, Arianna Scrò, Rubinia Celeste Bonfanti, Lucia Fortunato, Gianluca Lo Coco, A systematic review on the role of therapist characteristics in the treatment of eating disorders , Research in Psychotherapy: Psychopathology, Process and Outcome: Vol. 27 No. 2 (2024)
- Kim de Jong, Johanna Wilkens, Timothy Anderson, Kane Steggles, Facilitative interpersonal skills in benign versus challenging therapy situations in trainee therapists: a pilot study , Research in Psychotherapy: Psychopathology, Process and Outcome: Vol. 27 No. 2 (2024)
- Samantha Reis, Emily L. Matthews, Brin F.S. Grenyer, Characteristics of effective online interventions: implications for adolescents with personality disorder during a global pandemic , Research in Psychotherapy: Psychopathology, Process and Outcome: Vol. 23 No. 3 (2020)
- Christine Koddebusch, Christiane Hermann, A proposed conceptualization of therapeutic competence: the three level model , Research in Psychotherapy: Psychopathology, Process and Outcome: Vol. 21 No. 1 (2018)
- Hubert de Condé, Emmanuelle Zech, Jochem Willemsen, The person behind the therapist: a recall study on significant events that contribute to therapists’ personal and professional development , Research in Psychotherapy: Psychopathology, Process and Outcome: Vol. 27 No. 2 (2024)
- CV Vijayapriya, Rameshbabu Tamarana, Effectiveness of dialectical behavior therapy as a transdiagnostic treatment for improving cognitive functions: a systematic review , Research in Psychotherapy: Psychopathology, Process and Outcome: Vol. 26 No. 2 (2023)
- Giovanna Esposito, Francesco Cuomo, Angela Di Maro, Raffaella Passeggia, The assessment of therapist responsiveness in psychotherapy research: a systematic review , Research in Psychotherapy: Psychopathology, Process and Outcome: Vol. 27 No. 2 (2024)
- Racheli Miller, Mark J. Hilsenroth, Paul L. Hewitt, Perfectionism and therapeutic alliance: a review of the clinical research , Research in Psychotherapy: Psychopathology, Process and Outcome: Vol. 20 No. 1 (2017)
- Ana Bela Couto, Eunice Barbosa, Sara Silva, Tiago Bento, Ana Sofia Teixeira, Joào Salgado, Carla Cunha, Client's immersed and distanced speech and therapist's interventions in emotion-focused therapy for depression: an intensive analysis of a case study , Research in Psychotherapy: Psychopathology, Process and Outcome: Vol. 19 No. 2 (2016)
You may also start an advanced similarity search for this article.
