Psychometric analysis of the Dutch language Facilitative Interpersonal Skills (FIS) video clips

Abstract

With the motivation of investigating the replicability and transferability of the findings employing the Facilitative Interpersonal Skills (FIS) performance task beyond Anglophone countries, a set of Dutch FIS clips have been scripted and recorded. In this study the psychometric properties of the Dutch clips was tested. Furthermore, an additional set of FIS clips portraying a non-challenging client-therapist interaction was tested. 369 psychology students rated the interpersonal impact (IMI-C) and the affect (positive and negative affect schedule) displayed by the hypothetical client. Thirteen out of sixteen FIS clips were located in the same IMI-C quadrant as the US clips, indicating good content validity for all sets of FIS clips. Inter-rater reliability was reasonable for one set of Dutch language FIS clips (k=0.416). Visual inspection of quadrants showed the different character of the non-challenging set of FIS clips. The Dutch FIS clips are directly applicable for educational and research purposes.

Dimensions

Altmetric

PlumX Metrics

Downloads

Download data is not yet available.

References

Altman, D. G. (1999). Practical statistics for medical research. New York, NY: Chapman & Hall/CRC Press.

Anderson, T., Crowley, M. E., Himawan, L., Holmberg, J. K., & Uhlin, B. D. (2016). Therapist facilitative interpersonal skills and training status: a randomized clinical trial on alliance and outcome. Psychotherapy Research, 26, 511-529. DOI: https://doi.org/10.1080/10503307.2015.1049671

Anderson, T., McClintock, A. S., Himawan, L., Song, X., & Patterson, C. L. (2016). A prospective study of therapist facilitative interpersonal skills as a predictor of treatment outcome. Journal of Consulting and Clinical Psychology, 84(1), 57-66. DOI: https://doi.org/10.1037/ccp0000060

Anderson, T., Ogles, B. M., Patterson, C. L., Lambert, M. J., & Vermeersch, D. A. (2009). Therapist effects: Facilitative interpersonal skills as a predictor of therapist success. Journal of Clinical Psychology, 65(7), 755-768. DOI: https://doi.org/10.1002/jclp.20583

Anderson, T., Patterson, C., McClintock, A. S., McCarrick, S. M., Song, X., & The Psychotherapy and Interpersonal Lab Team. (2018). Facilitative Interpersonal Skills Task and Rating Manual. Unpublished Rating Manual. Athens, OH: Ohio University.

Baldwin, S. A., & Imel, Z. E. (2013). Therapist effects: Findings and methods. In: M.J. Lambert (Ed.), Bergin and Garfield’s handbook of psychotherapy and behavior change, 6 (pp. 258-297). New York, NY: Wiley.

Barkham, M., Lutz, W., Lambert, M. J., & Saxon, D. (2017). Therapist effects, effective therapists, and the law of variability. In L. G. Castonguay & C. E. Hill (Eds.), How and why are some therapists better than others?: Understanding therapist effects (pp. 13-36). Washington, DC: American Psychological Association.

Bjaastad, F.J., Wergeland, H.G. J., Haugland, M. B. S., Gjestad, R., Havik, O. E., Heiervang, E. R., & Öst, L. G. (2018). Do clinical experience, formal cognitive behavioural therapy training, adherence, and competence predict outcome in cognitive behavioural therapy for anxiety disorders in youth? Clinical psychology & psychotherapy, 25(6), 865-877. DOI: https://doi.org/10.1002/cpp.2321

Conger, A. J. (1980). Integration and generalization of kappas for multiple raters. Psychological Bulletin, 88(2), 322. DOI: https://doi.org/10.1037/0033-2909.88.2.322

Engelen, U., De Peuter, S., Victoir, A., Van Diest, I., & Van den Bergh, O. (2006). Verdere validering van de Positive and Negative Affect Schedule (PANAS) en vergelijking van twee Nederlandstalige versies. Gedrag en gezondheid, 34(2), 61-70.

Eubanks, C. F., Muran, J. C., & Safran, J. D. (2018). Alliance rupture repair: a meta-analysis. Psychotherapy, 55(4), 508. DOI: https://doi.org/10.1037/pst0000185

Fleiss, J. L. (1971). Measuring nominal scale agreement among many raters. Psychological Bulletin, 76(5), 378. DOI: https://doi.org/10.1037/h0031619

Gelso, C. J., & Hayes, J. (2007). Countertransference and the therapist’s inner experience: Perils and possibilities. New York, NY: Routledge. DOI: https://doi.org/10.4324/9780203936979

Gould, D. (1996) Using vignettes to collect data for nursing research studies: How valid are the findings? Journal of Clinical Nursing, 5, 207-212 DOI: https://doi.org/10.1111/j.1365-2702.1996.tb00253.x

Gummer, T., Roßmann, J., & Silber, H. (2018). Using instructed response items as attention checks in web surveys: properties and implementation. Sociological Methods & Research, 0049124118769083. DOI: https://doi.org/10.1177/0049124118769083

Hafkenscheid, A. (2003). Objective countertransference: do patients’ interpersonal impacts generalize across therapists?. Clinical Psychology & Psychotherapy: An International Journal of Theory & Practice, 10(1), 31-40. DOI: https://doi.org/10.1002/cpp.349

Hafkenscheid, A., & Rouckhout, D. (2013). The impact message inventory-circumplex (IMI-C): A replication study of its circumplex structure in a dutch sample. Journal of personality assessment, 95(4), 417-422. DOI: https://doi.org/10.1080/00223891.2013.765883

Hall, J. A., Gunnery, S. D., & Horgan, T. G. (2016). Gender differences in interpersonal accuracy. In J. A. Hall, M. Schmid Mast, & T. V. West (Eds.), The social psychology of perceiving others accurately (pp. 309-327). Cambridge, UK: Cambridge University Press.

Hatcher, R. L. (2015). Interpersonal competencies: responsiveness, technique, and training in psychotherapy. American Psychologist, 70(8), 747. DOI: https://doi.org/10.1037/a0039803

Hayes, J. A., Gelso, C. J., Goldberg, S., & Kivlighan, D. M. (2018). Countertransference management and effective psychotherapy: meta‐analytic findings. Psychotherapy, 55, 496-507. DOI: https://doi.org/10.1037/pst0000189

Heinonen, E., & Nissen-Lie, H. A. (2019). The professional and personal characteristics of effective psychotherapists: a systematic review. Psychotherapy Research, 1-16.

Hillen, M. A., van Vliet, L. M., de Haes, H. C., & Smets, E. M. (2013). Developing and administering scripted video vignettes for experimental research of patient-provider communication. Patient Education and Counseling, 91(3), 295-309. DOI: https://doi.org/10.1016/j.pec.2013.01.020

Holmqvist, R., Armelius, B.A. (1996). Sources of therapists’ countertransference feelings. Psychotherapy Research, 6(1), 70-78. DOI: https://doi.org/10.1080/10503309612331331588

Huppert, J. D., Bufka, L. F., Barlow, D. H., Gorman, J. M., Shear, M. K., & Woods, S. W. (2001). Therapists, therapist variables, and cognitive-behavioral therapy outcome in a multicenter trial for panic disorder. Journal of Consulting and Clinical Psychology, 69(5), 747. DOI: https://doi.org/10.1037/0022-006X.69.5.747

Johns, R. G., Barkham, M., Kellett, S., & Saxon, D. (2019). A systematic review of therapist effects: A critical narrative update and refinement to review. Clinical Psychology Review, 67, 78-93. DOI: https://doi.org/10.1016/j.cpr.2018.08.004

Kiesler, D. J. & Schmidt, J. A. (2006). The Impact Message Inventory-Circumplex (IMI-C) Manual: Sampler set, manual, test booklet, scoring key, work sheets. Redwood City, CA: Mind Garden.

Kim, D. M., Wampold, B. E., & Bolt, D. M. (2006). Therapist effects in psychotherapy: a random-effects modeling of the National Institute of Mental Health Treatment of Depression Collaborative Research Program data. Psychotherapy Research, 16(02), 161-172. DOI: https://doi.org/10.1080/10503300500264911

Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159-174. DOI: https://doi.org/10.2307/2529310

McHugh, M. L. (2012). Interrater reliability: the kappa statistic. Biochemia medica: Biochemia medica, 22(3), 276-282. DOI: https://doi.org/10.11613/BM.2012.031

Munder, T., Schlipfenbacher, C., Toussaint, K., Warmuth, M., Anderson, T., & Gumz, A. (2019). Facilitative interpersonal skills performance test: Psychometric analysis of a German language version. Journal of Clinical Psychology, 75(12), 2273-2283. DOI: https://doi.org/10.1002/jclp.22846

Okiishi, J., Lambert, M.J., Eggett, D., Nielsen, L., Dayton, D.D., & Vermeersch, D.A. (2006). An analysis of therapist treatment effects: Toward providing feedback to individual therapists on their clients’ psychotherapy outcome. Journal of Clinical Psychology, 62(9), 1157–1172. DOI: https://doi.org/10.1002/jclp.20272

Owen, J., Wampold, B. E., Kopta, M., Rousmaniere, T., & Miller, S. D. (2016). As good as it gets? Therapy outcomes of trainees over time. Journal of Counseling Psychology, 63(1), 12. DOI: https://doi.org/10.1037/cou0000112

Rouquette, A., & Falissard, B. (2011). Sample size requirements for the internal validation of psychiatric scales. International Journal of Methods in Psychiatric Research, 20(4), 235-249. DOI: https://doi.org/10.1002/mpr.352

Steggles, K., & de Jong, K. (2018). Does therapist emotion regulation moderate their facilitative interpersonal skills? Paper presented at the 49th International Society for Psychotherapy Researh International Annual Meeting, Amsterdam, The Netherlands.

Strupp, H. H. (1993). The Vanderbilt psychotherapy studies: synopsis. Journal of Consulting and Clinical Psychology, 61(3), 431-433. DOI: https://doi.org/10.1037/0022-006X.61.3.431

Wampold, B. E. (2015). How important are the common factors in psychotherapy? An update. World Psychiatry, 14(3), 270-277. DOI: https://doi.org/10.1002/wps.20238

Wampold, B. E., & Brown, G. S. J. (2005). Estimating variability in outcomes attributable to therapists: a naturalistic study of outcomes in managed care. Journal of Consulting and Clinical Psychology, 73(5), 914. DOI: https://doi.org/10.1037/0022-006X.73.5.914

Wampold, B. E., Baldwin, S. A., Holtforth, M. g., & Imel, Z. E. (2017). What characterizes effective therapists? In L. G. Castonguay & C. E. Hill (Eds.), How and why are some therapists better than others?: Understanding therapist effects (pp. 37-53). Washington, DC: American Psychological Association.

Wampold, B. E., & Imel, Z. E. (2015). The great psychotherapy debate: The evidence for what makes psychotherapy work. New York, NY: Routledge. DOI: https://doi.org/10.4324/9780203582015

Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: the PANAS scales. Journal of Personality and Social Psychology, 54(6), 1063. DOI: https://doi.org/10.1037/0022-3514.54.6.1063

Published
2021-04-08
Info
Issue
Section
Tools validation
Keywords:
Interpersonal skills, therapist effects, performance-based assessment, common factors.
Statistics
  • Abstract views: 232

  • PDF: 214
  • HTML: 0
How to Cite
van Thiel, S., Joosen, M. C., Joki, A.-L., van Dam, A., van der Klink, J. J., & de Jong, K. (2021). Psychometric analysis of the Dutch language Facilitative Interpersonal Skills (FIS) video clips. Research in Psychotherapy: Psychopathology, Process and Outcome, 24(1). https://doi.org/10.4081/ripppo.2021.513