Psychometric analysis of the Dutch language Facilitative Interpersonal Skills (FIS) video clips


With the motivation of investigating the replicability and transferability of the findings employing the Facilitative Interpersonal Skills (FIS) performance task beyond Anglophone countries, a set of Dutch FIS clips have been scripted and recorded. In this study the psychometric properties of the Dutch clips was tested. Furthermore, an additional set of FIS clips portraying a non-challenging client-therapist interaction was tested. 369 psychology students rated the interpersonal impact (IMI-C) and the affect (positive and negative affect schedule) displayed by the hypothetical client. Thirteen out of sixteen FIS clips were located in the same IMI-C quadrant as the US clips, indicating good content validity for all sets of FIS clips. Inter-rater reliability was reasonable for one set of Dutch language FIS clips (k=0.416). Visual inspection of quadrants showed the different character of the non-challenging set of FIS clips. The Dutch FIS clips are directly applicable for educational and research purposes.



PlumX Metrics


Download data is not yet available.


Altman, D. G. (1999). Practical statistics for medical research. New York, NY: Chapman & Hall/CRC Press.

Anderson, T., Crowley, M. E., Himawan, L., Holmberg, J. K., & Uhlin, B. D. (2016). Therapist facilitative interpersonal skills and training status: a randomized clinical trial on alliance and outcome. Psychotherapy Research, 26, 511-529. DOI:

Anderson, T., McClintock, A. S., Himawan, L., Song, X., & Patterson, C. L. (2016). A prospective study of therapist facilitative interpersonal skills as a predictor of treatment outcome. Journal of Consulting and Clinical Psychology, 84(1), 57-66. DOI:

Anderson, T., Ogles, B. M., Patterson, C. L., Lambert, M. J., & Vermeersch, D. A. (2009). Therapist effects: Facilitative interpersonal skills as a predictor of therapist success. Journal of Clinical Psychology, 65(7), 755-768. DOI:

Anderson, T., Patterson, C., McClintock, A. S., McCarrick, S. M., Song, X., & The Psychotherapy and Interpersonal Lab Team. (2018). Facilitative Interpersonal Skills Task and Rating Manual. Unpublished Rating Manual. Athens, OH: Ohio University.

Baldwin, S. A., & Imel, Z. E. (2013). Therapist effects: Findings and methods. In: M.J. Lambert (Ed.), Bergin and Garfield’s handbook of psychotherapy and behavior change, 6 (pp. 258-297). New York, NY: Wiley.

Barkham, M., Lutz, W., Lambert, M. J., & Saxon, D. (2017). Therapist effects, effective therapists, and the law of variability. In L. G. Castonguay & C. E. Hill (Eds.), How and why are some therapists better than others?: Understanding therapist effects (pp. 13-36). Washington, DC: American Psychological Association.

Bjaastad, F.J., Wergeland, H.G. J., Haugland, M. B. S., Gjestad, R., Havik, O. E., Heiervang, E. R., & Öst, L. G. (2018). Do clinical experience, formal cognitive behavioural therapy training, adherence, and competence predict outcome in cognitive behavioural therapy for anxiety disorders in youth? Clinical psychology & psychotherapy, 25(6), 865-877. DOI:

Conger, A. J. (1980). Integration and generalization of kappas for multiple raters. Psychological Bulletin, 88(2), 322. DOI:

Engelen, U., De Peuter, S., Victoir, A., Van Diest, I., & Van den Bergh, O. (2006). Verdere validering van de Positive and Negative Affect Schedule (PANAS) en vergelijking van twee Nederlandstalige versies. Gedrag en gezondheid, 34(2), 61-70.

Eubanks, C. F., Muran, J. C., & Safran, J. D. (2018). Alliance rupture repair: a meta-analysis. Psychotherapy, 55(4), 508. DOI:

Fleiss, J. L. (1971). Measuring nominal scale agreement among many raters. Psychological Bulletin, 76(5), 378. DOI:

Gelso, C. J., & Hayes, J. (2007). Countertransference and the therapist’s inner experience: Perils and possibilities. New York, NY: Routledge. DOI:

Gould, D. (1996) Using vignettes to collect data for nursing research studies: How valid are the findings? Journal of Clinical Nursing, 5, 207-212 DOI:

Gummer, T., Roßmann, J., & Silber, H. (2018). Using instructed response items as attention checks in web surveys: properties and implementation. Sociological Methods & Research, 0049124118769083. DOI:

Hafkenscheid, A. (2003). Objective countertransference: do patients’ interpersonal impacts generalize across therapists?. Clinical Psychology & Psychotherapy: An International Journal of Theory & Practice, 10(1), 31-40. DOI:

Hafkenscheid, A., & Rouckhout, D. (2013). The impact message inventory-circumplex (IMI-C): A replication study of its circumplex structure in a dutch sample. Journal of personality assessment, 95(4), 417-422. DOI:

Hall, J. A., Gunnery, S. D., & Horgan, T. G. (2016). Gender differences in interpersonal accuracy. In J. A. Hall, M. Schmid Mast, & T. V. West (Eds.), The social psychology of perceiving others accurately (pp. 309-327). Cambridge, UK: Cambridge University Press.

Hatcher, R. L. (2015). Interpersonal competencies: responsiveness, technique, and training in psychotherapy. American Psychologist, 70(8), 747. DOI:

Hayes, J. A., Gelso, C. J., Goldberg, S., & Kivlighan, D. M. (2018). Countertransference management and effective psychotherapy: meta‐analytic findings. Psychotherapy, 55, 496-507. DOI:

Heinonen, E., & Nissen-Lie, H. A. (2019). The professional and personal characteristics of effective psychotherapists: a systematic review. Psychotherapy Research, 1-16.

Hillen, M. A., van Vliet, L. M., de Haes, H. C., & Smets, E. M. (2013). Developing and administering scripted video vignettes for experimental research of patient-provider communication. Patient Education and Counseling, 91(3), 295-309. DOI:

Holmqvist, R., Armelius, B.A. (1996). Sources of therapists’ countertransference feelings. Psychotherapy Research, 6(1), 70-78. DOI:

Huppert, J. D., Bufka, L. F., Barlow, D. H., Gorman, J. M., Shear, M. K., & Woods, S. W. (2001). Therapists, therapist variables, and cognitive-behavioral therapy outcome in a multicenter trial for panic disorder. Journal of Consulting and Clinical Psychology, 69(5), 747. DOI:

Johns, R. G., Barkham, M., Kellett, S., & Saxon, D. (2019). A systematic review of therapist effects: A critical narrative update and refinement to review. Clinical Psychology Review, 67, 78-93. DOI:

Kiesler, D. J. & Schmidt, J. A. (2006). The Impact Message Inventory-Circumplex (IMI-C) Manual: Sampler set, manual, test booklet, scoring key, work sheets. Redwood City, CA: Mind Garden.

Kim, D. M., Wampold, B. E., & Bolt, D. M. (2006). Therapist effects in psychotherapy: a random-effects modeling of the National Institute of Mental Health Treatment of Depression Collaborative Research Program data. Psychotherapy Research, 16(02), 161-172. DOI:

Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159-174. DOI:

McHugh, M. L. (2012). Interrater reliability: the kappa statistic. Biochemia medica: Biochemia medica, 22(3), 276-282. DOI:

Munder, T., Schlipfenbacher, C., Toussaint, K., Warmuth, M., Anderson, T., & Gumz, A. (2019). Facilitative interpersonal skills performance test: Psychometric analysis of a German language version. Journal of Clinical Psychology, 75(12), 2273-2283. DOI:

Okiishi, J., Lambert, M.J., Eggett, D., Nielsen, L., Dayton, D.D., & Vermeersch, D.A. (2006). An analysis of therapist treatment effects: Toward providing feedback to individual therapists on their clients’ psychotherapy outcome. Journal of Clinical Psychology, 62(9), 1157–1172. DOI:

Owen, J., Wampold, B. E., Kopta, M., Rousmaniere, T., & Miller, S. D. (2016). As good as it gets? Therapy outcomes of trainees over time. Journal of Counseling Psychology, 63(1), 12. DOI:

Rouquette, A., & Falissard, B. (2011). Sample size requirements for the internal validation of psychiatric scales. International Journal of Methods in Psychiatric Research, 20(4), 235-249. DOI:

Steggles, K., & de Jong, K. (2018). Does therapist emotion regulation moderate their facilitative interpersonal skills? Paper presented at the 49th International Society for Psychotherapy Researh International Annual Meeting, Amsterdam, The Netherlands.

Strupp, H. H. (1993). The Vanderbilt psychotherapy studies: synopsis. Journal of Consulting and Clinical Psychology, 61(3), 431-433. DOI:

Wampold, B. E. (2015). How important are the common factors in psychotherapy? An update. World Psychiatry, 14(3), 270-277. DOI:

Wampold, B. E., & Brown, G. S. J. (2005). Estimating variability in outcomes attributable to therapists: a naturalistic study of outcomes in managed care. Journal of Consulting and Clinical Psychology, 73(5), 914. DOI:

Wampold, B. E., Baldwin, S. A., Holtforth, M. g., & Imel, Z. E. (2017). What characterizes effective therapists? In L. G. Castonguay & C. E. Hill (Eds.), How and why are some therapists better than others?: Understanding therapist effects (pp. 37-53). Washington, DC: American Psychological Association.

Wampold, B. E., & Imel, Z. E. (2015). The great psychotherapy debate: The evidence for what makes psychotherapy work. New York, NY: Routledge. DOI:

Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: the PANAS scales. Journal of Personality and Social Psychology, 54(6), 1063. DOI:

Tools validation
Interpersonal skills, therapist effects, performance-based assessment, common factors.
  • Abstract views: 32

  • PDF: 50
How to Cite
van Thiel, S., Joosen, M. C., Joki, A.-L., van Dam, A., van der Klink, J. J., & de Jong, K. (2021). Psychometric analysis of the Dutch language Facilitative Interpersonal Skills (FIS) video clips. Research in Psychotherapy: Psychopathology, Process and Outcome, 24(1).