https://doi.org/10.4081/ripppo.2021.513
Psychometric analysis of the Dutch language Facilitative Interpersonal Skills (FIS) video clips
Submitted: December 17, 2020
Accepted: March 13, 2021
Published: April 8, 2021
Accepted: March 13, 2021
Abstract Views: 1381
PDF: 792
HTML: 18
HTML: 18
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.
Authors
With the motivation of investigating the replicability and transferability of the findings employing the Facilitative Interpersonal Skills (FIS) performance task beyond Anglophone countries, a set of Dutch FIS clips have been scripted and recorded. In this study the psychometric properties of the Dutch clips was tested. Furthermore, an additional set of FIS clips portraying a non-challenging client-therapist interaction was tested. 369 psychology students rated the interpersonal impact (IMI-C) and the affect (positive and negative affect schedule) displayed by the hypothetical client. Thirteen out of sixteen FIS clips were located in the same IMI-C quadrant as the US clips, indicating good content validity for all sets of FIS clips. Inter-rater reliability was reasonable for one set of Dutch language FIS clips (k=0.416). Visual inspection of quadrants showed the different character of the non-challenging set of FIS clips. The Dutch FIS clips are directly applicable for educational and research purposes.
Altman, D. G. (1999). Practical statistics for medical research. New York, NY: Chapman & Hall/CRC Press.
Anderson, T., Crowley, M. E., Himawan, L., Holmberg, J. K., & Uhlin, B. D. (2016). Therapist facilitative interpersonal skills and training status: a randomized clinical trial on alliance and outcome. Psychotherapy Research, 26, 511-529.
DOI: https://doi.org/10.1080/10503307.2015.1049671
Anderson, T., McClintock, A. S., Himawan, L., Song, X., & Patterson, C. L. (2016). A prospective study of therapist facilitative interpersonal skills as a predictor of treatment outcome. Journal of Consulting and Clinical Psychology, 84(1), 57-66.
DOI: https://doi.org/10.1037/ccp0000060
Anderson, T., Ogles, B. M., Patterson, C. L., Lambert, M. J., & Vermeersch, D. A. (2009). Therapist effects: Facilitative interpersonal skills as a predictor of therapist success. Journal of Clinical Psychology, 65(7), 755-768.
DOI: https://doi.org/10.1002/jclp.20583
Anderson, T., Patterson, C., McClintock, A. S., McCarrick, S. M., Song, X., & The Psychotherapy and Interpersonal Lab Team. (2018). Facilitative Interpersonal Skills Task and Rating Manual. Unpublished Rating Manual. Athens, OH: Ohio University.
Baldwin, S. A., & Imel, Z. E. (2013). Therapist effects: Findings and methods. In: M.J. Lambert (Ed.), Bergin and Garfield’s handbook of psychotherapy and behavior change, 6 (pp. 258-297). New York, NY: Wiley.
Barkham, M., Lutz, W., Lambert, M. J., & Saxon, D. (2017). Therapist effects, effective therapists, and the law of variability. In L. G. Castonguay & C. E. Hill (Eds.), How and why are some therapists better than others?: Understanding therapist effects (pp. 13-36). Washington, DC: American Psychological Association.
Bjaastad, F.J., Wergeland, H.G. J., Haugland, M. B. S., Gjestad, R., Havik, O. E., Heiervang, E. R., & Öst, L. G. (2018). Do clinical experience, formal cognitive behavioural therapy training, adherence, and competence predict outcome in cognitive behavioural therapy for anxiety disorders in youth? Clinical psychology & psychotherapy, 25(6), 865-877.
DOI: https://doi.org/10.1002/cpp.2321
Conger, A. J. (1980). Integration and generalization of kappas for multiple raters. Psychological Bulletin, 88(2), 322.
DOI: https://doi.org/10.1037/0033-2909.88.2.322
Engelen, U., De Peuter, S., Victoir, A., Van Diest, I., & Van den Bergh, O. (2006). Verdere validering van de Positive and Negative Affect Schedule (PANAS) en vergelijking van twee Nederlandstalige versies. Gedrag en gezondheid, 34(2), 61-70.
Eubanks, C. F., Muran, J. C., & Safran, J. D. (2018). Alliance rupture repair: a meta-analysis. Psychotherapy, 55(4), 508.
DOI: https://doi.org/10.1037/pst0000185
Fleiss, J. L. (1971). Measuring nominal scale agreement among many raters. Psychological Bulletin, 76(5), 378.
DOI: https://doi.org/10.1037/h0031619
Gelso, C. J., & Hayes, J. (2007). Countertransference and the therapist’s inner experience: Perils and possibilities. New York, NY: Routledge.
DOI: https://doi.org/10.4324/9780203936979
Gould, D. (1996) Using vignettes to collect data for nursing research studies: How valid are the findings? Journal of Clinical Nursing, 5, 207-212
DOI: https://doi.org/10.1111/j.1365-2702.1996.tb00253.x
Gummer, T., Roßmann, J., & Silber, H. (2018). Using instructed response items as attention checks in web surveys: properties and implementation. Sociological Methods & Research, 0049124118769083.
DOI: https://doi.org/10.1177/0049124118769083
Hafkenscheid, A. (2003). Objective countertransference: do patients’ interpersonal impacts generalize across therapists?. Clinical Psychology & Psychotherapy: An International Journal of Theory & Practice, 10(1), 31-40.
DOI: https://doi.org/10.1002/cpp.349
Hafkenscheid, A., & Rouckhout, D. (2013). The impact message inventory-circumplex (IMI-C): A replication study of its circumplex structure in a dutch sample. Journal of personality assessment, 95(4), 417-422.
DOI: https://doi.org/10.1080/00223891.2013.765883
Hall, J. A., Gunnery, S. D., & Horgan, T. G. (2016). Gender differences in interpersonal accuracy. In J. A. Hall, M. Schmid Mast, & T. V. West (Eds.), The social psychology of perceiving others accurately (pp. 309-327). Cambridge, UK: Cambridge University Press.
Hatcher, R. L. (2015). Interpersonal competencies: responsiveness, technique, and training in psychotherapy. American Psychologist, 70(8), 747.
DOI: https://doi.org/10.1037/a0039803
Hayes, J. A., Gelso, C. J., Goldberg, S., & Kivlighan, D. M. (2018). Countertransference management and effective psychotherapy: meta‐analytic findings. Psychotherapy, 55, 496-507.
DOI: https://doi.org/10.1037/pst0000189
Heinonen, E., & Nissen-Lie, H. A. (2019). The professional and personal characteristics of effective psychotherapists: a systematic review. Psychotherapy Research, 1-16.
Hillen, M. A., van Vliet, L. M., de Haes, H. C., & Smets, E. M. (2013). Developing and administering scripted video vignettes for experimental research of patient-provider communication. Patient Education and Counseling, 91(3), 295-309.
DOI: https://doi.org/10.1016/j.pec.2013.01.020
Holmqvist, R., Armelius, B.A. (1996). Sources of therapists’ countertransference feelings. Psychotherapy Research, 6(1), 70-78.
DOI: https://doi.org/10.1080/10503309612331331588
Huppert, J. D., Bufka, L. F., Barlow, D. H., Gorman, J. M., Shear, M. K., & Woods, S. W. (2001). Therapists, therapist variables, and cognitive-behavioral therapy outcome in a multicenter trial for panic disorder. Journal of Consulting and Clinical Psychology, 69(5), 747.
DOI: https://doi.org/10.1037/0022-006X.69.5.747
Johns, R. G., Barkham, M., Kellett, S., & Saxon, D. (2019). A systematic review of therapist effects: A critical narrative update and refinement to review. Clinical Psychology Review, 67, 78-93.
DOI: https://doi.org/10.1016/j.cpr.2018.08.004
Kiesler, D. J. & Schmidt, J. A. (2006). The Impact Message Inventory-Circumplex (IMI-C) Manual: Sampler set, manual, test booklet, scoring key, work sheets. Redwood City, CA: Mind Garden.
Kim, D. M., Wampold, B. E., & Bolt, D. M. (2006). Therapist effects in psychotherapy: a random-effects modeling of the National Institute of Mental Health Treatment of Depression Collaborative Research Program data. Psychotherapy Research, 16(02), 161-172.
DOI: https://doi.org/10.1080/10503300500264911
Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159-174.
DOI: https://doi.org/10.2307/2529310
McHugh, M. L. (2012). Interrater reliability: the kappa statistic. Biochemia medica: Biochemia medica, 22(3), 276-282.
DOI: https://doi.org/10.11613/BM.2012.031
Munder, T., Schlipfenbacher, C., Toussaint, K., Warmuth, M., Anderson, T., & Gumz, A. (2019). Facilitative interpersonal skills performance test: Psychometric analysis of a German language version. Journal of Clinical Psychology, 75(12), 2273-2283.
DOI: https://doi.org/10.1002/jclp.22846
Okiishi, J., Lambert, M.J., Eggett, D., Nielsen, L., Dayton, D.D., & Vermeersch, D.A. (2006). An analysis of therapist treatment effects: Toward providing feedback to individual therapists on their clients’ psychotherapy outcome. Journal of Clinical Psychology, 62(9), 1157–1172.
DOI: https://doi.org/10.1002/jclp.20272
Owen, J., Wampold, B. E., Kopta, M., Rousmaniere, T., & Miller, S. D. (2016). As good as it gets? Therapy outcomes of trainees over time. Journal of Counseling Psychology, 63(1), 12.
DOI: https://doi.org/10.1037/cou0000112
Rouquette, A., & Falissard, B. (2011). Sample size requirements for the internal validation of psychiatric scales. International Journal of Methods in Psychiatric Research, 20(4), 235-249.
DOI: https://doi.org/10.1002/mpr.352
Steggles, K., & de Jong, K. (2018). Does therapist emotion regulation moderate their facilitative interpersonal skills? Paper presented at the 49th International Society for Psychotherapy Researh International Annual Meeting, Amsterdam, The Netherlands.
Strupp, H. H. (1993). The Vanderbilt psychotherapy studies: synopsis. Journal of Consulting and Clinical Psychology, 61(3), 431-433.
DOI: https://doi.org/10.1037/0022-006X.61.3.431
Wampold, B. E. (2015). How important are the common factors in psychotherapy? An update. World Psychiatry, 14(3), 270-277.
DOI: https://doi.org/10.1002/wps.20238
Wampold, B. E., & Brown, G. S. J. (2005). Estimating variability in outcomes attributable to therapists: a naturalistic study of outcomes in managed care. Journal of Consulting and Clinical Psychology, 73(5), 914.
DOI: https://doi.org/10.1037/0022-006X.73.5.914
Wampold, B. E., Baldwin, S. A., Holtforth, M. g., & Imel, Z. E. (2017). What characterizes effective therapists? In L. G. Castonguay & C. E. Hill (Eds.), How and why are some therapists better than others?: Understanding therapist effects (pp. 37-53). Washington, DC: American Psychological Association.
Wampold, B. E., & Imel, Z. E. (2015). The great psychotherapy debate: The evidence for what makes psychotherapy work. New York, NY: Routledge.
DOI: https://doi.org/10.4324/9780203582015
Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: the PANAS scales. Journal of Personality and Social Psychology, 54(6), 1063.
DOI: https://doi.org/10.1037/0022-3514.54.6.1063
How to Cite
van Thiel, S., Joosen, M. C., Joki, A.-L., van Dam, A., van der Klink, J. J., & de Jong, K. (2021). Psychometric analysis of the Dutch language Facilitative Interpersonal Skills (FIS) video clips. Research in Psychotherapy: Psychopathology, Process and Outcome, 24(1). https://doi.org/10.4081/ripppo.2021.513
PAGEPress has chosen to apply the Creative Commons Attribution NonCommercial 4.0 International License (CC BY-NC 4.0) to all manuscripts to be published.
Similar Articles
- Michael J. Lambert, Gianluca Lo Coco, Simple methods for enhancing patient outcome in routine care: Measuring, monitoring, and feedback , Research in Psychotherapy: Psychopathology, Process and Outcome: Vol. 16 No. 2 (2013)
- Diego Rocco, Alessandro Gennaro, Francesco De Bei, Diego Zanelli, Valeria Condino, Development and Characteristics of the Therapeutic Alliance in a Short-Term Dynamic Psychotherapy: A Descriptive Case Study , Research in Psychotherapy: Psychopathology, Process and Outcome: Vol. 16 No. 1 (2013)
- Alessandro Talia, Madeleine Miller-Bottome, Rachel Wyner, Peter Lilliengren, Jordan Bate, Patients’ Adult Attachment Interview classification and their experience of the therapeutic relationship: are they associated? , Research in Psychotherapy: Psychopathology, Process and Outcome: Vol. 22 No. 2 (2019)
- Alessandra De Coro, A Final Commentary: Change and Therapeutic Factors in the Short-Term Dynamic Psychotherapy with Mr. C , Research in Psychotherapy: Psychopathology, Process and Outcome: Vol. 16 No. 1 (2013)
- Rolf Sandell, Rating the outcomes of psychotherapy or psychoanalysis using the Change After Psychotherapy (CHAP) scales. Manual and commentary , Research in Psychotherapy: Psychopathology, Process and Outcome: Vol. 18 No. 2 (2015): Special issue on Qualitative and Quantitative Research in Child and Adolescent Psychotherapy: part 1
- Emanuela Saita, Carmine Parrella, Federica Facchin, Floriana Irtelli, The Clinical Use of Photography: A Single Case, Multimethod Study of the Therapeutic Process , Research in Psychotherapy: Psychopathology, Process and Outcome: Vol. 17 No. 1 (2014)
- Hemrie Zalman, Katie Aafjes-van Doorn, Catherine F. Eubanks, Alliance challenges in the treatment of a narcissistic patient: the case of Alex , Research in Psychotherapy: Psychopathology, Process and Outcome: Vol. 22 No. 2 (2019)
- Paul Schröder-Pfeifer, Alessandro Talia, Jana Volkert, Svenja Taubner, Developing an assessment of epistemic trust: a research protocol , Research in Psychotherapy: Psychopathology, Process and Outcome: Vol. 21 No. 3 (2018)
- Annalisa Tanzilli, Michele Majorana, Laura Fonzi, Mauro Pallagrosi, Angelo Picardi, Maria Antonietta Coccanari de’ Fornari, Massimo Biondi, Vittorio Lingiardi, Relational variables in short-term psychodynamic psychotherapy: an effectiveness study , Research in Psychotherapy: Psychopathology, Process and Outcome: Vol. 21 No. 3 (2018)
- Santo Di Nuovo, What research for what training in psychotherapy? Some methodological issues and a proposal , Research in Psychotherapy: Psychopathology, Process and Outcome: Vol. 22 No. 3 (2019)
<< < 16 17 18 19 20 21 22 23 24 25 > >>
You may also start an advanced similarity search for this article.
