Psychometric properties of the Psychological Problem Change Expectancy Scale
Abstract
The Psychological Problem Change Expectancy Scale (PPCES)is an instrument designed to assess the client’s outcome expectations of a psychological treatment. It is based on theAnxiety Change Expectancy Scale (ACES; Dozois & Westra, 2005). The expectancies regarding the psychological change as a treatment outcome expectation are conceptualized as a system of client’s prognostic beliefs about the consequences of participation in some kind of psychological treatment, i.e. the client’s expectation of improvement of his/herstate as a consequence of participation in a psychological treatment. This paper was aimed atevaluating the basic metric characteristics of the ACES adaptation. The adaptationconsisted of translating the items into Serbian language and changing the content in order to generally imply to the psychological problem which had been the reason for a person to seek a professional help. The research incorporated two separate studies. In Study 1, conducted on the sample of 171 clients beginning the psychological treatment, the internal consistency and the latent structure of the scale were investigated by exploratory factor analysis (EFA). In Study 2, conducted on the sample of 240 students participating in ananalogue study, the construct validity was additionally checked by confirmatory factor analysis (CFA). The results of the EFA suggested a high heterogeneity of the scale, while the CFA, due to the impossibility of confirming the original model, suggested a potential shortening of the scale from the initial twenty to eleven items, organized into the bifactor model. The items were organized in two specific factors – change optimism and change pessimism, together with the general factor – treatment outcome expectations. Concurrent validity was confirmed by adequate correlations with the measures of dispositional optimism, self-efficacy and the measures of subjective well-being. It can be concluded that the PPCES scale is a reliable and valid instrument for assessing the expectations of treatment outcomes, but it is more structurally homogeneous in the form of 11 items compared to the initial structure. Because of the specificity of the samples from both studies, future research should additionaly check the structural validity of the PPCES, especially within the clinical population and more homogeneous psychotherapy samples.
References
Ahmed, M., &Westra, H.A. (2009). Impact of a Treatment Rationale on Expectancy and Engagement in Cognitive Behavioral Therapy for Social Anxiety. Cognitive Therapy and Research, 33(3), 314-322. doi:10.1007/s10608-008-9182-1
Ametrano, R.M., Constantino, M.J., &Nalven, T. (2017).The Influence of Expectancy Persuasion Techniques on Socially Anxious Analogue Patients' Treatment Beliefs and Therapeutic Actions. International Journal of Cognitive Therapy, 10(3), 187-205. doi:10.1521/ijct.2017.10.3.187
Arnkoff, D.B., Glass, C.R., & Shapiro, S.J. (2002). Expectations and preferences. U J.C. Norcross (Ur.), Psychotherapy relationships that work: Therapist contributions and responsiveness to patients. New York, NY: Oxford University Pres.. pp. 335-356.
Baldwin, J.M. (1902). Dictionary of Philosophy and Psychology.Volume 2. The American Journal of Psychology, 13(4), 576.doi:10.2307/1412448
Bentler, P.M. (1989). EQS structural equations program model. Los Angeles: BMDP Statistical Software.
Bentler, P.M. (2006). EQS structural equations program manual. Encino, CA: Multivariate Software, Inc..
Bentler, P.M., &Bonett, D.G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88(3), 588-606. doi:10.1037//0033-2909.88.3.588
Brady, J.P., Reznikoff, M., & Zeller, W.W. (1960). The relationship of expectation of improvement to actual improvement of hospitalized psychiatric patients. The Journal of Nervous and Mental Disease, 130(1), 41-44. doi:10.1097/00005053-196001000-00006
Carver, C.S., Scheier, M.F., &Segerstrom, S.C. (2010).Optimism. Clinical Psychology Review, 30(7), 879-889. doi:10.1016/j.cpr.2010.01.006
Cattell, R.B. (1966). The Scree Test For The Number Of Factors. Multivariate Behavioral Research, 1(2), 245-276. doi:10.1207/s15327906mbr0102_10
Chang, E.C., D'Zurilla, T.J., &Maydeu-Olivares, A. (1994). Assessing the dimensionality of optimism and pessimism using a multimeasure approach. Cognitive Therapy and Research, 18(2), 143-160. doi:10.1007/bf02357221
Chang, L., & McBride-Chang, C. (1996). The Factor Structure of the Life Orientation Test. Educational and Psychological Measurement, 56(2), 325-329. doi:10.1177/0013164496056002013
Child, D. (2006). The essentials of factor analysis. New York, NY: Continuum International Publishing Group. 3rd ed..
Clark, L.A., & Watson, D. (1991). Tripartite model of anxiety and depression: Psychometric evidence and taxonomic implications. Journal of Abnormal Psychology, 100(3), 316-336. doi:10.1037//0021-843x.100.3.316
Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences. Hillsdale, N. J.: Lawrence Erlbaum. 2nd ed..
Constantino, M.J., Ametrano, R.M., & Greenberg, R.P. (2012).Clinician interventions and participant characteristics that foster adaptive patient expectations for psychotherapy and psychotherapeutic change. Psychotherapy, 49(4), 557-569. doi:10.1037/a0029440
Norcross, J.C., Constantino, M.J., Glass, C.R., Arnkoff, D.B., Ametrano, R.M., & Smith, J.Z. (2011).Expectations.U Psychotherapy relationships that work: Evidence-based responsiveness. (str. 354-376). Oxford University Press (OUP). doi:10.1093/acprof:oso/9780199737208.003.0018
Constantino, M.J., Penek, S., Bernecker, S.L., &Overtree, C.E. (2014). A preliminary examination of participant characteristics in relation to patients’ treatment beliefs in psychotherapy in a training clinic. Journal of Psychotherapy Integration, 24(3), 238-250. doi:10.1037/a0031424
Cooper, M., & Norcross, J.C. (2016). A brief, multidimensional measure of clients’ therapy preferences: The Cooper-Norcross Inventory of Preferences (C-NIP). International Journal of Clinical and Health Psychology, 16(1), 87-98. doi:10.1016/j.ijchp.2015.08.003
Devilly, G.J., &Borkovec, T.D. (2000). Psychometric properties of the credibility/expectancy questionnaire. Journal of Behavior Therapy and Experimental Psychiatry, 31(2), 73-86. doi:10.1016/s0005-7916(00)00012-4
Diener, E., Emmons, R.A., Larsen, R.J., & Griffin, S. (1985). The Satisfaction With Life Scale. Journal of Personality Assessment, 49(1), 71-75. doi:10.1207/s15327752jpa4901_13
Dozois, D.J.A., &Westra, H.A. (2005). Development of the Anxiety Change Expectancy Scale (ACES) and validation in college, community, and clinical samples. Behaviour Research and Therapy, 43(12), 1655-1672. doi:10.1016/j.brat.2004.12.001
Duncan, B.L., Miller, S.D., & Sparks, J.A. (2004). The heroic client: A revolutionary way to improve effectiveness through client-directed, outcome-informed therapy. San Francisco: Jossey-Bass.(Rev. ed.).
Eddington, K.M., Dozois, D.J.A., & Backs-Dermott, B.J. (2014). Evaluation of the Internal Consistency, Factor Structure, and Validity of the Depression Change Expectancy Scale. Assessment, 21(5), 607-617. doi:10.1177/1073191113517929
Fajgelj, S. (2003). Psihometrija.Metod i teorija psihološkog merenja. Beograd: Centar za primenjenupsihologiju.
Fajgelj, S. (2014). Metode istraživanja ponašanja. Beograd: Centar za primenjenupsihologiju. 6. izdanje.
Frank, J.D., & Frank, J.B. (1991). Persuasion and healing.A comparative study of psychotherapy. Baltimore: Johns Hopkins University Press. 3rd ed.
Frank, J.D. (1961). Persuasion and healing.A comparative study of psychotherapy. Baltimore: Johns Hopkins University Press.
Garfield, S.L. (1994). Research on client variables in psychotherapy.U A.E. Bergin & S.L. Garfield (Ur.), Handbook of psychotherapy and behavior change. NewYork: Wiley. pp. 190-228; 4th ed.
Garfield, S.L., &Wolpin, M. (1963).Expectations regarding psychotherapy. The Journal of Nervous and Mental Disease, 137(4), 353-362. doi:10.1097/00005053-196310000-00007
Gavrilov-Jerković, V., Jovanović, V., Žuljević, D., &Brdarić, D. (2014). When Less is More: A Short Version of the Personal Optimism Scale and the Self-Efficacy Optimism Scale. Journal of Happiness Studies, 15(2), 455-474. doi:10.1007/s10902-013-9432-0
Gignac, G.E., &Szodorai, E.T. (2016).Effect size guidelines for individual differences researchers. Personality and Individual Differences, 102, 74-78. doi:10.1016/j.paid.2016.06.069
Goldfarb, D.E. (2002). College Counseling Center Clients' Expectations About Counseling: How They Relate to Depression, Hopelessness, and Actual-Ideal Self-Discrepancies. Journal of College Counseling, 5(2), 142-152. doi:10.1002/j.2161-1882.2002.tb00216.x
Goldfried, M.R. (1980). Toward the delineation of therapeutic change principles. American Psychologist, 35(11), 991-999. doi:10.1037//0003-066x.35.11.991
Goldstein, A.P. (1960). Patient's expectancies and non-specific therapy as a basis for (UN)spontaneous remission. Journal of Clinical Psychology, 16(4), 399-403. doi:10.1002/1097-4679(196010)16:4<399::aid-jclp2270160416>3.0.co;2-e
Goldstein, A.P. (1960). Therapist and client expectation of personality change in psychotherapy. Journal of Counseling Psychology, 7(3), 180-184.doi:10.1037/h0043998
Goldstein, A.P. (1962). Therapist-patient expectancies in psychotherapy. New York: Pergamon Press.
Goldstein, A.P., & Shipman, W.G. (1961). Patient expectancies, symptom reduction and aspects of the initial psychotherapeutic interview. Journal of Clinical Psychology, 17(2), 129-133. doi:10.1002/1097-4679(196104)17:2<129::aid-jclp2270170207>3.0.co;2-t
Gorsuch, R.L. (1983). Factor analysis. Hillsdale, NJ: Erlbaum. 2nd ed..
Greenberg, R.P., Constantino, M.J., & Bruce, N. (2006). Are patient expectations still relevant for psychotherapy process and outcome. Clinical Psychology Review, 26(6), 657-678. doi:10.1016/j.cpr.2005.03.002
Haanstra, T.M., Tilbury, C., Kamper, S.J., Tordoir, R.L., Vliet, V.T.P.M., Nelissen, R.G.H.H., . . .Ostelo, R.W. (2015). Can Optimism, Pessimism, Hope, Treatment Credibility and Treatment Expectancy Be Distinguished in Patients Undergoing Total Hip and Total Knee Arthroplasty. PLOS ONE, 10(7), 133730. doi:10.1371/journal.pone.0133730
Hancock, G.R., & Mueller, R.O. (2001).Rethinking construct reliability within latent variable systems. U R. Cudeck, (. Toit,& D. Sorbom (Ur.), Structural Equation Modeling: Present and future - A festschrift in honor of Karl Joreskog. Lincolnwood, IL: Scientific Software International. pp. 195-216.
Herzberg, P.Y., Glaesmer, H., & Hoyer, J. (2006). Separating optimism and pessimism: A robust psychometric analysis of the Revised Life Orientation Test (LOT-R). Psychological Assessment, 18(4), 433-438. doi:10.1037/1040-3590.18.4.433
Hsieh, M., Ponsford, J., Wong, D., & McKay, A. (2012). Exploring variables associated with change in cognitive behaviour therapy (CBT) for anxiety following traumatic brain injury. Disability and Rehabilitation, 34(5), 408-415. doi:10.3109/09638288.2011.607219
Hu, L., &Bentler, P.M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3(4), 424-453. doi:10.1037//1082-989x.3.4.424
Hu, L., &Bentler, P.M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55. doi:10.1080/10705519909540118
Ilardi, S.S., & Craighead, W.E. (1994). The Role of Nonspecific Factors in Cognitive-Behavior Therapy for Depression. Clinical Psychology: Science and Practice, 1(2), 138-155. doi:10.1111/j.1468-2850.1994.tb00016.x
Jones, S.L., Hadjistavropoulos, H.D., &Soucy, J.N. (2016). A randomized controlled trial of guided internet-delivered cognitive behaviour therapy for older adults with generalized anxiety. Journal of Anxiety Disorders, 37, 1-9. doi:10.1016/j.janxdis.2015.10.006
Jovanović, V., & Gavrilov-Jerković, V. (2013). Dimensionality and Validity of the Serbian Version of the Life Orientation Test-Revised in a Sample of Youths. Journal of Happiness Studies, 14(3), 771-782. doi:10.1007/s10902-012-9354-2
Jovanović, V., Gavrilov-Jerković, V., Žuljević, D., & Brdarić, D. (2014).Psihometrijska evaluacija Skale depresivnosti, anksioznosti i stresa - 21 (DASS-21) na uzorku studenata u Srbiji / Psychometric evaluation of the depression anxiety stress scales-21 (DASS-21) in a Serbian student sample. Psihologija, 47(1), 93-112. doi:10.2298/psi1401093j
Kirsch, I. (1990). Changing expectations: A key to effective psychotherapy. Belmont, CA: Brooks/Cole.
Kirsch, I. (1999). How expectancies shape experience. U I. Kirsch (Ur.), . Washington: American Psychological Association (APA). doi:10.1037/10332-000
Kline, R.B. (2005). Principles and practices of structural equation modeling. New York: Guilford Press. 2nd ed..
Langley, E.L. (2015). Why do people seek help?, An evaluation of treatment barriers and help-seeking in anxiety disorders. University of Tasmania. Honours thesis.
Lazić, M., Jovanović, V., & Gavrilov-Jerković, V. (2018). The general self-efficacy scale: New evidence of structural validity, measurement invariance, and predictive properties in relationship to subjective well-being in Serbian samples. Current Psychology, doi:10.1007/s12144-018-9992-6
Lovibond, S.H., & Lovibond, P.F. (1995). Manual for the depression anxiety stress scales. Sydney: Psychology Foundation. 2nd ed..
Maddux, J.E., Sherer, M., & Rogers, R.W. (1982). Self-efficacy expectancy and outcome expectancy: Their relationship and their effects on behavioral intentions. Cognitive Therapy and Research, 6(2), 207-211. doi:10.1007/bf01183893
Martin, P.J., & Sterne, A.L. (1975).Prognostic expectations and treatment outcome. Journal of Consulting and Clinical Psychology, 43(4), 572-576. doi:10.1037/h0076886
Maydeu-Olivares, A., & Coffman, D.L. (2006). Random intercept item factor analysis. Psychological Methods, 11(4), 344-362. doi:10.1037/1082-989x.11.4.344
McNeil, D.W., & Hayes, S.E. (2015).Psychotherapy Analog Studies. U R.L. Cautin& S.O. Lilienfeld (Ur.), The Encyclopedia of Clinical Psychology. (str. 1-3). Hoboken, NJ, USA: Wiley. doi:10.1002/9781118625392.wbecp406
Norberg, M.M., Wetterneck, C.T., Sass, D.A., &Kanter, J.W. (2011).Development and psychometric evaluation of the Milwaukee Psychotherapy Expectations Questionnaire. Journal of Clinical Psychology, 67(6), 574-590. doi:10.1002/jclp.20781
Novović, Z., & Mihić. L. (2008). Srpski inventor afekata baziranna Positive and Negative Affect Schedule-X (SIAB-PANAS). Novi Sad: University of Novi Sad. Unpublished manuscript.
Novović, Z., Mihić, L., Tovilović, S., & Jovanović, V. (2008). Relations among positive and negative affect, dysphoria and anxiety1. Psihologija, 41(4), 413-433. doi:10.2298/psi0804413n
Nunnally, J., & Bernstein, I. (1994). Psychometric theory. New York: McGraw-Hill..
Nurosis, M. (1994). Statistical Data Analysis. Chicago: SPSS Inc..
Reise, S.P., Bonifay, W.E., &Haviland, M.G. (2013). Scoring and Modeling Psychological Measures in the Presence of Multidimensionality. Journal of Personality Assessment, 95(2), 129-140. doi:10.1080/00223891.2012.725437
Rodriguez, A., Reise, S.P., &Haviland, M.G. (2016).Applying Bifactor Statistical Indices in the Evaluation of Psychological Measures. Journal of Personality Assessment, 98(3), 223-237. doi:10.1080/00223891.2015.1089249
Rodriguez, A., Reise, S.P., &Haviland, M.G. (2016). Evaluating bifactor models: Calculating and interpreting statistical indices. Psychological Methods, 21(2), 137-150. doi:10.1037/met0000045
Rosenzweig, S. (1936).Some implicit common factors in diverse methods of psychotherapy. American Journal of Orthopsychiatry, 6(3), 412-415. doi:10.1111/j.1939-0025.1936.tb05248.x
Safren, S.A., Heimberg, R.G., &Juster, H.R. (1997).Clients' expectancies and their relationship to pretreatment symptomatology and outcome of cognitive-behavioral group treatment for social phobia. Journal of Consulting and Clinical Psychology, 65(4), 694-698. doi:10.1037//0022-006x.65.4.694
Satorra, A., &Bentler, P.M. (2010).Ensuring Positiveness of the Scaled Difference Chi-square Test Statistic. Psychometrika, 75(2), 243-248. doi:10.1007/s11336-009-9135-y
Satorra, A., &Bentler, P.M. (1994). Corrections to test statistics and standard errors in covariance structure analysis. U A. von Eye & C.C. Clogg (Ur.), Latent variables analysis: Applications for developmental research. Thousand Oaks, CA: Sage. (pp. 399-419).
Scheier, M.F., & Carver, C.S. (1985). Optimism, coping, and health: Assessment and implications of generalized outcome expectancies. Health Psychology, 4(3), 219-247. doi:10.1037//0278-6133.4.3.219
Scheier, M.F., Carver, C.S., & Bridges, M.W. (2001).Optimism, pessimism, and psychological well-being.U E.C. Chang (Ur.), Optimism and pessimism: Implications for theory, research, and practice.. (str. 189-216). Washington: American Psychological Association (APA). doi:10.1037/10385-009
Scholz, U., Gutiérrez, D.B., Sud, S., &Schwarzer, R. (2002). Is General Self-Efficacy a Universal Construct? Psychometric findings from 25 countries. European Journal of Psychological Assessment, 18(3), 242-251. doi:10.1027//1015-5759.18.3.242
Schumacker, R., & Lomax, R. (1996). A Beginner's Guide to Structural Equation Modeling. Mahwah, NJ: Lawrence Earlboum Associates: Inc..
Schwarzer, R. (1994). Optimism, Vulnerability, and self-beliefs as health-related cognitions: A systematic overview. Psychology and Health, 9(3), 161-180. doi:10.1080/08870449408407475
Schwarzer, R., & Jerusalem, M. (1995).Generalized self-efficacy scale.U J. Weinman, S. Wright, & M. Johnston (Ur.), Measures in health psychology: A user's portfolio. Causal and control beliefs. Windsor, UK: NFER-Nelson. pp. 35-37.
Schweizer, K., & Koch, W. (2001).The assessment of components of optimism by POSO-E. Personality and Individual Differences, 31(4), 563-574. doi:10.1016/s0191-8869(00)00161-6
Steiger, J.H. (2016). Notes on the Steiger–Lind (1980) Handout. Structural Equation Modeling: A Multidisciplinary Journal, 23(6), 777-781. doi:10.1080/10705511.2016.1217487
Streiner, D.L. (2003). Starting at the Beginning: An Introduction to Coefficient Alpha and Internal Consistency. Journal of Personality Assessment, 80(1), 99-103. doi:10.1207/s15327752jpa8001_18
Tabachnick, B.G., &Fidell, L.S. (2007). Using multivariate statistics. Boston, MA: Allyn and Bacon. 5th ed..
Tinsley, H.E.A., &Westcot, A.M. (1990). Analysis of the cognitions stimulated by the items on the Expectations About Counseling-Brief Form: An analysis of construct validity. Journal of Counseling Psychology, 37(2), 223-226. doi:10.1037/0022-0167.37.2.223
Tinsley, H.E., Workman, K.R., & Kass, R.A. (1980). Factor analysis of the domain of client expectancies about counseling. Journal of Counseling Psychology, 27(6), 561-570. doi:10.1037//0022-0167.27.6.561
Tsai, M., Ogrodniczuk, J.S., Sochting, I., & Mirmiran, J. (2012).Forecasting Success: Patients' Expectations for Improvement and Their Relations to Baseline, Process and Outcome Variables in Group Cognitive-Behavioural Therapy for Depression. Clinical Psychology and Psychotherapy, 21(2), 97-107. doi:10.1002/cpp.1831
van der Sterren-Kusters, W.J.C., Egger, J.I.M., & van der Heijden, P.T. (2017). Psychometric properties of the Dutch anxiety change expectancy scale (ACES-NL). International Journal of Psychology and Psychological Therapy, 189-198; 17.
Vorstenbosch, V., &Laposa, J.M. (2015).Treatment expectancy for anxiety change and response to cognitive behavioral therapy for OCD. Journal of Obsessive-Compulsive and Related Disorders, 5, 55-60. doi:10.1016/j.jocrd.2015.02.003
Wampold, B.E., &Imel, Z.E. (2015). The great psychotherapy debate: The evidence for what makes the psychotherapy work. Informa UK Limited. doi:10.4324/9780203582015
Watson, D., & Clark, L.A. (1994). The PANAS-X: Manual for the Positive and Negative Affect Schedule-Expanded Form. Ames: The University of Iowa. doi:10.17077/48vt-m4t2
Weems, C.F. (2006). The Anxiety Change Expectancy Scale score shows high internal validity and correlation with validated measures of anxiety, self-esteem, and hopelessness in varied settings. Evidence-Based Mental Health, 9(3), 66-66. doi:10.1136/ebmh.9.3.66
Weinberger, J., &Eig, A. (1999). Expectancies: The ignored common factor in psychotherapy. U I. Kirsch (Ur.), How expectancies shape experience.. (str. 357-382). Washington: American Psychological Association (APA). doi:10.1037/10332-015
Westra, H.A., Arkowitz, H., &Dozois, D.J.A. (2009).Adding a motivational interviewing pretreatment to cognitive behavioral therapy for generalized anxiety disorder: A preliminary randomized controlled trial. Journal of Anxiety Disorders, 23(8), 1106-1117. doi:10.1016/j.janxdis.2009.07.014
Westra, H.A., Dozois, D.J.A., & Marcus, M. (2007).Expectancy, homework compliance, and initial change in cognitive-behavioral therapy for anxiety. Journal of Consulting and Clinical Psychology, 75(3), 363-373. doi:10.1037/0022-006x.75.3.363
Wolpe, J. (1981). Reciprocal inhibition and therapeutic change. Journal of Behavior Therapy and Experimental Psychiatry, 12(3), 185-188. doi:10.1016/0005-7916(81)90044-6
Yong, A.G., & Pearce, S. (2013). A Beginner’s Guide to Factor Analysis: Focusing on Exploratory Factor Analysis. Tutorials in Quantitative Methods for Psychology, 9(2), 79-94. doi:10.20982/tqmp.09.2.p079
Authors retain the copyright of the published papers and grant to the publisher the nonexclusive right to publish the article, to be cited as its original publisher in case of re-use, and to distribute it in all forms and media. The published articles will be distributed under the Creative Commons Attribution ShareAlike 4.0 International license (CC BY-SA). It is allowed to copy and redistribute the material in any medium or format, and remix, transform and build upon it for any purpose, even commercially, as long as appropriate credit is given to the original
author(s), a link to the license is provided, it is indicated if changes were made and the new work is distributed under the same license as the original. Authors are permitted to deposit the author’s publisher’s version (PDF) of their work in an institutional repository, subject-based repository, author’s personal website (including social networking sites, such as ResearchGate, Academia.edu, etc.), and/or departmental website at any time after publication, with an acknowledgment of its initial publication in this journal.