Psychometric properties of the Psychological Problem Change Expectancy Scale

  • Dragan Žuljević Faculty of Law and Business Dr Lazar Vrkatić, Novi Sad
  • Nikolija Rakočević University of Novi Sad, Faculty of Philosophy, Department of psychology
  • Vesna Gavrilov Jerković University of Novi Sad, Faculty of Philosophy, Department of psychology
Keywords: Psychological Problem Change Expectancy Scale, psychometric properties, Serbia,

Abstract


The Psychological Problem Change Expectancy Scale (PPCES)is an instrument designed to assess the client’s outcome expectations of a psychological treatment. It is based on theAnxiety Change Expectancy Scale (ACES; Dozois & Westra, 2005). The expectancies regarding the psychological change as a treatment outcome expectation are conceptualized as a system of client’s prognostic beliefs about the consequences of participation in some kind of psychological treatment, i.e. the client’s expectation of improvement of his/herstate as a consequence of participation in a psychological treatment. This paper was aimed atevaluating the basic metric characteristics of the ACES adaptation. The adaptationconsisted of translating the items into Serbian language and changing the content in order to generally imply to the psychological problem which had been the reason for a person to seek a professional help. The research incorporated two separate studies. In Study 1, conducted on the sample of 171 clients beginning the psychological treatment, the internal consistency and the latent structure of the scale were investigated by exploratory factor analysis (EFA). In Study 2, conducted on the sample of 240 students participating in ananalogue study, the construct validity was additionally checked by confirmatory factor analysis (CFA). The results of the EFA suggested a high heterogeneity of the scale, while the CFA, due to the impossibility of confirming the original model, suggested a potential shortening of the scale from the initial twenty to eleven items, organized into the bifactor model. The items were organized in two specific factors – change optimism and change pessimism, together with the general factor – treatment outcome expectations. Concurrent validity was confirmed by adequate correlations with the measures of dispositional optimism, self-efficacy and  the measures of subjective well-being. It can be concluded that the PPCES scale is a reliable and valid instrument for assessing the expectations of treatment outcomes, but it is more structurally homogeneous in the form of 11 items compared to the initial structure. Because of the specificity of the samples from both studies, future research should additionaly check the structural validity of the PPCES, especially within the clinical population and more homogeneous psychotherapy samples.

References

Ahmed, M., &Westra, H.A. (2009). Impact of a Treatment Rationale on Expectancy and Engagement in Cognitive Behavioral Therapy for Social Anxiety. Cognitive Therapy and Research, 33(3), 314-322. doi:10.1007/s10608-008-9182-1

Ametrano, R.M., Constantino, M.J., &Nalven, T. (2017).The Influence of Expectancy Persuasion Techniques on Socially Anxious Analogue Patients' Treatment Beliefs and Therapeutic Actions. International Journal of Cognitive Therapy, 10(3), 187-205. doi:10.1521/ijct.2017.10.3.187

Arnkoff, D.B., Glass, C.R., & Shapiro, S.J. (2002). Expectations and preferences. U J.C. Norcross (Ur.), Psychotherapy relationships that work: Therapist contributions and responsiveness to patients. New York, NY: Oxford University Pres.. pp. 335-356.

Baldwin, J.M. (1902). Dictionary of Philosophy and Psychology.Volume 2. The American Journal of Psychology, 13(4), 576.doi:10.2307/1412448

Bentler, P.M. (1989). EQS structural equations program model. Los Angeles: BMDP Statistical Software.

Bentler, P.M. (2006). EQS structural equations program manual. Encino, CA: Multivariate Software, Inc..

Bentler, P.M., &Bonett, D.G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88(3), 588-606. doi:10.1037//0033-2909.88.3.588

Brady, J.P., Reznikoff, M., & Zeller, W.W. (1960). The relationship of expectation of improvement to actual improvement of hospitalized psychiatric patients. The Journal of Nervous and Mental Disease, 130(1), 41-44. doi:10.1097/00005053-196001000-00006

Carver, C.S., Scheier, M.F., &Segerstrom, S.C. (2010).Optimism. Clinical Psychology Review, 30(7), 879-889. doi:10.1016/j.cpr.2010.01.006

Cattell, R.B. (1966). The Scree Test For The Number Of Factors. Multivariate Behavioral Research, 1(2), 245-276. doi:10.1207/s15327906mbr0102_10

Chang, E.C., D'Zurilla, T.J., &Maydeu-Olivares, A. (1994). Assessing the dimensionality of optimism and pessimism using a multimeasure approach. Cognitive Therapy and Research, 18(2), 143-160. doi:10.1007/bf02357221

Chang, L., & McBride-Chang, C. (1996). The Factor Structure of the Life Orientation Test. Educational and Psychological Measurement, 56(2), 325-329. doi:10.1177/0013164496056002013

Child, D. (2006). The essentials of factor analysis. New York, NY: Continuum International Publishing Group. 3rd ed..

Clark, L.A., & Watson, D. (1991). Tripartite model of anxiety and depression: Psychometric evidence and taxonomic implications. Journal of Abnormal Psychology, 100(3), 316-336. doi:10.1037//0021-843x.100.3.316

Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences. Hillsdale, N. J.: Lawrence Erlbaum. 2nd ed..

Constantino, M.J., Ametrano, R.M., & Greenberg, R.P. (2012).Clinician interventions and participant characteristics that foster adaptive patient expectations for psychotherapy and psychotherapeutic change. Psychotherapy, 49(4), 557-569. doi:10.1037/a0029440

Norcross, J.C., Constantino, M.J., Glass, C.R., Arnkoff, D.B., Ametrano, R.M., & Smith, J.Z. (2011).Expectations.U Psychotherapy relationships that work: Evidence-based responsiveness. (str. 354-376). Oxford University Press (OUP). doi:10.1093/acprof:oso/9780199737208.003.0018

Constantino, M.J., Penek, S., Bernecker, S.L., &Overtree, C.E. (2014). A preliminary examination of participant characteristics in relation to patients’ treatment beliefs in psychotherapy in a training clinic. Journal of Psychotherapy Integration, 24(3), 238-250. doi:10.1037/a0031424

Cooper, M., & Norcross, J.C. (2016). A brief, multidimensional measure of clients’ therapy preferences: The Cooper-Norcross Inventory of Preferences (C-NIP). International Journal of Clinical and Health Psychology, 16(1), 87-98. doi:10.1016/j.ijchp.2015.08.003

Devilly, G.J., &Borkovec, T.D. (2000). Psychometric properties of the credibility/expectancy questionnaire. Journal of Behavior Therapy and Experimental Psychiatry, 31(2), 73-86. doi:10.1016/s0005-7916(00)00012-4

Diener, E., Emmons, R.A., Larsen, R.J., & Griffin, S. (1985). The Satisfaction With Life Scale. Journal of Personality Assessment, 49(1), 71-75. doi:10.1207/s15327752jpa4901_13

Dozois, D.J.A., &Westra, H.A. (2005). Development of the Anxiety Change Expectancy Scale (ACES) and validation in college, community, and clinical samples. Behaviour Research and Therapy, 43(12), 1655-1672. doi:10.1016/j.brat.2004.12.001

Duncan, B.L., Miller, S.D., & Sparks, J.A. (2004). The heroic client: A revolutionary way to improve effectiveness through client-directed, outcome-informed therapy. San Francisco: Jossey-Bass.(Rev. ed.).

Eddington, K.M., Dozois, D.J.A., & Backs-Dermott, B.J. (2014). Evaluation of the Internal Consistency, Factor Structure, and Validity of the Depression Change Expectancy Scale. Assessment, 21(5), 607-617. doi:10.1177/1073191113517929

Fajgelj, S. (2003). Psihometrija.Metod i teorija psihološkog merenja. Beograd: Centar za primenjenupsihologiju.

Fajgelj, S. (2014). Metode istraživanja ponašanja. Beograd: Centar za primenjenupsihologiju. 6. izdanje.

Frank, J.D., & Frank, J.B. (1991). Persuasion and healing.A comparative study of psychotherapy. Baltimore: Johns Hopkins University Press. 3rd ed.

Frank, J.D. (1961). Persuasion and healing.A comparative study of psychotherapy. Baltimore: Johns Hopkins University Press.

Garfield, S.L. (1994). Research on client variables in psychotherapy.U A.E. Bergin & S.L. Garfield (Ur.), Handbook of psychotherapy and behavior change. NewYork: Wiley. pp. 190-228; 4th ed.

Garfield, S.L., &Wolpin, M. (1963).Expectations regarding psychotherapy. The Journal of Nervous and Mental Disease, 137(4), 353-362. doi:10.1097/00005053-196310000-00007

Gavrilov-Jerković, V., Jovanović, V., Žuljević, D., &Brdarić, D. (2014). When Less is More: A Short Version of the Personal Optimism Scale and the Self-Efficacy Optimism Scale. Journal of Happiness Studies, 15(2), 455-474. doi:10.1007/s10902-013-9432-0

Gignac, G.E., &Szodorai, E.T. (2016).Effect size guidelines for individual differences researchers. Personality and Individual Differences, 102, 74-78. doi:10.1016/j.paid.2016.06.069

Goldfarb, D.E. (2002). College Counseling Center Clients' Expectations About Counseling: How They Relate to Depression, Hopelessness, and Actual-Ideal Self-Discrepancies. Journal of College Counseling, 5(2), 142-152. doi:10.1002/j.2161-1882.2002.tb00216.x

Goldfried, M.R. (1980). Toward the delineation of therapeutic change principles. American Psychologist, 35(11), 991-999. doi:10.1037//0003-066x.35.11.991

Goldstein, A.P. (1960). Patient's expectancies and non-specific therapy as a basis for (UN)spontaneous remission. Journal of Clinical Psychology, 16(4), 399-403. doi:10.1002/1097-4679(196010)16:4<399::aid-jclp2270160416>3.0.co;2-e

Goldstein, A.P. (1960). Therapist and client expectation of personality change in psychotherapy. Journal of Counseling Psychology, 7(3), 180-184.doi:10.1037/h0043998

Goldstein, A.P. (1962). Therapist-patient expectancies in psychotherapy. New York: Pergamon Press.

Goldstein, A.P., & Shipman, W.G. (1961). Patient expectancies, symptom reduction and aspects of the initial psychotherapeutic interview. Journal of Clinical Psychology, 17(2), 129-133. doi:10.1002/1097-4679(196104)17:2<129::aid-jclp2270170207>3.0.co;2-t

Gorsuch, R.L. (1983). Factor analysis. Hillsdale, NJ: Erlbaum. 2nd ed..

Greenberg, R.P., Constantino, M.J., & Bruce, N. (2006). Are patient expectations still relevant for psychotherapy process and outcome. Clinical Psychology Review, 26(6), 657-678. doi:10.1016/j.cpr.2005.03.002

Haanstra, T.M., Tilbury, C., Kamper, S.J., Tordoir, R.L., Vliet, V.T.P.M., Nelissen, R.G.H.H., . . .Ostelo, R.W. (2015). Can Optimism, Pessimism, Hope, Treatment Credibility and Treatment Expectancy Be Distinguished in Patients Undergoing Total Hip and Total Knee Arthroplasty. PLOS ONE, 10(7), 133730. doi:10.1371/journal.pone.0133730

Hancock, G.R., & Mueller, R.O. (2001).Rethinking construct reliability within latent variable systems. U R. Cudeck, (. Toit,& D. Sorbom (Ur.), Structural Equation Modeling: Present and future - A festschrift in honor of Karl Joreskog. Lincolnwood, IL: Scientific Software International. pp. 195-216.

Herzberg, P.Y., Glaesmer, H., & Hoyer, J. (2006). Separating optimism and pessimism: A robust psychometric analysis of the Revised Life Orientation Test (LOT-R). Psychological Assessment, 18(4), 433-438. doi:10.1037/1040-3590.18.4.433

Hsieh, M., Ponsford, J., Wong, D., & McKay, A. (2012). Exploring variables associated with change in cognitive behaviour therapy (CBT) for anxiety following traumatic brain injury. Disability and Rehabilitation, 34(5), 408-415. doi:10.3109/09638288.2011.607219

Hu, L., &Bentler, P.M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3(4), 424-453. doi:10.1037//1082-989x.3.4.424

Hu, L., &Bentler, P.M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55. doi:10.1080/10705519909540118

Ilardi, S.S., & Craighead, W.E. (1994). The Role of Nonspecific Factors in Cognitive-Behavior Therapy for Depression. Clinical Psychology: Science and Practice, 1(2), 138-155. doi:10.1111/j.1468-2850.1994.tb00016.x

Jones, S.L., Hadjistavropoulos, H.D., &Soucy, J.N. (2016). A randomized controlled trial of guided internet-delivered cognitive behaviour therapy for older adults with generalized anxiety. Journal of Anxiety Disorders, 37, 1-9. doi:10.1016/j.janxdis.2015.10.006

Jovanović, V., & Gavrilov-Jerković, V. (2013). Dimensionality and Validity of the Serbian Version of the Life Orientation Test-Revised in a Sample of Youths. Journal of Happiness Studies, 14(3), 771-782. doi:10.1007/s10902-012-9354-2

Jovanović, V., Gavrilov-Jerković, V., Žuljević, D., & Brdarić, D. (2014).Psihometrijska evaluacija Skale depresivnosti, anksioznosti i stresa - 21 (DASS-21) na uzorku studenata u Srbiji / Psychometric evaluation of the depression anxiety stress scales-21 (DASS-21) in a Serbian student sample. Psihologija, 47(1), 93-112. doi:10.2298/psi1401093j

Kirsch, I. (1990). Changing expectations: A key to effective psychotherapy. Belmont, CA: Brooks/Cole.

Kirsch, I. (1999). How expectancies shape experience. U I. Kirsch (Ur.), . Washington: American Psychological Association (APA). doi:10.1037/10332-000

Kline, R.B. (2005). Principles and practices of structural equation modeling. New York: Guilford Press. 2nd ed..

Langley, E.L. (2015). Why do people seek help?, An evaluation of treatment barriers and help-seeking in anxiety disorders. University of Tasmania. Honours thesis.

Lazić, M., Jovanović, V., & Gavrilov-Jerković, V. (2018). The general self-efficacy scale: New evidence of structural validity, measurement invariance, and predictive properties in relationship to subjective well-being in Serbian samples. Current Psychology, doi:10.1007/s12144-018-9992-6

Lovibond, S.H., & Lovibond, P.F. (1995). Manual for the depression anxiety stress scales. Sydney: Psychology Foundation. 2nd ed..

Maddux, J.E., Sherer, M., & Rogers, R.W. (1982). Self-efficacy expectancy and outcome expectancy: Their relationship and their effects on behavioral intentions. Cognitive Therapy and Research, 6(2), 207-211. doi:10.1007/bf01183893

Martin, P.J., & Sterne, A.L. (1975).Prognostic expectations and treatment outcome. Journal of Consulting and Clinical Psychology, 43(4), 572-576. doi:10.1037/h0076886

Maydeu-Olivares, A., & Coffman, D.L. (2006). Random intercept item factor analysis. Psychological Methods, 11(4), 344-362. doi:10.1037/1082-989x.11.4.344

McNeil, D.W., & Hayes, S.E. (2015).Psychotherapy Analog Studies. U R.L. Cautin& S.O. Lilienfeld (Ur.), The Encyclopedia of Clinical Psychology. (str. 1-3). Hoboken, NJ, USA: Wiley. doi:10.1002/9781118625392.wbecp406

Norberg, M.M., Wetterneck, C.T., Sass, D.A., &Kanter, J.W. (2011).Development and psychometric evaluation of the Milwaukee Psychotherapy Expectations Questionnaire. Journal of Clinical Psychology, 67(6), 574-590. doi:10.1002/jclp.20781

Novović, Z., & Mihić. L. (2008). Srpski inventor afekata baziranna Positive and Negative Affect Schedule-X (SIAB-PANAS). Novi Sad: University of Novi Sad. Unpublished manuscript.

Novović, Z., Mihić, L., Tovilović, S., & Jovanović, V. (2008). Relations among positive and negative affect, dysphoria and anxiety1. Psihologija, 41(4), 413-433. doi:10.2298/psi0804413n

Nunnally, J., & Bernstein, I. (1994). Psychometric theory. New York: McGraw-Hill..

Nurosis, M. (1994). Statistical Data Analysis. Chicago: SPSS Inc..

Reise, S.P., Bonifay, W.E., &Haviland, M.G. (2013). Scoring and Modeling Psychological Measures in the Presence of Multidimensionality. Journal of Personality Assessment, 95(2), 129-140. doi:10.1080/00223891.2012.725437

Rodriguez, A., Reise, S.P., &Haviland, M.G. (2016).Applying Bifactor Statistical Indices in the Evaluation of Psychological Measures. Journal of Personality Assessment, 98(3), 223-237. doi:10.1080/00223891.2015.1089249

Rodriguez, A., Reise, S.P., &Haviland, M.G. (2016). Evaluating bifactor models: Calculating and interpreting statistical indices. Psychological Methods, 21(2), 137-150. doi:10.1037/met0000045

Rosenzweig, S. (1936).Some implicit common factors in diverse methods of psychotherapy. American Journal of Orthopsychiatry, 6(3), 412-415. doi:10.1111/j.1939-0025.1936.tb05248.x

Safren, S.A., Heimberg, R.G., &Juster, H.R. (1997).Clients' expectancies and their relationship to pretreatment symptomatology and outcome of cognitive-behavioral group treatment for social phobia. Journal of Consulting and Clinical Psychology, 65(4), 694-698. doi:10.1037//0022-006x.65.4.694

Satorra, A., &Bentler, P.M. (2010).Ensuring Positiveness of the Scaled Difference Chi-square Test Statistic. Psychometrika, 75(2), 243-248. doi:10.1007/s11336-009-9135-y

Satorra, A., &Bentler, P.M. (1994). Corrections to test statistics and standard errors in covariance structure analysis. U A. von Eye & C.C. Clogg (Ur.), Latent variables analysis: Applications for developmental research. Thousand Oaks, CA: Sage. (pp. 399-419).

Scheier, M.F., & Carver, C.S. (1985). Optimism, coping, and health: Assessment and implications of generalized outcome expectancies. Health Psychology, 4(3), 219-247. doi:10.1037//0278-6133.4.3.219

Scheier, M.F., Carver, C.S., & Bridges, M.W. (2001).Optimism, pessimism, and psychological well-being.U E.C. Chang (Ur.), Optimism and pessimism: Implications for theory, research, and practice.. (str. 189-216). Washington: American Psychological Association (APA). doi:10.1037/10385-009

Scholz, U., Gutiérrez, D.B., Sud, S., &Schwarzer, R. (2002). Is General Self-Efficacy a Universal Construct? Psychometric findings from 25 countries. European Journal of Psychological Assessment, 18(3), 242-251. doi:10.1027//1015-5759.18.3.242

Schumacker, R., & Lomax, R. (1996). A Beginner's Guide to Structural Equation Modeling. Mahwah, NJ: Lawrence Earlboum Associates: Inc..

Schwarzer, R. (1994). Optimism, Vulnerability, and self-beliefs as health-related cognitions: A systematic overview. Psychology and Health, 9(3), 161-180. doi:10.1080/08870449408407475

Schwarzer, R., & Jerusalem, M. (1995).Generalized self-efficacy scale.U J. Weinman, S. Wright, & M. Johnston (Ur.), Measures in health psychology: A user's portfolio. Causal and control beliefs. Windsor, UK: NFER-Nelson. pp. 35-37.

Schweizer, K., & Koch, W. (2001).The assessment of components of optimism by POSO-E. Personality and Individual Differences, 31(4), 563-574. doi:10.1016/s0191-8869(00)00161-6

Steiger, J.H. (2016). Notes on the Steiger–Lind (1980) Handout. Structural Equation Modeling: A Multidisciplinary Journal, 23(6), 777-781. doi:10.1080/10705511.2016.1217487

Streiner, D.L. (2003). Starting at the Beginning: An Introduction to Coefficient Alpha and Internal Consistency. Journal of Personality Assessment, 80(1), 99-103. doi:10.1207/s15327752jpa8001_18

Tabachnick, B.G., &Fidell, L.S. (2007). Using multivariate statistics. Boston, MA: Allyn and Bacon. 5th ed..

Tinsley, H.E.A., &Westcot, A.M. (1990). Analysis of the cognitions stimulated by the items on the Expectations About Counseling-Brief Form: An analysis of construct validity. Journal of Counseling Psychology, 37(2), 223-226. doi:10.1037/0022-0167.37.2.223

Tinsley, H.E., Workman, K.R., & Kass, R.A. (1980). Factor analysis of the domain of client expectancies about counseling. Journal of Counseling Psychology, 27(6), 561-570. doi:10.1037//0022-0167.27.6.561

Tsai, M., Ogrodniczuk, J.S., Sochting, I., & Mirmiran, J. (2012).Forecasting Success: Patients' Expectations for Improvement and Their Relations to Baseline, Process and Outcome Variables in Group Cognitive-Behavioural Therapy for Depression. Clinical Psychology and Psychotherapy, 21(2), 97-107. doi:10.1002/cpp.1831

van der Sterren-Kusters, W.J.C., Egger, J.I.M., & van der Heijden, P.T. (2017). Psychometric properties of the Dutch anxiety change expectancy scale (ACES-NL). International Journal of Psychology and Psychological Therapy, 189-198; 17.

Vorstenbosch, V., &Laposa, J.M. (2015).Treatment expectancy for anxiety change and response to cognitive behavioral therapy for OCD. Journal of Obsessive-Compulsive and Related Disorders, 5, 55-60. doi:10.1016/j.jocrd.2015.02.003

Wampold, B.E., &Imel, Z.E. (2015). The great psychotherapy debate: The evidence for what makes the psychotherapy work. Informa UK Limited. doi:10.4324/9780203582015

Watson, D., & Clark, L.A. (1994). The PANAS-X: Manual for the Positive and Negative Affect Schedule-Expanded Form. Ames: The University of Iowa. doi:10.17077/48vt-m4t2

Weems, C.F. (2006). The Anxiety Change Expectancy Scale score shows high internal validity and correlation with validated measures of anxiety, self-esteem, and hopelessness in varied settings. Evidence-Based Mental Health, 9(3), 66-66. doi:10.1136/ebmh.9.3.66

Weinberger, J., &Eig, A. (1999). Expectancies: The ignored common factor in psychotherapy. U I. Kirsch (Ur.), How expectancies shape experience.. (str. 357-382). Washington: American Psychological Association (APA). doi:10.1037/10332-015

Westra, H.A., Arkowitz, H., &Dozois, D.J.A. (2009).Adding a motivational interviewing pretreatment to cognitive behavioral therapy for generalized anxiety disorder: A preliminary randomized controlled trial. Journal of Anxiety Disorders, 23(8), 1106-1117. doi:10.1016/j.janxdis.2009.07.014

Westra, H.A., Dozois, D.J.A., & Marcus, M. (2007).Expectancy, homework compliance, and initial change in cognitive-behavioral therapy for anxiety. Journal of Consulting and Clinical Psychology, 75(3), 363-373. doi:10.1037/0022-006x.75.3.363

Wolpe, J. (1981). Reciprocal inhibition and therapeutic change. Journal of Behavior Therapy and Experimental Psychiatry, 12(3), 185-188. doi:10.1016/0005-7916(81)90044-6

Yong, A.G., & Pearce, S. (2013). A Beginner’s Guide to Factor Analysis: Focusing on Exploratory Factor Analysis. Tutorials in Quantitative Methods for Psychology, 9(2), 79-94. doi:10.20982/tqmp.09.2.p079

Published
2020/01/14
Section
Scientific Articles