Psychometric Properties of a Peruvian Translation of the Valuing Questionnaire (P-VQ): An Exploratory Structural Equation Modelling Approach

Main Article Content

Alvaro Okumura-Clark
Ángel Christopher Zegarra-López

Abstract

Values-based behavior is a highly studied concept and presents difficulty assessment within the Acceptance and Commitment Therapy’s framework. As a result, the present study sought to psychometrically adapt the P-VQ in a sample of 368 adults, as it was a preliminary proposal. Validity evidence based on test content (analysis of representativeness of each item) and based on the relationship with other variables (concurrent, divergent, and incremental validity) were obtained satisfactorily. Exploratory Structural Equation Modelling analyses supported evidence in favor of a two-dimensional latent structure with a better fit compared to previous Confirmatory Factor Analysis proposals. Reliability analysis (Alpha and Omega) demonstrated significant degrees of internal consistency. The invariance of the measurement (configurational, metric, scalar, and strict) regarding gender was obtained as evidence of equity. In conclusion, P-VQ demonstrated excellent psychometric properties with respect to validity, reliability, and fairness.

Article Details

How to Cite
Psychometric Properties of a Peruvian Translation of the Valuing Questionnaire (P-VQ): An Exploratory Structural Equation Modelling Approach. (2023). Argentinean Journal of Behavioral Sciences, 15(3), 56-71. https://doi.org/10.32348/1852.4206.v15.n3.36469
Section
Technical or Methodological Articles

How to Cite

Psychometric Properties of a Peruvian Translation of the Valuing Questionnaire (P-VQ): An Exploratory Structural Equation Modelling Approach. (2023). Argentinean Journal of Behavioral Sciences, 15(3), 56-71. https://doi.org/10.32348/1852.4206.v15.n3.36469

References

Abdollah, O., Saeid, A., & Hamidreza, H. (2018). Adaptation and factor structure of Valuing Questionnaire in Acceptance and Commitment Therapy approach. Training measurement, 8(32), 85-101. https://www.sid.ir/en/journal/ViewPaper.aspx?ID=744086

Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1), 131–142. https://doi.org/10.1177/0013164485451012

American Educational Research Association, American Psychological Association, & National Council on Measurement in Education (2014). Standards for educational and psychological testing. American Educational Research Association.

Arch, J., Eifert, G. H., Davies, C., Plumb Vilardaga, J. C., Rose, R. D., & Craske, M. G. (2012). Randomized clinical trial of cognitive behavioral therapy (CBT) versus acceptance and commitment therapy (ACT) for mixed anxiety disorders. Journal of Consulting and Clinical Psychology, 80(5), 750–765. https://doi.org/10.1037/a0028310

Asparouhov, T., & Muthén, B. (2009). Exploratory structural equation modeling. Structural Equation Modeling: A Multidisciplinary Journal, 16(3), 397–438. https://doi.org/10.1080/10705510903008204

Aydin, Y., & Aydın, G. (2017). Adaptation of Valuing Questionnaire (VQ) into Turkish culture. Bant İzzet Baysal Üniversitesi Eğitim Fakültesi Dergisi, 17(1), 64-77. https://doi.org/10.17240/aibuefd.2017.17.28551-304621

Bach, P. A., & Moran, D. J. (2008). ACT in practice. Case conceptualization in Acceptance & Commitment Therapy. New Harbinger Publications.

Bandalos, D. L., & Finney, S. J. (2018). Factor analysis: Exploratory and confirmatory. En G. R. Hancock & R. O. Mueller (Eds.), The reviewer’s guide to quantitative methods in the Social Sciences (pp. 93-114). Routledge.

Bond, F. W., Hayes, S. C., Baer, R. A., Carpenter, K. M., Guenole, N., Orcutt, H. K., Waltz, T., & Zettle, R. D. (2011). Preliminary psychometric properties of the Acceptance and Action Questionnaire – II: A revised measure of psychological inflexibility and experiential avoidance. Behavior Therapy, 42(4), 676–688. https://doi.org/10.1016/j.beth.2011.03.007

Brown, T. A. (2015). Confirmatory factor analysis applied research (2nd ed.). The Guilford Press.

Browne, M. W. (2001). An overview of analytic rotation in exploratory factor analysis. Multivariate Behavioral Research, 36(1), 111–150. https://doi.org/10.1207/s15327906mbr3601_05

Carvalho, S. A., Palmeira, L., Pinto-Gouveia, J., Gillanders, D., & Castilho, P. (2018). The utility of the Valuing Questionnaire in chronic pain. Journal of Contextual Behavioral Science, 9, 21-29. https://doi.org/10.1016/j.jcbs.2018.06.002

Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464–504. https://doi.org/10.1080/10705510701301834

Cho, E. (2016). Making reliability reliable: A Systematic Approach to Reliability Coefficients. Organizational Research Methods, 19(4), 651–682. https://doi.org/10.1177/1094428116656239

Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155–159. https://doi.org/10.1037/0033-2909.112.1.155

Dahl, J. C., Plumb, J. C., Stewart, I., & Lundgren, T. (2009). The art and science of valuing in psychotherapy. New Harbinger Publications.

Dahl, J. C., Wilson, K. G., Luciano, C., & Hayes, S. C. (2005). Acceptance and Commitment Therapy for chronic pain. New Harbinger Publications.

Davis, L. (1992). Instrument review: getting the most from a panel of experts. Applied Nursing Research, 5(4), 194-197. https://doi.org/10.1016/S0897-1897(05)80008-4

Devlieger, I., & Rosseel, Y. (2017). Factor score path analysis. An alternative for SEM? Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 13(1), 31-38. https://doi.org/10.1027/1614-2241/a000130

Devlieger, I., Talloen, W., & Rosseel, Y. (2019). New developments in factor score regression: Fit indices and a model comparison test. Educational and Psychological Measurement, 79(6), 1017-1037. https://doi.org/10.1177/0013164419844552

Diener, E., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The Satisfaction with Life Scale. Journal of Personality Assessment, 49(1), 71-75. https://doi.org/10.1207/s15327752jpa4901_13

DiStefano, C., Zhu, M., & Mîndrilã, D. (2009). Understanding and using factor scores: Considerations for the applied researcher. Practical Assessment, Research & Evaluation, 14, 20. https://doi.org/10.7275/da8t-4g52

Doi, S., Sakano, A., Muto, T., & Sakano, Y. (2017). Reliability and validity of a Japanese version of the Valuing Questionnaire. Japanese Journal of Behavior Therapy, 43(1), 83-94. https://doi.org/10.24468/jjbt.16-170

Dunn, T. J., Baguley, T., & Brunsden, V. (2013). From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology, 105(3), 399–412. https://doi.org/10.1111/bjop.12046

Edwards, K. A., & Vowles, K. E. (2020). Acceptance and Action Questionnaire – II Confirmatory factor analysis and measurement invariance between Non-Hispanic White and Hispanic/Latinx undergraduates. Journal of Contextual Behavioral Science, 17, 32-38. https://doi.org/10.1016/j.jcbs.2020.05.003

Falk, C. F., & Savalei, V. (2011). The relationship between unstandardized and standardized alpha, true reliability, and the underlying measurement model. Journal of Personality Assessment, 93(5), 445–453. https://doi.org/10.1080/00223891.2011.594129

Forman, E. M., Herbert, J. D., Moitra, E., Yeomans, P. D., & Geller, P. A. (2007). A randomized controlled effectiveness trial of Acceptance and Commitment Therapy and Cognitive Therapy for Anxiety and Depression. Behavior Modification, 31(6), 772–799. https://doi.org/10.1177/0145445507302202

Gargurevich, R. (2010). Propiedades psicométricas de la versión internacional de la Escala de Afecto Positivo y Negativo-forma corta (I- Spanas SF) en estudiantes universitarios. Persona, 13, 31-42. https://doi.org/10.26439/persona2010.n013.263

Gillanders, D. T., Bolderston, H., Bond, F. W., Dempster, M., Flaxman, P. E., Campbell, L., Kerr, S., Tansey, L., Noel, P., Ferenbach, C., Masley, S., Roach, L., Lloyd, J., May, L., Clarke, S., & Remington, B. (2014). The development and initial validation of the Cognitive Fusion Questionnaire. Behavior Therapy, 45(1), 83-101. https://doi.org/10.1016/J.BETH.2013.09.001

Gomes, C. M. A., Almeida, L. S., & Núñez, J. C. (2017). Rationale and applicability of exploratory structural equation modeling (ESEM) in psychoeducational contexts. Psicothema, 29(3), 396-401. https://doi.org/10.7334/psicothema2016.369

Harris, R. (2009). ACT made simple: An easy-to-read primer on Acceptance and Commitment Therapy. New Harbinger Publications.

Hasani, J. H., Hasani, R., & Niaei, A. (2017). The effectiveness of Acceptance and Commitment Therapy in impulsivity of patients with depression. International Journal of Applied Behavioral Sciences, 4(4), 57-68. https://doi.org/10.22037/ijabs.v4i4.19022

Hayes, S. C. (1989). Rule governed behavior: Cognition, contingencies, and instructional control. Plenum Press.

Hayes, S. C., Strosahl, K. D., & Wilson, K. G. (2012). Acceptance and Commitment Therapy: The process and practice of mindful change. Guilford Press.

Hayes, S. C., Wilson, K. G., Gifford, E. V., Follette, V. M., & Strosahl, K. (1996). Experiential avoidance and behavioral disorders: A functional dimensional approach to diagnosis and treatment. Journal of Consulting and Clinical Psychology, 64(6), 1152-1168. https://doi.org/10.1037//0022-006x.64.6.1152

Hayes, T., & Usami, S. (2019). Factor score regression in the presence of correlated unique factors. Educational and Psychological Measurement, 80(1), 5-40. https://doi.org/10.1177/0013164419854492

Hayes, T., & Usami, S. (2020). Factor score regression in connected measurement models containing cross-loadings. Structural Equation Modeling: A Multidisciplinary Journal, 27(6), 942-951. https://doi.org/10.1080/10705511.2020.1729160

Heiberger, R., & Robbins, N. (2014). Design of diverging stacked bar charts for Likert scales and other applications. Journal of Statistical Software, 57(5), 1-32. https://doi.org/10.18637/jss.v057.i05

Henze, N., & Zirkler, B. (1990). A class of invariant consistent tests for multivariate normality. Communications in Statistics - Theory and Methods, 19(10), 3595–3617. https://doi.org/10.1080/03610929008830400

International Test Commission (2017). ITC guidelines for translating and adapting tests (2nd ed.). https://www.intestcom.org/page/14

Kaiser, H. F. (1974). An index of factorial simplicity. Psychometrika, 39(1), 31-36. https://doi.org/10.1007/BF02291575

Keith, T. Z. (2019). Multiple regression and beyond. An introduction to multiple regression and structural equation modeling (3rd ed.). Routledge.

Kibbey, M. M., DiBello, A. M., Babu, A. A., & Farris, S. G. (2020). Validation of the Valuing Questionnaire (VQ) in adults with cardiovascular disease and risk. Journal of Contextual Behavioral Science, 17, 144-151. https://doi.org/10.1016/j.jcbs.2020.07.006

Kline, R. B. (2020). Becoming a behavioral science researcher. A guide to producing research that matters (2nd ed.). The Guilford Press.

Korkmaz, S. (2019). Multivariate normality tests (Version 5.8) [R package]. https://cran.r-project.org/web/packages/MVN/index.html

LeJeune, J., & Luoma, J. B. (2019). Values in therapy. A clinician’s guide to helping clients explore values, increase psychological flexibility and live a more meaningful life. New Harbinger Publications.

Lloret-Segura, S., Ferreres-Traver, A., Hernández-Baeza, A., & Tomás-Marco, I. (2014). El análisis factorial exploratorio de los ítems: una guía práctica, revisada y actualizada. Anales de Psicología / Annals of Psychology, 30(3), 1151-1169. https://doi.org/10.6018/analesps.30.3.199361

Lucena-Santos, P., Carvalho, S., Pinto-Gouveia, J., Gillanders, D., & Silva Oliveira, M. (2017). Cognitive Fusion Questionnaire: Exploring measurement invariance across three groups of Brazilian women and the role of cognitive fusion as a mediator in the relationship between rumination and depression. Journal of Contextual Behavioral Science, 6(1), 53–62. https://doi.org/10.1016/j.jcbs.2017.02.004

Luoma, J. B., Hayes, S. C., & Walser, R. D. (2007). Learning ACT. An Acceptance and Commitment Therapy. Skills Training Manual for Therapists. New Harbinger Publications.

Mardia, K. V. (1970). Measures of multivariate skewness and kurtosis with applications. Biometrika, 57(3), 519–530. https://doi.org/10.1093/biomet/57.3.519

, H. W., Morin, A. J. S., Parker, P. D., & Kaur, G. (2014). Exploratory structural equation modeling: An integration of the best features of exploratory and confirmatory factor analysis. Annual Review of Clinical Psychology, 10(1), 85–110. https://doi.org/10.1146/annurev-clinpsy-032813-153700

Marsh, H. W., Muthén, B., Asparouhov, T., Lüdtke, O., Robitzsch, A., Morin, A. J. S., & Trautwein, U. (2009). Exploratory structural equation modeling, integrating CFA and EFA: Application to students’ evaluations of university teaching. Structural Equation Modeling: A Multidisciplinary Journal, 16(3), 439–476. https://doi.org/10.1080/10705510903008220

McGartland Rubio, D., Berg-Weger, M., Tebb, S. S., Lee, E. S., & Rauch, S. (2003). Objectifying content validity: Conducting a content validity study in social work research. Social Work Research, 27(2), 94-104. https://doi.org/10.1093/swr/27.2.94

McNeish, D., & Wolf, M. G. (2020). Thinking twice about sum scores. Behavior Research Methods, 52(6), 2287–2305. https://doi.org/10.3758/s13428-020-01398-0

Morrison, K. L., Smith, B. M., Ong, C. W., Lee, E. B., Friedel, J. E., Odum, A., Madden, G. J., Ledermann, T., Rung, J., & Twohig, M. P. (2020). Effects of Acceptance and Commitment Therapy on impulsive decision-making. Behavior Modification, 44(4), 598–621. https://doi.org/10.1177/0145445519833041

Muthén, B., & Kaplan, D. (1985). A comparison of some methodologies for the factor analysis of non-normal Likert variables. British Journal of Mathematical and Statistical Psychology, 38(2), 171–189. https://doi.org/10.1111/j.2044-8317.1985.tb00832.x

Muthén, L. K., & Muthén, B. O. (2015). Mplus. (Version 7.2) [Computer software]. Beta-plus Publishing. https://www.statmodel.com/

Nonahal, S., Mohammadkhani, S., Hasani, J., & Akbari, M. (2020). Psychometric properties of the Persian version of the Valuing Questionnaire (VQ) in population engage in weight loss. Journal of Research in Psychological Health, 14(3), 1-17. http://rph.khu.ac.ir/article-1-3671-en.html

Pérez, M. (2014). Las terapias de tercera generación como terapias contextuales. Síntesis.

Pérez-Acosta, A., Guerrero, F., & López López, W. (2002). Siete conductismos contemporáneos: Una síntesis verbal y gráfica. International Journal of Psychology and Psychological Therapy, 2(1), 103-113. https://www.redalyc.org/articulo.oa?id=56020106

Polk, K. L., Schoendorff, B., Webster, M., & Olaz, F. O. (2016). The essential guide to the ACT matrix: A step-by-step approach to Using the ACT matrix model in clinical practice. New Harbinger Publications.

Putnick, D. L., & Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71–90. https://doi.org/10.1016/j.dr.2016.06.004

Raykov, T., & Marcoulides, G. A. (2017). Thanks Coefficient Alpha, we still need you! Educational and Psychological Measurement, 79(1), 200-210. https://doi.org/10.1177/0013164417725127

Revelle, W. (2020). Procedures for psychological, psychometric, and personality research (Version 2.0.12) [R package]. https://personality-project.org/r/psych/

Rhemtulla, M., Brosseau-Liard, P. É., & Savalei, V. (2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods, 17(3), 354-373. https://doi.org/10.1037/a0029315

Rickardsson, J., Zetterqvist, V., Kemani, M. K., Holmström, L., Andersson, E., & Wicksell, R. K. (2019). Assessing values - Psychometric properties of the Swedish version of the Valuing Questionnaire in adults with chronic pain. Journal of Contextual Behavioral Science, 14, 40-49. https://doi.org/10.1016/j.jcbs.2019.08.009

Robb, H. (2007). Values as leading principles in Acceptance and Commitment Therapy. International Journal of Behavioral Consultation and Therapy, 3(1), 118-122. http://doi.org/10.1037/h0100170

Rosseel, Y. (2020). Latent variable analysis (Version 0.6-7) [R package]. https://lavaan.ugent.be/

Ruiz, F. J., Suárez-Falcón, J. C., Segura-Vargas, M. A., & Gil-Luciano, B. (2022). Psychometric properties of the Spanish version of the Valuing Questionnaire in Colombian clinical and nonclinical samples. Journal of clinical psychology, 78(2), 233–248. https://doi.org/10.1002/jclp.23212

Rutkowski, L., & Svetina, D. (2014). Assessing the hypothesis of measurement invariance in the context of large-scale international surveys. Educational and Psychological Measurement, 74(1), 31–57. https://doi.org/10.1177/0013164413498257

Schumacker, R. E., & Lomax, R. G. (2016). A beginner’s guide to structural equation modeling (4th ed.). Routledge.

Sireci, S., & Faulkner-Bond, M. (2014). Validity evidence based on test content. Psicothema, 26(1), 100-107. https://doi.org/10.7334/psicothema2013.256

Skinner, B. F. (1957). Verbal behavior. Appleton-Century-Crofts.

Smout, M., Davies, M., Burns, N., & Christie, A. (2014). Development of the Valuing Questionnaire (VQ). Journal of Contextual Behavioral Science, 3(3), 164-172. https://doi.org/10.1016/j.jcbs.2014.06.001

Stevens, S. S. (1946). On the theory of scales of measurement. Science, 103, 677–680. https://doi.org/10.1126/science.103.2684.677

Thompson, E. R. (2007). Development and Validation of an internationally reliable short-form of the Positive and Negative Affect Schedule (PANAS). Journal of Cross-Cultural Psychology, 38(2), 227-242. https://doi.org/10.1177/0022022106297301

Thurstone, L. L. (1947). Multiple factor analysis. University of Chicago Press.

Van Vaerenbergh, Y., & Thomas, T. D. (2013). Response styles in survey research: A literature review of antecedents, consequences, and remedies. International Journal of Public Opinion Research, 25(2), 195–217. https://doi.org/10.1093/ijpor/eds021

Viladrich, C., Angulo-Brunet, A., & Doval, E. (2017). A journey around alpha and omega to estimate internal consistency reliability. Anales de Psicología, 33(3), 755–782. https://doi.org/10.6018/analesps.33.3.268401

Wang, J., & Wang, X. (2020). Structural equation modeling. Applications using Mplus (2nd ed.). Wiley.

Watkins, M. W. (2018). Exploratory factor analysis: A guide to best practice. Journal of Black Psychology, 44(3), 219–246. https://doi.org/10.1177/0095798418771807

Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology, 54(6), 1063-1070. https://doi.org/10.1037//0022-3514.54.6.1063

Wetherell, J. L., Afari, N., Rutledge, T., Sorrell, J. T., Stoddard, J. A., Petkus, A. J., Solomon, B. C., Lehman, D. H., Liu, L., Lang, A. J., & Atkinson, J. H. (2011). A randomized, controlled trial of Acceptance and Commitment Therapy and Cognitive-Behavioral Therapy for chronic pain. Pain, 152(9), 2098-2107. https://doi.org/10.1016/j.pain.2011.05.016

Wilson, K. G., & DuFrene, T. (2009). Mindfulness for two: An Acceptance and Commitment Therapy approach to mindfulness in psychotherapy. New Harbinger Publications.

Wilson, K. G., Sandoz, E. K., Kitchens, J., & Roberts, M. (2010). The valued living questionnaire: Defining and measuring valued action within a behavioral framework. The Psychological Record, 60, 249-272. https://doi.org/10.1007/BF03395706