Psychometric Properties of a Peruvian Translation of the Valuing Questionnaire (P-VQ): An Exploratory Structural Equation Modelling Approach
Main Article Content
Abstract
Values-based behavior is a highly studied concept and presents difficulty assessment within the Acceptance and Commitment Therapy’s framework. As a result, the present study sought to psychometrically adapt the P-VQ in a sample of 368 adults, as it was a preliminary proposal. Validity evidence based on test content (analysis of representativeness of each item) and based on the relationship with other variables (concurrent, divergent, and incremental validity) were obtained satisfactorily. Exploratory Structural Equation Modelling analyses supported evidence in favor of a two-dimensional latent structure with a better fit compared to previous Confirmatory Factor Analysis proposals. Reliability analysis (Alpha and Omega) demonstrated significant degrees of internal consistency. The invariance of the measurement (configurational, metric, scalar, and strict) regarding gender was obtained as evidence of equity. In conclusion, P-VQ demonstrated excellent psychometric properties with respect to validity, reliability, and fairness.
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
La RACC aplicará la licencia internacional de atribuciones comunes creativas (Reconocimiento 4.0 Internacional: https://creativecommons.org/licenses/by/4.0/).
Bajo esta licencia, se permite cualquier explotación de la obra, incluyendo la explotación con fines comerciales y la creación de obras derivadas, la distribución de las cuales también está permitida sin ninguna restricción. Esta licencia es una licencia libre según la Freedom Defined. La única condición es que siempre y en todos los casos se cite a los autores y a la fuente original de publicación (i.e., RACC). Esta licencia fue desarrollada para facilitar el acceso abierto, gratuito y libre a trabajos originales científicos y artísticos.
How to Cite
References
Abdollah, O., Saeid, A., & Hamidreza, H. (2018). Adaptation and factor structure of Valuing Questionnaire in Acceptance and Commitment Therapy approach. Training measurement, 8(32), 85-101. https://www.sid.ir/en/journal/ViewPaper.aspx?ID=744086
Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1), 131–142. https://doi.org/10.1177/0013164485451012
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education (2014). Standards for educational and psychological testing. American Educational Research Association.
Arch, J., Eifert, G. H., Davies, C., Plumb Vilardaga, J. C., Rose, R. D., & Craske, M. G. (2012). Randomized clinical trial of cognitive behavioral therapy (CBT) versus acceptance and commitment therapy (ACT) for mixed anxiety disorders. Journal of Consulting and Clinical Psychology, 80(5), 750–765. https://doi.org/10.1037/a0028310
Asparouhov, T., & Muthén, B. (2009). Exploratory structural equation modeling. Structural Equation Modeling: A Multidisciplinary Journal, 16(3), 397–438. https://doi.org/10.1080/10705510903008204
Aydin, Y., & Aydın, G. (2017). Adaptation of Valuing Questionnaire (VQ) into Turkish culture. Bant İzzet Baysal Üniversitesi Eğitim Fakültesi Dergisi, 17(1), 64-77. https://doi.org/10.17240/aibuefd.2017.17.28551-304621
Bach, P. A., & Moran, D. J. (2008). ACT in practice. Case conceptualization in Acceptance & Commitment Therapy. New Harbinger Publications.
Bandalos, D. L., & Finney, S. J. (2018). Factor analysis: Exploratory and confirmatory. En G. R. Hancock & R. O. Mueller (Eds.), The reviewer’s guide to quantitative methods in the Social Sciences (pp. 93-114). Routledge.
Bond, F. W., Hayes, S. C., Baer, R. A., Carpenter, K. M., Guenole, N., Orcutt, H. K., Waltz, T., & Zettle, R. D. (2011). Preliminary psychometric properties of the Acceptance and Action Questionnaire – II: A revised measure of psychological inflexibility and experiential avoidance. Behavior Therapy, 42(4), 676–688. https://doi.org/10.1016/j.beth.2011.03.007
Brown, T. A. (2015). Confirmatory factor analysis applied research (2nd ed.). The Guilford Press.
Browne, M. W. (2001). An overview of analytic rotation in exploratory factor analysis. Multivariate Behavioral Research, 36(1), 111–150. https://doi.org/10.1207/s15327906mbr3601_05
Carvalho, S. A., Palmeira, L., Pinto-Gouveia, J., Gillanders, D., & Castilho, P. (2018). The utility of the Valuing Questionnaire in chronic pain. Journal of Contextual Behavioral Science, 9, 21-29. https://doi.org/10.1016/j.jcbs.2018.06.002
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464–504. https://doi.org/10.1080/10705510701301834
Cho, E. (2016). Making reliability reliable: A Systematic Approach to Reliability Coefficients. Organizational Research Methods, 19(4), 651–682. https://doi.org/10.1177/1094428116656239
Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155–159. https://doi.org/10.1037/0033-2909.112.1.155
Dahl, J. C., Plumb, J. C., Stewart, I., & Lundgren, T. (2009). The art and science of valuing in psychotherapy. New Harbinger Publications.
Dahl, J. C., Wilson, K. G., Luciano, C., & Hayes, S. C. (2005). Acceptance and Commitment Therapy for chronic pain. New Harbinger Publications.
Davis, L. (1992). Instrument review: getting the most from a panel of experts. Applied Nursing Research, 5(4), 194-197. https://doi.org/10.1016/S0897-1897(05)80008-4
Devlieger, I., & Rosseel, Y. (2017). Factor score path analysis. An alternative for SEM? Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 13(1), 31-38. https://doi.org/10.1027/1614-2241/a000130
Devlieger, I., Talloen, W., & Rosseel, Y. (2019). New developments in factor score regression: Fit indices and a model comparison test. Educational and Psychological Measurement, 79(6), 1017-1037. https://doi.org/10.1177/0013164419844552
Diener, E., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The Satisfaction with Life Scale. Journal of Personality Assessment, 49(1), 71-75. https://doi.org/10.1207/s15327752jpa4901_13
DiStefano, C., Zhu, M., & Mîndrilã, D. (2009). Understanding and using factor scores: Considerations for the applied researcher. Practical Assessment, Research & Evaluation, 14, 20. https://doi.org/10.7275/da8t-4g52
Doi, S., Sakano, A., Muto, T., & Sakano, Y. (2017). Reliability and validity of a Japanese version of the Valuing Questionnaire. Japanese Journal of Behavior Therapy, 43(1), 83-94. https://doi.org/10.24468/jjbt.16-170
Dunn, T. J., Baguley, T., & Brunsden, V. (2013). From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology, 105(3), 399–412. https://doi.org/10.1111/bjop.12046
Edwards, K. A., & Vowles, K. E. (2020). Acceptance and Action Questionnaire – II Confirmatory factor analysis and measurement invariance between Non-Hispanic White and Hispanic/Latinx undergraduates. Journal of Contextual Behavioral Science, 17, 32-38. https://doi.org/10.1016/j.jcbs.2020.05.003
Falk, C. F., & Savalei, V. (2011). The relationship between unstandardized and standardized alpha, true reliability, and the underlying measurement model. Journal of Personality Assessment, 93(5), 445–453. https://doi.org/10.1080/00223891.2011.594129
Forman, E. M., Herbert, J. D., Moitra, E., Yeomans, P. D., & Geller, P. A. (2007). A randomized controlled effectiveness trial of Acceptance and Commitment Therapy and Cognitive Therapy for Anxiety and Depression. Behavior Modification, 31(6), 772–799. https://doi.org/10.1177/0145445507302202
Gargurevich, R. (2010). Propiedades psicométricas de la versión internacional de la Escala de Afecto Positivo y Negativo-forma corta (I- Spanas SF) en estudiantes universitarios. Persona, 13, 31-42. https://doi.org/10.26439/persona2010.n013.263
Gillanders, D. T., Bolderston, H., Bond, F. W., Dempster, M., Flaxman, P. E., Campbell, L., Kerr, S., Tansey, L., Noel, P., Ferenbach, C., Masley, S., Roach, L., Lloyd, J., May, L., Clarke, S., & Remington, B. (2014). The development and initial validation of the Cognitive Fusion Questionnaire. Behavior Therapy, 45(1), 83-101. https://doi.org/10.1016/J.BETH.2013.09.001
Gomes, C. M. A., Almeida, L. S., & Núñez, J. C. (2017). Rationale and applicability of exploratory structural equation modeling (ESEM) in psychoeducational contexts. Psicothema, 29(3), 396-401. https://doi.org/10.7334/psicothema2016.369
Harris, R. (2009). ACT made simple: An easy-to-read primer on Acceptance and Commitment Therapy. New Harbinger Publications.
Hasani, J. H., Hasani, R., & Niaei, A. (2017). The effectiveness of Acceptance and Commitment Therapy in impulsivity of patients with depression. International Journal of Applied Behavioral Sciences, 4(4), 57-68. https://doi.org/10.22037/ijabs.v4i4.19022
Hayes, S. C. (1989). Rule governed behavior: Cognition, contingencies, and instructional control. Plenum Press.
Hayes, S. C., Strosahl, K. D., & Wilson, K. G. (2012). Acceptance and Commitment Therapy: The process and practice of mindful change. Guilford Press.
Hayes, S. C., Wilson, K. G., Gifford, E. V., Follette, V. M., & Strosahl, K. (1996). Experiential avoidance and behavioral disorders: A functional dimensional approach to diagnosis and treatment. Journal of Consulting and Clinical Psychology, 64(6), 1152-1168. https://doi.org/10.1037//0022-006x.64.6.1152
Hayes, T., & Usami, S. (2019). Factor score regression in the presence of correlated unique factors. Educational and Psychological Measurement, 80(1), 5-40. https://doi.org/10.1177/0013164419854492
Hayes, T., & Usami, S. (2020). Factor score regression in connected measurement models containing cross-loadings. Structural Equation Modeling: A Multidisciplinary Journal, 27(6), 942-951. https://doi.org/10.1080/10705511.2020.1729160
Heiberger, R., & Robbins, N. (2014). Design of diverging stacked bar charts for Likert scales and other applications. Journal of Statistical Software, 57(5), 1-32. https://doi.org/10.18637/jss.v057.i05
Henze, N., & Zirkler, B. (1990). A class of invariant consistent tests for multivariate normality. Communications in Statistics - Theory and Methods, 19(10), 3595–3617. https://doi.org/10.1080/03610929008830400
International Test Commission (2017). ITC guidelines for translating and adapting tests (2nd ed.). https://www.intestcom.org/page/14
Kaiser, H. F. (1974). An index of factorial simplicity. Psychometrika, 39(1), 31-36. https://doi.org/10.1007/BF02291575
Keith, T. Z. (2019). Multiple regression and beyond. An introduction to multiple regression and structural equation modeling (3rd ed.). Routledge.
Kibbey, M. M., DiBello, A. M., Babu, A. A., & Farris, S. G. (2020). Validation of the Valuing Questionnaire (VQ) in adults with cardiovascular disease and risk. Journal of Contextual Behavioral Science, 17, 144-151. https://doi.org/10.1016/j.jcbs.2020.07.006
Kline, R. B. (2020). Becoming a behavioral science researcher. A guide to producing research that matters (2nd ed.). The Guilford Press.
Korkmaz, S. (2019). Multivariate normality tests (Version 5.8) [R package]. https://cran.r-project.org/web/packages/MVN/index.html
LeJeune, J., & Luoma, J. B. (2019). Values in therapy. A clinician’s guide to helping clients explore values, increase psychological flexibility and live a more meaningful life. New Harbinger Publications.
Lloret-Segura, S., Ferreres-Traver, A., Hernández-Baeza, A., & Tomás-Marco, I. (2014). El análisis factorial exploratorio de los ítems: una guía práctica, revisada y actualizada. Anales de Psicología / Annals of Psychology, 30(3), 1151-1169. https://doi.org/10.6018/analesps.30.3.199361
Lucena-Santos, P., Carvalho, S., Pinto-Gouveia, J., Gillanders, D., & Silva Oliveira, M. (2017). Cognitive Fusion Questionnaire: Exploring measurement invariance across three groups of Brazilian women and the role of cognitive fusion as a mediator in the relationship between rumination and depression. Journal of Contextual Behavioral Science, 6(1), 53–62. https://doi.org/10.1016/j.jcbs.2017.02.004
Luoma, J. B., Hayes, S. C., & Walser, R. D. (2007). Learning ACT. An Acceptance and Commitment Therapy. Skills Training Manual for Therapists. New Harbinger Publications.
Mardia, K. V. (1970). Measures of multivariate skewness and kurtosis with applications. Biometrika, 57(3), 519–530. https://doi.org/10.1093/biomet/57.3.519
, H. W., Morin, A. J. S., Parker, P. D., & Kaur, G. (2014). Exploratory structural equation modeling: An integration of the best features of exploratory and confirmatory factor analysis. Annual Review of Clinical Psychology, 10(1), 85–110. https://doi.org/10.1146/annurev-clinpsy-032813-153700
Marsh, H. W., Muthén, B., Asparouhov, T., Lüdtke, O., Robitzsch, A., Morin, A. J. S., & Trautwein, U. (2009). Exploratory structural equation modeling, integrating CFA and EFA: Application to students’ evaluations of university teaching. Structural Equation Modeling: A Multidisciplinary Journal, 16(3), 439–476. https://doi.org/10.1080/10705510903008220
McGartland Rubio, D., Berg-Weger, M., Tebb, S. S., Lee, E. S., & Rauch, S. (2003). Objectifying content validity: Conducting a content validity study in social work research. Social Work Research, 27(2), 94-104. https://doi.org/10.1093/swr/27.2.94
McNeish, D., & Wolf, M. G. (2020). Thinking twice about sum scores. Behavior Research Methods, 52(6), 2287–2305. https://doi.org/10.3758/s13428-020-01398-0
Morrison, K. L., Smith, B. M., Ong, C. W., Lee, E. B., Friedel, J. E., Odum, A., Madden, G. J., Ledermann, T., Rung, J., & Twohig, M. P. (2020). Effects of Acceptance and Commitment Therapy on impulsive decision-making. Behavior Modification, 44(4), 598–621. https://doi.org/10.1177/0145445519833041
Muthén, B., & Kaplan, D. (1985). A comparison of some methodologies for the factor analysis of non-normal Likert variables. British Journal of Mathematical and Statistical Psychology, 38(2), 171–189. https://doi.org/10.1111/j.2044-8317.1985.tb00832.x
Muthén, L. K., & Muthén, B. O. (2015). Mplus. (Version 7.2) [Computer software]. Beta-plus Publishing. https://www.statmodel.com/
Nonahal, S., Mohammadkhani, S., Hasani, J., & Akbari, M. (2020). Psychometric properties of the Persian version of the Valuing Questionnaire (VQ) in population engage in weight loss. Journal of Research in Psychological Health, 14(3), 1-17. http://rph.khu.ac.ir/article-1-3671-en.html
Pérez, M. (2014). Las terapias de tercera generación como terapias contextuales. Síntesis.
Pérez-Acosta, A., Guerrero, F., & López López, W. (2002). Siete conductismos contemporáneos: Una síntesis verbal y gráfica. International Journal of Psychology and Psychological Therapy, 2(1), 103-113. https://www.redalyc.org/articulo.oa?id=56020106
Polk, K. L., Schoendorff, B., Webster, M., & Olaz, F. O. (2016). The essential guide to the ACT matrix: A step-by-step approach to Using the ACT matrix model in clinical practice. New Harbinger Publications.
Putnick, D. L., & Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71–90. https://doi.org/10.1016/j.dr.2016.06.004
Raykov, T., & Marcoulides, G. A. (2017). Thanks Coefficient Alpha, we still need you! Educational and Psychological Measurement, 79(1), 200-210. https://doi.org/10.1177/0013164417725127
Revelle, W. (2020). Procedures for psychological, psychometric, and personality research (Version 2.0.12) [R package]. https://personality-project.org/r/psych/
Rhemtulla, M., Brosseau-Liard, P. É., & Savalei, V. (2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods, 17(3), 354-373. https://doi.org/10.1037/a0029315
Rickardsson, J., Zetterqvist, V., Kemani, M. K., Holmström, L., Andersson, E., & Wicksell, R. K. (2019). Assessing values - Psychometric properties of the Swedish version of the Valuing Questionnaire in adults with chronic pain. Journal of Contextual Behavioral Science, 14, 40-49. https://doi.org/10.1016/j.jcbs.2019.08.009
Robb, H. (2007). Values as leading principles in Acceptance and Commitment Therapy. International Journal of Behavioral Consultation and Therapy, 3(1), 118-122. http://doi.org/10.1037/h0100170
Rosseel, Y. (2020). Latent variable analysis (Version 0.6-7) [R package]. https://lavaan.ugent.be/
Ruiz, F. J., Suárez-Falcón, J. C., Segura-Vargas, M. A., & Gil-Luciano, B. (2022). Psychometric properties of the Spanish version of the Valuing Questionnaire in Colombian clinical and nonclinical samples. Journal of clinical psychology, 78(2), 233–248. https://doi.org/10.1002/jclp.23212
Rutkowski, L., & Svetina, D. (2014). Assessing the hypothesis of measurement invariance in the context of large-scale international surveys. Educational and Psychological Measurement, 74(1), 31–57. https://doi.org/10.1177/0013164413498257
Schumacker, R. E., & Lomax, R. G. (2016). A beginner’s guide to structural equation modeling (4th ed.). Routledge.
Sireci, S., & Faulkner-Bond, M. (2014). Validity evidence based on test content. Psicothema, 26(1), 100-107. https://doi.org/10.7334/psicothema2013.256
Skinner, B. F. (1957). Verbal behavior. Appleton-Century-Crofts.
Smout, M., Davies, M., Burns, N., & Christie, A. (2014). Development of the Valuing Questionnaire (VQ). Journal of Contextual Behavioral Science, 3(3), 164-172. https://doi.org/10.1016/j.jcbs.2014.06.001
Stevens, S. S. (1946). On the theory of scales of measurement. Science, 103, 677–680. https://doi.org/10.1126/science.103.2684.677
Thompson, E. R. (2007). Development and Validation of an internationally reliable short-form of the Positive and Negative Affect Schedule (PANAS). Journal of Cross-Cultural Psychology, 38(2), 227-242. https://doi.org/10.1177/0022022106297301
Thurstone, L. L. (1947). Multiple factor analysis. University of Chicago Press.
Van Vaerenbergh, Y., & Thomas, T. D. (2013). Response styles in survey research: A literature review of antecedents, consequences, and remedies. International Journal of Public Opinion Research, 25(2), 195–217. https://doi.org/10.1093/ijpor/eds021
Viladrich, C., Angulo-Brunet, A., & Doval, E. (2017). A journey around alpha and omega to estimate internal consistency reliability. Anales de Psicología, 33(3), 755–782. https://doi.org/10.6018/analesps.33.3.268401
Wang, J., & Wang, X. (2020). Structural equation modeling. Applications using Mplus (2nd ed.). Wiley.
Watkins, M. W. (2018). Exploratory factor analysis: A guide to best practice. Journal of Black Psychology, 44(3), 219–246. https://doi.org/10.1177/0095798418771807
Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology, 54(6), 1063-1070. https://doi.org/10.1037//0022-3514.54.6.1063
Wetherell, J. L., Afari, N., Rutledge, T., Sorrell, J. T., Stoddard, J. A., Petkus, A. J., Solomon, B. C., Lehman, D. H., Liu, L., Lang, A. J., & Atkinson, J. H. (2011). A randomized, controlled trial of Acceptance and Commitment Therapy and Cognitive-Behavioral Therapy for chronic pain. Pain, 152(9), 2098-2107. https://doi.org/10.1016/j.pain.2011.05.016
Wilson, K. G., & DuFrene, T. (2009). Mindfulness for two: An Acceptance and Commitment Therapy approach to mindfulness in psychotherapy. New Harbinger Publications.
Wilson, K. G., Sandoz, E. K., Kitchens, J., & Roberts, M. (2010). The valued living questionnaire: Defining and measuring valued action within a behavioral framework. The Psychological Record, 60, 249-272. https://doi.org/10.1007/BF03395706