Dimensionality of the Penn State Worry Questionnaire and its brief versions
Main Article Content
Abstract
Worry, a form of experiential avoidance, has been studied using the Penn State Worry Questionnaire (PSWQ). The aim of the present study was to assess the dimensionality of the PSWQ and three of its brief versions. The full PSWQ was administrated to 290 Peruvian undergraduate students. In order to achieve that goal, we examined the factor structure and reliability of six models: one-dimensional, oblique, bifactor, the PSWQ-11, the PSWQ-A and the PSWQ-5. The results suggest that the PSWQ is an essentially one-dimensional measure and it functions better without reversed items. Likewise, brief versions were found to have similarly adequate psychometric properties.
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
La RACC aplicará la licencia internacional de atribuciones comunes creativas (Reconocimiento 4.0 Internacional: https://creativecommons.org/licenses/by/4.0/).
Bajo esta licencia, se permite cualquier explotación de la obra, incluyendo la explotación con fines comerciales y la creación de obras derivadas, la distribución de las cuales también está permitida sin ninguna restricción. Esta licencia es una licencia libre según la Freedom Defined. La única condición es que siempre y en todos los casos se cite a los autores y a la fuente original de publicación (i.e., RACC). Esta licencia fue desarrollada para facilitar el acceso abierto, gratuito y libre a trabajos originales científicos y artísticos.
How to Cite
References
Auerbach, R. P., Mortier, P., Bruffaerts, R., Alonso, J., Benjet, C., Cuijpers, P., … Kessler, R. C. (2018). WHO World Mental Health Surveys International College Student Project: Prevalence and distribution of mental disorders. Journal of Abnormal Psychology, 127(7), 623–638. doi: 10.1037/abn0000362
Bauer, E. A., Braitman, A. L., Judah, M. R., & Cigularov, K. P. (2020). Worry as a mediator between psychosocial stressors and emotional sequelae: Moderation by contrast avoidance. Journal of Affective Disorders, 266, 456–464. doi: 10.1016/j.jad.2020.01.092
Beck, J. G., Stanley, M. A., & Zebb, B. J. (1995). Psychometric properties of the Penn State Worry Questionnaire in older adults. Journal of Clinical Geropsychology, 1(1), 33–42.
Berle, D., Starcevic, V., Moses, K., Hannan, A., Milicevic, D., & Sammut, P. (2011). Preliminary validation of an ultra-brief version of the Penn State Worry Questionnaire. Clinical Psychology & Psychotherapy, 18(4), 339–346. doi: 10.1002/cpp.724
Borkovec, T. D., & Inz, J. (1990). The nature of worry in generalized anxiety disorder: a predominance of thought activity. Behaviour Research and Therapy, 28(2), 153–158. doi: 10.1016/0005-7967(90)90027-g
Borkovec, T. D., Ray, W. J., & Stöber, J. (1998). Worry: A cognitive phenomenon intimately linked to affective, physiological, and interpersonal behavioral processes. Cognitive Therapy and Research, 22(6), 561–576. doi: 10.1023/A:1018790003416
Borkovec, T. D., Robinson, E., Pruzinsky, T., & DePree, J. A. (1983). Preliminary exploration of worry: Some characteristics and processes. Behaviour Research and Therapy, 21(1), 9–16. doi: 10.1016/0005-7967(83)90121-3
Brown, T. A. (2003). Confirmatory factor analysis of the Penn State Worry Questionnaire: Multiple factors or method effects? Behaviour Research and Therapy, 41(12), 1411–1426. doi: 10.1016/S0005-7967(03)00059-7
Brown, T. A. (2015). Confirmatory factor analysis for applied research (2nd ed.). New York, USA: Guilford Press.
Brown, T. A., Antony, M. M., & Barlow, D. H. (1992). Psychometric properties of the Penn State Worry Questionnaire in a clinical anxiety disorders sample. Behaviour Research and Therapy, 30(1), 33–37. doi: 10.1016/0005-7967(92)90093-V
Browne, M. W., & Cudeck, R. (1992). Alternative ways of assessing model fit. Sociological Methods & Research, 21(2), 230–258. doi: 10.1177/0049124192021002005
Bruffaerts, R., Mortier, P., Kiekens, G., Auerbach, R. P., Cuijpers, P., Demyttenaere, K., … Kessler, R. C. (2018). Mental health problems in college freshmen: Prevalence and academic functioning. Journal of Affective Disorders, 225, 97–103. doi: 10.1016/J.JAD.2017.07.044
Carter, M. M., Sbrocco, T., Miller, O., Suchday, S., Lewis, E. L., & Freedman, R. E. K. (2005). Factor structure, reliability, and validity of the Penn State Worry Questionnaire: differences between African-American and White-American college students. Journal of Anxiety Disorders, 19(8), 827–843. doi: 10.1016/J.JANXDIS.2004.11.001
Castillo, C., Macrini, L., Cheniaux, E., & Landeira-Fernandez, J. (2010). Psychometric properties and latent structure of the Portuguese version of the Penn State Worry Questionnaire. The Spanish Journal of Psychology, 13(1), 431–443. doi: 10.1017/S113874160000398X
Chalmers, R. P. (2017). On misconceptions and the limited usefulness of ordinal alpha. Educational and Psychological Measurement, 78(6), 1056–1071. doi: 10.1177/0013164417727036
Chen, F. F., West, S., & Sousa, K. (2006). A comparison of bifactor and second-order models of quality of life. Multivariate Behavioral Research, 41(2), 189–225. doi: 10.1207/s15327906mbr4102_5
Crittendon, J., & Hopko, D. R. (2006). Assessing worry in older and younger adults: Psychometric properties of an abbreviated Penn State Worry Questionnaire (PSWQ-A). Journal of Anxiety Disorders, 20(8), 1036–1054. doi: 10.1016/j.janxdis.2005.11.006
Dar, K. A., Iqbal, N., & Mushtaq, A. (2017). Intolerance of uncertainty, depression, and anxiety: Examining the indirect and moderating effects of worry. Asian Journal of Psychiatry, 29, 129–133. doi: 10.1016/j.ajp.2017.04.017
DeLapp, R. C. T., Chapman, L. K., & Williams, M. T. (2016). Psychometric properties of a brief version of the Penn State Worry Questionnaire in African Americans and European Americans. Psychological Assessment, 28(5), 499–508. doi: 10.1037/pas0000208
DiStefano, C., Liu, J., Jiang, N., & Shi, D. (2018). Examination of the Weighted Root Mean Square Residual: Evidence for trustworthiness? Structural Equation Modeling: A Multidisciplinary Journal, 25(3), 453–466. doi: 10.1080/10705511.2017.1390394
Duffy, A., Saunders, K. E. A., Malhi, G. S., Patten, S., Cipriani, A., McNevin, S. H., … Geddes, J. (2019). Mental health care for university students: a way forward? The Lancet Psychiatry, 6(11), 885–887. doi: 10.1016/S2215-0366(19)30275-5
Dunn, T. J., Baguley, T., & Brunsden, V. (2014). From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology, 105(3), 399–412. doi: 10.1111/bjop.12046
Ehring, T., & Watkins, E. R. (2008). Repetitive negative thinking as a transdiagnostic process. International Journal of Cognitive Therapy, 1(3), 192–205. doi: 10.1521/ijct.2008.1.3.192
Elhai, J. D., Rozgonjuk, D., Yildirim, C., Alghraibeh, A. M., & Alafnan, A. A. (2019). Worry and anger are associated with latent classes of problematic smartphone use severity among college students. Journal of Affective Disorders, 246, 209–216. doi: 10.1016/j.jad.2018.12.047
Ferrando, P. J., & Anguiano-Carrasco, C. (2010). El análisis factorial como técnica de investigación en psicología. Papeles del Psicólogo, 31(1), 18–33.
Fresco, D. M., Heimberg, R. G., Mennin, D. S., & Turk, C. L. (2002). Confirmatory factor analysis of the Penn State Worry Questionnaire. Behaviour Research and Therapy, 40(3), 313–323. doi: 10.1016/S0005-7967(00)00113-3
Furr, R. M., & Bacharach, V. R. (2014). Psychometrics: An introduction. New York, USA: SAGE.
Gadermann, A. M., Guhn, M., & Zumbo, B. D. (2012). Estimating ordinal reliability for Likert-type and ordinal item response data: A conceptual, empirical, and practical guide. Practical Assessment, Research & Evaluation, 17, 1-13. doi: 10.7275/n560-j767
Gana, K., Martin, B., Canouet, M.-D., Trouillet, R., & Meloni, F. (2002). Factorial structure of a French version of the Penn State Worry Questionnaire. European Journal of Psychological Assessment, 18(2), 158–164. doi: 10.1027/1015-5759.18.2.158
Gorday, J. Y., Rogers, M. L., & Joiner, T. E. (2018). Examining characteristics of worry in relation to depression, anxiety, and suicidal ideation and attempts. Journal of Psychiatric Research, 107, 97–103. doi: 10.1016/j.jpsychires.2018.10.004
Green, S. B., & Yang, Y. (2009). Reliability of summed item scores using structural equation modeling: An alternative to coefficient alpha. Psychometrika, 74(1), 155–167. doi: 10.1007/s11336-008-9099-3
Hayes, S. C., Wilson, K. G., Gifford, E. V, Follette, V. M., & Strosahl, K. D. (1996). Experiential avoidance and behavioral disorders: A functional dimensional approach to diagnosis and treatment. Journal of Consulting and Clinical Psychology, 64(6), 1152–1168. doi: 10.1037/0022-006X.64.6.1152
Hayes-Skelton, S. A., & Eustis, E. H. (2020). Experiential avoidance. En J. S. Abramowitz & S. M. Blakey (Eds.), Clinical handbook of fear and anxiety: Maintenance processes and treatment mechanisms (pp. 115–131). USA: American Psychological Association.
Hazlett-Stevens, H., Ullman, J. B., & Craske, M. G. (2004). Factor structure of the Penn State Worry Questionnaire: Examination of a method factor. Assessment, 11(4), 361–370. doi: 10.1177/1073191104269872
Hopko, D. R., Reas, D. L., Beck, J. G., Stanley, M. A., Wetherell, J. L., Novy, D. M., & Averill, P. M. (2003). Assessing worry in older adults: Confirmatory factor analysis of the Penn State Worry Questionnaire and psychometric properties of an abbreviated model. Psychological Assessment, 15(2), 173–183. doi: 10.1037/1040-3590.15.2.173
Hu, L., & Bentler, P. M. (1999). Cut-off criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modelling, 6(1), 1–55. doi: 10.1080/10705519909540118
Kelley, K., & Pornprasertmanit, S. (2016). Confidence intervals for population reliability coefficients: Evaluation of methods, recommendations, and software for composite measures. Psychological Methods, 21(1), 69–92. doi: 10.1037/a0040086
Kertz, S. J., Lee, J., & Björgvinsson, T. (2014). Psychometric properties of abbreviated and ultra-brief versions of the Penn State Worry Questionnaire. Psychological Assessment, 26(4), 1146–1154. doi: 10.1037/a0037251
Kline, R. B. (2016). Principles and practice of structural equation modeling (4th ed.). New York, USA: The Guilford Press.
Lim, Y. J., Kim, Y. H., Lee, E. H., & Kwon, S. M. (2008). The Penn State Worry Questionnaire: Psychometric properties of the Korean version. Depression and Anxiety, 25(10), E97–E103. doi: 10.1002/da.20356
Meyer, T. J., Miller, M. L., Metzger, R. L., & Borkovec, T. D. (1990). Development and validation of the Penn State Worry Questionnaire. Behaviour Research and Therapy, 28(6), 487–495. doi: 10.1016/0005-7967(90)90135-6
Nolen-Hoeksema, S., & Watkins, E. R. (2011). A heuristic for developing transdiagnostic models of psychopathology. Perspectives on Psychological Science, 6(6), 589–609. doi: 10.1177/1745691611419672
Padros-Blazquez, F., Gonzalez-Betanzos, F., Martinez-Medina, M. P., & Wagner, F. (2018). Psychometric characteristics of the original and brief version of the Penn State Worry Questionnaire (PSWQ) in Mexican samples. Actas Españolas de Psiquiatría, 46(4), 117–124.
Pallesen, S., Nordhus, I. H., Carlstedt, B., Thayer, J. F., & Johnsen, T. B. (2006). A Norwegian adaptation of the Penn State Worry Questionnaire: Factor structure, reliability, validity and norms. Scandinavian Journal of Psychology, 47(4), 281–291. doi: 10.1111/j.1467-9450.2006.00518.x
Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2012). Sources of method bias in social science research and recommendations on how to control it. Annual Review of Psychology, 63(1), 539–569. doi: 10.1146/annurev-psych-120710-100452
Purdon, C., & Harrington, J. (2006). Worry in psychopathology. En G. C. L. Davey & A. Wells (Eds.), Worry and its psychological disorders: Theory, assessment and treatment (pp. 41–50). New Jersey, USA: Wiley Publishing.
Raykov, T. (2012). Scale construction and development using structural equation modeling. En R. H. Hoyle (Ed.), Handbook of structural equation modeling, (pp. 472–492). New York, USA: Guilford Press.
R Core Team. (2019). R: A language and environment for statistical computing (version 3.5.3) [software]. Vienna: R Foundation of Statistical Computing. Recuperado de: https://www.r-project.org
Reise, S. P., Scheines, R., Widaman, K. F., & Haviland, M. G. (2013). Multidimensionality and structural coefficient bias in structural equation modeling: A bifactor perspective. Educational and Psychological Measurement, 73(1), 5–26. doi: 10.1177/0013164412449831
Revelle, W. (2019). Psych: Procedures for Personality and Psychological Research (version 1.8.12) [software]. Recuperado de: https://cran.r-project.org/package=psych
Rodríguez-Biglieri, R., & Vetere, G. L. (2011). Psychometric characteristics of the Penn State Worry Questionnaire in an Argentinean sample: A cross-cultural contribution. The Spanish Journal of Psychology, 14(1), 452–463. doi: 10.5209/rev_SJOP.2011.v14.n1.41
Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1-36. doi: 10.18637/jss.v048.i02
Ruiz, F. J., Monroy-Cifuentes, A., & Suárez-Falcón, J. C. (2018). Penn State Worry Questionnaire-11 validity in Colombia and factorial equivalence across gender and nonclinical and clinical samples. Anales de Psicología / Annals of Psychology, 34(3), 451–457. doi: 10.6018/analesps.34.3.300281
Sandín, B., Chorot, P., Valiente, R. M., & Lostao, L. (2009). Validación española del cuestionario de preocupación PSWQ: estructura factorial y propiedades psicométricas. Revista de Psicopatología y Psicología Clínica, 14(2), 107–122. doi: 10.5944/rppc.vol.14.num.2.2009.4070
Schroder, H. S., Clark, D. A., & Moser, J. S. (2017). Screening for problematic worry in adults with a single item from the Penn State Worry Questionnaire. Assessment, 26(2), 336–346. doi: 10.1177/1073191117694453
Sibrava, N. J., & Borkovec, T. D. (2006). The cognitive avoidance theory of worry. En G. C. L. Davey & A. Wells (Eds.), Worry and its psychological disorders: Theory, assessment and treatment (pp. 239–256). New Jersey, USA: Wiley Publishing.
Spinhoven, P., van der Veen, D. C., Voshaar, R. C. O., & Comijs, H. C. (2017). Worry and cognitive control predict course trajectories of anxiety in older adults with late-life depression. European Psychiatry, 44, 134–140. doi: 10.1016/j.eurpsy.2017.05.002
Suárez-Alvarez, J., Pedrosa, I., Lozano, L. M., García-Cueto, E., Cuesta, M., & Muñiz, J. (2018). Using reversed items in Likert scales: A questionable practice. Psicothema, 30(2), 149–158. doi: 10.7334/psicothema2018.33
Topper, M., Emmelkamp, P. M. G., Watkins, E., & Ehring, T. (2014). Development and assessment of brief versions of the Penn State Worry Questionnaire and the Ruminative Response Scale. British Journal of Clinical Psychology, 53(4), 402–421. doi: 10.1111/bjc.12052
van Rijsoort, S., Emmelkamp, P., & Vervaeke, G. (1999). The Penn State Worry Questionnaire and the Worry Domains Questionnaire: structure, reliability and validity. Clinical Psychology & Psychotherapy, 6(4), 297–307. doi: 10.1002/(SICI)1099-0879(199910)6:4<297::AID-CPP206>3.0.CO;2-E
Verkuil, B., & Brosschot, J. F. (2012). The online version of the Dutch Penn State Worry Questionnaire: Factor structure, predictive validity and reliability. Journal of Anxiety Disorders, 26(8), 844–848. doi: 10.1016/j.janxdis.2012.08.002
Wang, H., Yang, C., He, F., Shi, Y., Qu, Q., Rozelle, S., & Chu, J. (2015). Mental health and dropout behavior: A cross-sectional study of junior high students in northwest rural China. International Journal of Educational Development, 41, 1–12. doi: 10.1016/j.ijedudev.2014.12.005
Watkins, E. R. (2008). Constructive and unconstructive repetitive thought. Psychological Bulletin, 134(2), 163–206. doi: 10.1037/0033-2909.134.2.163
Watkins, E. R. (2015). An alternative transdiagnostic mechanistic approach to affective disorders illustrated with research from clinical psychology. Emotion Review, 7(3), 250–255. doi: 10.1177/1754073915575400
Wuthrich, V. M., Johnco, C., & Knight, A. (2014). Comparison of the Penn State Worry Questionnaire (PSWQ) and abbreviated version (PSWQ-A) in a clinical and non-clinical population of older adults. Journal of Anxiety Disorders, 28(7), 657–663. doi: 10.1016/j.janxdis.2014.07.005
Zhong, J., Wang, C., Li, J., & Liu, J. (2009). Penn State Worry Questionnaire: Structure and psychometric properties of the Chinese version. Journal of Zhejiang University SCIENCE B, 10(3), 211-218. doi: 10.1631/jzus.B0820189
Zinbarg, R. E., Yovel, I., Revelle, W., & McDonald, R. P. (2006). Estimating Generalizability to a Latent Variable Common to All of a Scale’s Indicators: A comparison of estimators for ωh. Applied Psychological Measurement, 30(2), 121-144. doi: 10.1177/0146621605278814
Zvolensky, M. J., Kauffman, B. Y., Bogiaizian, D., Viana, A. G., Bakhshaie, J., & Peraza, N. (2019). Worry among Latinx college students: relations to anxious arousal, social anxiety, general depression, and insomnia. Journal of American College Health, 1–8. Publicación anticipada en línea. doi: 10.1080/07448481.2019.1686004