Psychometric properties of the Indonesian version of the Depression Anxiety Stress Scale: Factor structure, reliability, gender, and age measurement invariance
DOI:
https://doi.org/10.21580/pjpp.v6i1.7815Keywords:
DASS, factor structure, measurement invariance, psychological distress, reliabilityAbstract
Measuring instruments that have satisfactory psychometric properties are needed to improve mental health research and services, especially in the effort to measure, identify, and monitor psychological problems experienced by individuals. The purpose of this study is to examine the psychometric properties of the Indonesian version of the Depression Anxiety Stress Scale (DASS). The study involved 1922 participants aged 16-26 in Surabaya, Indonesia. Data collection was made using the convenience sampling method. Testing of the factor structure, reliability, and measurement invariance of the Indonesian version of the DASS was conducted using confirmatory factor analysis, composite reliability, and multi-group analysis. It was found that the bifactor model consisting of specific factors (depression, anxiety, and stress) and general factors (psychological distress) was the best factor structure of the Indonesian version of the DASS (GFI = .954, CFI = .956, RMSEA = .049). In addition, this version has satisfactory composite reliability (.806 – .917) and gender measurement is invariant. The findings indicate that the Indonesian version of the DASS was a valid and reliable measurement tool to measure and compare depression, anxiety, stress, and psychological distress between genders in the Indonesian sample.Downloads
References
Alfonsson, S., Wallin, E., & Maathz, P. (2017). Factor structure and validity of the Depression, Anxiety and Stress Scale-21 in Swedish translation. Journal of Psychiatric and Mental Health Nursing, 24(2–3), 154–162. https://doi.org/10.1111/jpm.12363
Ali, A. M., Ahmed, A., Sharaf, A., Kawakami, N., Abdeldayem, S. M., & Green, J. (2017). The Arabic version of the Depression Anxiety Stress Scale-21: Cumulative scaling and discriminant-validation testing. Asian Journal of Psychiatry, 30, 56–58. https://doi.org/10.1016/j.ajp.2017.07.018
Almhdawi, K. A., Alazrai, A., Kanaan, S., Shyyab, A. A., Oteir, A. O., Mansour, Z. M., & Jaber, H. (2020). Post-stroke depression, anxiety, and stress symptoms and their associated factors: A cross-sectional study. Neuropsychological Rehabilitation, 1–14. https://doi.org/10.1080/09602011.2020.1760893
Apóstolo, J. L. A., Mendes, A. C., & Azeredo, Z. A. (2006). Adaptation to Portuguese of the Depression, Anxiety and Stress Scales (DASS). Revista Latino-Americana de Enfermagem, 14(6), 863–871. https://doi.org/10.1590/S0104-11692006000600006
Arbuckle, J. L. (2012). IBM SPSS Amos 21 users guide. Amos Development Corporation.
Asghari, A., Saed, F., & Dibajnia, P. (2008). Psychometric properties of the Depression Anxiety Stress Scales-21 (DASS-21) in a non-clinical Iranian sample. International Journal of Psychology, 2(2), 82–102.
Bados, A., Solanas, A., & Andrés, R. (2005). Psychometric properties of the Spanish version of Depression, Anxiety and Stress Scales (DASS). Psicothema, 17(4), 679–683.
Bandalos, D. L. (2002). The effects of item parceling on goodness-of-fit and parameter estimate bias in structural equation modeling. Structural Equation Modeling: A Multidisciplinary Journal, 9(1), 78–102. https://doi.org/10.1207/S15328007SEM0901_5
Bandalos, D. L. (2018). Measurement theory and applications for the social sciences. The Guilford Press.
Beck, A. T., Epstein, N., Brown, G., & Steer, R. A. (1988). An inventory for measuring clinical anxiety: Psychometric properties. Journal of Consulting and Clinical Psychology, 56(6), 893–897. https://doi.org/10.1037/0022-006X.56.6.893
Beck, A. T., Steer, R. A., & Brown, G. K. (1996). Manual for the Revised Beck Depression Inventory-II. Psychological Corporation.
Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88(3), 588–606. https://doi.org/10.1037/0033-2909.88.3.588
Blankson, A. N., & McArdle, J. J. (2015). Measurement invariance of cognitive abilities across ethnicity, gender, and time among older Americans. The Journals of Gerontology Series B: Psychological Sciences and Social Sciences, 70(3), 386–397. https://doi.org/10.1093/geronb/gbt106
Borkovec, T. D., Echemendia, R. J., Ragusea, S. A., & Ruiz, M. (2006). The Pennsylvania practice research network and future possibilities for clinically meaningful and scientifically rigorous psychotherapy effectiveness research. Clinical Psychology: Science and Practice, 8(2), 155–167. https://doi.org/10.1093/clipsy.8.2.155
Bottesi, G., Ghisi, M., Altoè, G., Conforti, E., Melli, G., & Sica, C. (2015). The Italian version of the Depression Anxiety Stress Scales-21: Factor structure and psychometric properties on community and clinical samples. Comprehensive Psychiatry, 60, 170–181. https://doi.org/10.1016/j.comppsych.2015.04.005
Byrne, B. M., & van de Vijver, F. J. R. (2010). Testing for measurement and structural equivalence in large-scale cross-cultural studies: Addressing the issue of nonequivalence. International Journal of Testing, 10(2), 107–132. https://doi.org/10.1080/15305051003637306
Byrne, D. G., Davenport, S. C., & Mazanov, J. (2007). Profiles of adolescent stress: The development of the Adolescent Stress Questionnaire (ASQ). Journal of Adolescence, 30(3), 393–416. https://doi.org/10.1016/j.adolescence.2006.04.004
Carlson, K. D., & Herdman, A. O. (2012). Understanding the impact of convergent validity on research results. Organizational Research Methods, 15(1), 17–32. https://doi.org/10.1177/1094428110392383
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464–504. https://doi.org/10.1080/10705510701301834
Chen, F. F. (2008). What happens if we compare chopsticks with forks? The impact of making inappropriate comparisons in cross-cultural research. Journal of Personality and Social Psychology, 95(5), 1005–1018. https://doi.org/10.1037/a0013193
Chen, F. F., Hayes, A., Carver, C. S., Laurenceau, J.-P., & Zhang, Z. (2012). Modeling general and specific variance in multifaceted constructs: A comparison of the bifactor model to other approaches. Journal of Personality, 80(1), 219–251. https://doi.org/10.1111/j.1467-6494.2011.00739.x
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5
Clara, I. P., Cox, B. J., & Enns, M. W. (2001). Confirmatory factor analysis of the Depression-Anxiety-Stress Scales in depressed and anxious patients. Journal of Psychopathology and Behavioral Assessment, 23(1), 61–67. https://doi.org/10.1023/A:1011095624717
Cohen, S., & Herbert, T. B. (1996). Health psychology: Psychological factors and physical disease from the perspective of human psychoneuroimmunology. Annual Review of Psychology, 47(1), 113–142. https://doi.org/10.1146/annurev.psych.47.1.113
Coker, A. O., Coker, O. O., & Sanni, D. (2018). Psychometric properties of the 21-item Depression Anxiety Stress Scale (DASS-21). African Research Review, 12(2), 135. https://doi.org/10.4314/afrrev.v12i2.13
Cole, D. A. (1987). Utility of confirmatory factor analysis in test validation research. Journal of Consulting and Clinical Psychology, 55(4), 584–594. https://doi.org/10.1037/0022-006X.55.4.584
Conley, C. S., Shapiro, J. B., Huguenel, B. M., & Kirsch, A. C. (2020). Navigating the college years: Developmental trajectories and gender differences in psychological functioning, cognitive-affective strategies, and social well-being. Emerging Adulthood, 8(2), 103–117. https://doi.org/10.1177/2167696818791603
Crawford, J. R., & Henry, J. D. (2003). The Depression Anxiety Stress Scales (DASS): Normative data and latent structure in a large non-clinical sample. British Journal of Clinical Psychology, 42(2), 111–131. https://doi.org/10.1348/014466503321903544
Daza, P., Novy, D. M., Stanley, M. A., & Averill, P. (2002). The Depression Anxiety Stress Scale-21: Spanish translation and validation with a Hispanic sample. Journal of Psychopathology and Behavioral Assessment, 24(3), 195–205. https://doi.org/10.1023/A:1016014818163
Downs, A., Boucher, L. A., Campbell, D. G., & Dasse, M. (2013). Development and initial validation of the Symptoms and Assets Screening Scale. Journal of American College Health, 61(3), 164–174. https://doi.org/10.1080/07448481.2013.773902
Dreyer, Z., Henn, C., & Hill, C. (2019). Validation of the Depression Anxiety Stress Scale-21 (DASS-21) in a non-clinical sample of South African working adults. Journal of Psychology in Africa, 29(4), 346–353. https://doi.org/10.1080/14330237.2019.1647499
Fliege, H., Rose, M., Arck, P., Walter, O. B., Kocalevent, R. D., Weber, C., & Klapp, B. F. (2005). The Perceived Stress Questionnaire (PSQ) reconsidered: Validation and reference values from different clinical and healthy adult samples. Psychosomatic Medicine, 67(1), 78–88. https://doi.org/10.1097/01.psy.0000151491.80178.78
Furr, R. M. (2011). Scale construction and psychometrics for social and personality psychology. Sage Publications, Inc.
Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2014). A primer on partial least squares structural equation modeling (PLS-SEM). Sage Publications, Inc.
Hekimoglu, L., Altun, Z., Kaya, E., Bayram, N., & Bilgel, N. (2012). Psychometric properties of the Turkish version of the 42 item Depression Anxiety Stress Scale (DASS-42) in a clinical sample. International Journal of Psychiatry in Medicine, 44(3), 183–198. https://doi.org/10.2190/PM.44.3.a
Henkel, V. (2003). Identifying depression in primary care: A comparison of different methods in a prospective cohort study. BMJ, 326(7382), 200–201. https://doi.org/10.1136/bmj.326.7382.200
Henry, J. D., & Crawford, J. R. (2005). The short-form version of the Depression Anxiety Stress Scales (DASS-21): Construct validity and normative data in a large non-clinical sample. British Journal of Clinical Psychology, 44(2), 227–239. https://doi.org/10.1348/014466505X29657
Horn, J. L., & Mcardle, J. J. (1992). A practical and theoretical guide to measurement invariance in aging research. Experimental Aging Research, 18(3), 117–144. https://doi.org/10.1080/03610739208253916
Joplin, S., & Petar Vrklevski, L. (2017). Emotional anaesthesia: A cognitive-behavioural treatment of prolonged grief in a client with complex comorbidities-the importance of reintegrating attachment, memory, and self-identity. Bereavement Care, 36(1), 25–32. https://doi.org/10.1080/02682621.2017.1305048
Kataoka, S. H., Zhang, L., & Wells, K. B. (2002). Unmet need for mental health care among U.S. children: Variation by ethnicity and insurance status. American Journal of Psychiatry, 159(9), 1548–1555. https://doi.org/10.1176/appi.ajp.159.9.1548
Kia-Keating, M., No, U., Moore, S., Furlong, M. J., Liu, S., & You, S. (2018). Structural validity of the Depression, Anxiety, and Stress Scales-21 adapted for U.S. undergraduates. Emerging Adulthood, 6(6), 434–440. https://doi.org/10.1177/2167696817745407
Kline, R. B. (2014). Principles and practices of structural equation modeling (3rd ed.). American Psychological Association.
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001). The PHQ-9. Journal of General Internal Medicine, 16, 606–613.
Le, M. T. H., Tran, T. D., Holton, S., Nguyen, H. T., Wolfe, R., & Fisher, J. (2017). Reliability, convergent validity and factor structure of the DASS-21 in a sample of Vietnamese adolescents. PLOS ONE, 12(7), e0180557. https://doi.org/10.1371/journal.pone.0180557
Lee, D. (2019). The convergent, discriminant, and nomological validity of the Depression Anxiety Stress Scales-21 (DASS-21). Journal of Affective Disorders, 259, 136–142. https://doi.org/10.1016/j.jad.2019.06.036
Lee, E. H., Moon, S. H., Cho, M. S., Park, E. S., Kim, S. Y., Han, J. S., & Cheio, J. H. (2019). The 21-item and 12-item versions of the Depression Anxiety Stress Scales: Psychometric evaluation in a Korean population. Asian Nursing Research, 13(1), 30–37. https://doi.org/10.1016/j.anr.2018.11.006
Liptzin, B. (2009). Quality improvement, pay for performance, and “outcomes measurement”: What makes sense? Psychiatric Services, 60(1), 108–111. https://doi.org/10.1176/ps.2009.60.1.108
Little, T. D., Cunningham, W. A., Shahar, G., & Widaman, K. F. (2002). To parcel or not to parcel: Exploring the question, weighing the merits. Structural Equation Modeling: A Multidisciplinary Journal, 9(2), 151–173. https://doi.org/10.1207/S15328007SEM0902_1
Lovibond, P. F., & Lovibond, S. H. (1995). The structure of negative emotional states: Comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories. Behaviour Research and Therapy, 33(3), 335–343. https://doi.org/10.1007/BF02511245
Lovibond, S. H., & Lovibond, P. F. (1995). Manual for the Depression Anxiety Stress Scales (2nd. Ed.). Psychology Foundation.
Medvedev, O. N., Krägeloh, C. U., Titkova, E. A., & Siegert, R. J. (2018). Rasch analysis and ordinal-to-interval conversion tables for the Depression, Anxiety and Stress Scale. Journal of Health Psychology, 25(10–11), 1374–1383. https://doi.org/10.1177/1359105318755261
Mellor, D., Vinet, E. V., Xu, X., Hidayah Bt Mamat, N., Richardson, B., & Román, F. (2015). Factorial invariance of the DASS-21 among adolescents in four countries. European Journal of Psychological Assessment, 31(2), 138–142. https://doi.org/10.1027/1015-5759/a000218
Millsap, R. E., & Kwok, O.-M. (2004). Evaluating the impact of partial factorial invariance on selection in two populations. Psychological Methods, 9(1), 93–115. https://doi.org/10.1037/1082-989X.9.1.93
Millsap, R. E., & Olivera-Aguilar, M. (2012). Investigating measurement invariance using confirmatory factor analysis. In R. Hoyle (Ed.), Handbook of structural equation modeling (pp. 380–392). The Guilford Press.
Moore, S. A., Dowdy, E., & Furlong, M. J. (2017). Using the Depression, Anxiety, Stress Scales–21 with U.S. adolescents: An alternate models analysis. Journal of Psychoeducational Assessment, 35(6), 581–598. https://doi.org/10.1177/0734282916651537
Musa, R., Fadzil, M. A., & Zain, Z. (2007). Translation, validation and psychometric properties of Bahasa Malaysia version of the Depression Anxiety and Stress Scales (DASS). ASEAN Journal of Psychiatry, 8(2), 82–89.
Muttaqin, D., Yunanto, T. A. R., Fitria, A. Z. N., Ramadhanty, A. M., & Lempang, G. F. (2020). Properti psikometri Self-Compassion Scale versi Indonesia: Struktur faktor, reliabilitas, dan validitas kriteria. Persona:Jurnal Psikologi Indonesia, 9(2), 189–208. https://doi.org/10.30996/persona.v9i2.3944
Negi, A. S., Khanna, A., & Aggarwal, R. (2019). Psychological health, stressors and coping mechanism of engineering students. International Journal of Adolescence and Youth, 24(4), 511–520. https://doi.org/10.1080/02673843.2019.1570856
Ng, F., Trauer, T., Dodd, S., Callaly, T., Campbell, S., & Berk, M. (2007). The validity of the 21-item version of the Depression Anxiety Stress Scales as a routine clinical outcome measure. Acta Neuropsychiatrica, 19(5), 304–310. https://doi.org/10.1111/j.1601-5215.2007.00217.x
Norton, P. J. (2007). Depression Anxiety and Stress Scales (DASS-21): Psychometric analysis across four racial groups. Anxiety, Stress & Coping, 20(3), 253–265. https://doi.org/10.1080/10615800701309279
Oei, T. P. S., Sawang, S., Goh, Y. W., & Mukhtar, F. (2013). Using the Depression Anxiety Stress Scale 21 (DASS-21) across cultures. In International Journal of Psychology (Vol. 48, Issue 6, pp. 1018–1029). Taylor & Francis. https://doi.org/10.1080/00207594.2012.755535
Osman, A., Wong, J. L., Bagge, C. L., Freedenthal, S., Gutierrez, P. M., & Lozano, G. (2012). The Depression Anxiety Stress Scales-21 (DASS-21): Further examination of dimensions, scale reliability, and correlates. Journal of Clinical Psychology, 68(12), 1322–1338. https://doi.org/10.1002/jclp.21908
Page, A. C., Hooke, G. R., & Morrison, D. L. (2007). Psychometric properties of the Depression Anxiety Stress Scales (DASS) in depressed clinical samples. British Journal of Clinical Psychology, 46(3), 283–297. https://doi.org/10.1348/014466506X158996
Patias, N. D., Machado, W. D. L., Bandeira, D. R., & Dell’Aglio, D. D. (2016). Depression Anxiety and Stress Scale (DASS-21) - Short Form: Adaptation and validation for Brazilian adolescents. Psico-USF, 21(3), 459–469. https://doi.org/10.1590/1413-82712016210302
Radloff, L. S. (1977). The CES-D Scale. Applied Psychological Measurement, 1(3), 385–401. https://doi.org/10.1177/014662167700100306
Randall, D., Thomas, M., Whiting, D., & McGrath, A. (2017). Depression Anxiety Stress Scales (DASS-21): Factor structure in traumatic brain injury rehabilitation. Journal of Head Trauma Rehabilitation, 32(2), 134–144. https://doi.org/10.1097/HTR.0000000000000250
Reise, S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47(5), 667–696. https://doi.org/10.1080/00273171.2012.715555
Ronk, F. R., Korman, J. R., Hooke, G. R., & Page, A. C. (2013). Assessing clinical significance of treatment outcomes using the DASS-21. Psychological Assessment, 25(4), 1103–1110. https://doi.org/10.1037/a0033100
Schnapp, J. E., O’Neal, D. N., & Vaughn, A. A. (2020). Dyadic perceptions of depression and anxiety in romantic relationships. Journal of Social and Personal Relationships, 37(2), 432–449. https://doi.org/10.1177/0265407519867418
Schreiber, J. B., Nora, A., Stage, F. K., Barlow, E. A., & King, J. (2006). Reporting structural equation modeling and confirmatory factor analysis results: A review. The Journal of Educational Research, 99(6), 323–338. https://doi.org/10.3200/JOER.99.6.323-338
Severino, G. A., & Haynes, W. D. G. (2010). Development of an Italian version of the Depression Anxiety Stress Scales. Psychology, Health & Medicine, 15(5), 607–621. https://doi.org/10.1080/13548506.2010.498889
Sinclair, S. J., Siefert, C. J., Slavin-Mulford, J. M., Stein, M. B., Renna, M., & Blais, M. A. (2012). Psychometric evaluation and normative data for the Depression, Anxiety, and Stress Scales-21 (DASS-21) in a nonclinical sample of U.S. adults. Evaluation & the Health Professions, 35(3), 259–279. https://doi.org/10.1177/0163278711424282
Spielberger, C. D., Goruch, R. L., & Lushene, R. E. (1970). Manual for State Trait Anxiety Inventory (STAI Y-II). Consulting Psychologist Press.
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006). A brief measure for assessing generalized anxiety disorder. Archives of Internal Medicine, 166(10), 1092. https://doi.org/10.1001/archinte.166.10.1092
Tonsing, K. N. (2014). Psychometric properties and validation of Nepali version of the Depression Anxiety Stress Scales (DASS-21). Asian Journal of Psychiatry, 8, 63–66. https://doi.org/10.1016/j.ajp.2013.11.001
Tran, T. D., Tran, T., & Fisher, J. (2013). Validation of the depression anxiety stress scales (DASS) 21 as a screening instrument for depression and anxiety in a rural community-based cohort of northern Vietnamese women. BMC Psychiatry, 13(1), 24. https://doi.org/10.1186/1471-244X-13-24
Tully, P. J., Zajac, I. T., & Venning, A. J. (2009). The structure of Anxiety and Depression in a normative sample of younger and older Australian adolescents. Journal of Abnormal Child Psychology, 37(5), 717–726. https://doi.org/10.1007/s10802-009-9306-4
van de Schoot, R., Lugtig, P., & Hox, J. (2012). A checklist for testing measurement invariance. European Journal of Developmental Psychology, 9(4), 486–492. https://doi.org/10.1080/17405629.2012.686740
Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4–70. https://doi.org/10.1177/109442810031002
Vignola, R. C. B., & Tucci, A. M. (2014). Adaptation and validation of the Depression, Anxiety and Stress Scale (DASS) to Brazilian Portuguese. Journal of Affective Disorders, 155(1), 104–109. https://doi.org/10.1016/j.jad.2013.10.031
Wang, B., You, J., Lin, M. P., Xu, S., & Leung, F. (2017). Developmental trajectories of nonsuicidal self-injury in adolescence and intrapersonal/interpersonal risk factors. Journal of Research on Adolescence, 27(2), 392–406. https://doi.org/10.1111/jora.12273
Watson, D., Clark, L. A., Weber, K., Assenheimer, J. S., Strauss, M. E., & McCormick, R. A. (1995). Testing a tripartite model: II. Exploring the symptom structure of anxiety and depression in student, adult, and patient samples. Journal of Abnormal Psychology, 104(1), 15–25. https://doi.org/10.1037/0021-843X.104.1.15
Xavier, S., João Martins, M., Pereira, A. T., Paula Amaral, A., João Soares, M., Roque, C., & Macedo, A. (2017). Contribution for the Portuguese validation of the Depression, Anxiety and Stress Scales (DASS-21): Comparison between dimensional models in a sample of students. European Psychiatry, 41(S1), S416–S416. https://doi.org/10.1016/j.eurpsy.2017.01.365
Yıldırım, A., Boysan, M., & Kefeli, M. C. (2018). Psychometric properties of the Turkish version of the Depression Anxiety Stress Scale-21 (DASS-21). British Journal of Guidance and Counselling, 46(5), 582–595. https://doi.org/10.1080/03069885.2018.1442558
Yohannes, A. M., Dryden, S., & Hanania, N. A. (2019). Validity and responsiveness of the Depression Anxiety Stress Scales-21 (DASS-21) in COPD. Chest, 155(6), 1166–1177. https://doi.org/10.1016/j.chest.2018.12.010
Zanon, C., Brenner, R. E., Baptista, M. N., Vogel, D. L., Rubin, M., Al-Darmaki, F. R., Gonçalves, M., Heath, P. J., Liao, H. Y., Mackenzie, C. S., Topkaya, N., Wade, N. G., & Zlati, A. (2020). Examining the dimensionality, reliability, and invariance of the Depression, Anxiety, and Stress Scale-21 (DASS-21) across eight countries. Assessment. https://doi.org/10.1177/1073191119887449
Zhang, B., Sun, T., Cao, M., & Drasgow, F. (2020). Using bifactor models to examine the predictive validity of hierarchical constructs: Pros, cons, and solutions. Organizational Research Methods, 109442812091552. https://doi.org/10.1177/1094428120915522
Downloads
Published
How to Cite
Issue
Section
License
The copyright of the accepted article shall be assigned to the publisher of the journal. The intended copyright includes the right to publish the article in various forms (including reprints). The journal maintains the publishing rights to published articles.
In line with the license, authors and any users (readers and other researchers) are allowed to share and adapt the material only for non-commercial purposes. In addition, the material must be given appropriate credit, provided with a link to the license, and indicated if changes were made. If authors remix, transform, or build upon the material, authors must distribute their contributions under the same license as the original.
