Psychometric properties of the Indonesian version of the Depression Anxiety Stress Scale: Factor structure, reliability, gender, and age measurement invariance

Authors

DOI:

https://doi.org/10.21580/pjpp.v6i1.7815

Keywords:

DASS, factor structure, measurement invariance, psychological distress, reliability

Abstract

Measuring instruments that have satisfactory psychometric properties are needed to improve mental health research and services, especially in the effort to measure, identify, and monitor psychological problems experienced by individuals. The purpose of this study is to examine the psychometric properties of the Indonesian version of the Depression Anxiety Stress Scale (DASS). The study involved 1922 participants aged 16-26 in Surabaya, Indonesia. Data collection was made using the convenience sampling method. Testing of the factor structure, reliability, and measurement invariance of the Indonesian version of the DASS was conducted using confirmatory factor analysis, composite reliability, and multi-group analysis. It was found that the bifactor model consisting of specific factors (depression, anxiety, and stress) and general factors (psychological distress) was the best factor structure of the Indonesian version of the DASS (GFI = .954, CFI = .956, RMSEA = .049). In addition, this version has satisfactory composite reliability (.806 – .917) and gender measurement is invariant. The findings indicate that the Indonesian version of the DASS was a valid and reliable measurement tool to measure and compare depression, anxiety, stress, and psychological distress between genders in the Indonesian sample.

Downloads

Download data is not yet available.

Author Biography

Serena Ripa, Centro la Famiglia Onlus, Naples

References

Alfonsson, S., Wallin, E., & Maathz, P. (2017). Factor structure and validity of the Depression, Anxiety and Stress Scale-21 in Swedish translation. Journal of Psychiatric and Mental Health Nursing, 24(2–3), 154–162. https://doi.org/10.1111/jpm.12363

Ali, A. M., Ahmed, A., Sharaf, A., Kawakami, N., Abdeldayem, S. M., & Green, J. (2017). The Arabic version of the Depression Anxiety Stress Scale-21: Cumulative scaling and discriminant-validation testing. Asian Journal of Psychiatry, 30, 56–58. https://doi.org/10.1016/j.ajp.2017.07.018

Almhdawi, K. A., Alazrai, A., Kanaan, S., Shyyab, A. A., Oteir, A. O., Mansour, Z. M., & Jaber, H. (2020). Post-stroke depression, anxiety, and stress symptoms and their associated factors: A cross-sectional study. Neuropsychological Rehabilitation, 1–14. https://doi.org/10.1080/09602011.2020.1760893

Apóstolo, J. L. A., Mendes, A. C., & Azeredo, Z. A. (2006). Adaptation to Portuguese of the Depression, Anxiety and Stress Scales (DASS). Revista Latino-Americana de Enfermagem, 14(6), 863–871. https://doi.org/10.1590/S0104-11692006000600006

Arbuckle, J. L. (2012). IBM SPSS Amos 21 users guide. Amos Development Corporation.

Asghari, A., Saed, F., & Dibajnia, P. (2008). Psychometric properties of the Depression Anxiety Stress Scales-21 (DASS-21) in a non-clinical Iranian sample. International Journal of Psychology, 2(2), 82–102.

Bados, A., Solanas, A., & Andrés, R. (2005). Psychometric properties of the Spanish version of Depression, Anxiety and Stress Scales (DASS). Psicothema, 17(4), 679–683.

Bandalos, D. L. (2002). The effects of item parceling on goodness-of-fit and parameter estimate bias in structural equation modeling. Structural Equation Modeling: A Multidisciplinary Journal, 9(1), 78–102. https://doi.org/10.1207/S15328007SEM0901_5

Bandalos, D. L. (2018). Measurement theory and applications for the social sciences. The Guilford Press.

Beck, A. T., Epstein, N., Brown, G., & Steer, R. A. (1988). An inventory for measuring clinical anxiety: Psychometric properties. Journal of Consulting and Clinical Psychology, 56(6), 893–897. https://doi.org/10.1037/0022-006X.56.6.893

Beck, A. T., Steer, R. A., & Brown, G. K. (1996). Manual for the Revised Beck Depression Inventory-II. Psychological Corporation.

Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88(3), 588–606. https://doi.org/10.1037/0033-2909.88.3.588

Blankson, A. N., & McArdle, J. J. (2015). Measurement invariance of cognitive abilities across ethnicity, gender, and time among older Americans. The Journals of Gerontology Series B: Psychological Sciences and Social Sciences, 70(3), 386–397. https://doi.org/10.1093/geronb/gbt106

Borkovec, T. D., Echemendia, R. J., Ragusea, S. A., & Ruiz, M. (2006). The Pennsylvania practice research network and future possibilities for clinically meaningful and scientifically rigorous psychotherapy effectiveness research. Clinical Psychology: Science and Practice, 8(2), 155–167. https://doi.org/10.1093/clipsy.8.2.155

Bottesi, G., Ghisi, M., Altoè, G., Conforti, E., Melli, G., & Sica, C. (2015). The Italian version of the Depression Anxiety Stress Scales-21: Factor structure and psychometric properties on community and clinical samples. Comprehensive Psychiatry, 60, 170–181. https://doi.org/10.1016/j.comppsych.2015.04.005

Byrne, B. M., & van de Vijver, F. J. R. (2010). Testing for measurement and structural equivalence in large-scale cross-cultural studies: Addressing the issue of nonequivalence. International Journal of Testing, 10(2), 107–132. https://doi.org/10.1080/15305051003637306

Byrne, D. G., Davenport, S. C., & Mazanov, J. (2007). Profiles of adolescent stress: The development of the Adolescent Stress Questionnaire (ASQ). Journal of Adolescence, 30(3), 393–416. https://doi.org/10.1016/j.adolescence.2006.04.004

Carlson, K. D., & Herdman, A. O. (2012). Understanding the impact of convergent validity on research results. Organizational Research Methods, 15(1), 17–32. https://doi.org/10.1177/1094428110392383

Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464–504. https://doi.org/10.1080/10705510701301834

Chen, F. F. (2008). What happens if we compare chopsticks with forks? The impact of making inappropriate comparisons in cross-cultural research. Journal of Personality and Social Psychology, 95(5), 1005–1018. https://doi.org/10.1037/a0013193

Chen, F. F., Hayes, A., Carver, C. S., Laurenceau, J.-P., & Zhang, Z. (2012). Modeling general and specific variance in multifaceted constructs: A comparison of the bifactor model to other approaches. Journal of Personality, 80(1), 219–251. https://doi.org/10.1111/j.1467-6494.2011.00739.x

Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5

Clara, I. P., Cox, B. J., & Enns, M. W. (2001). Confirmatory factor analysis of the Depression-Anxiety-Stress Scales in depressed and anxious patients. Journal of Psychopathology and Behavioral Assessment, 23(1), 61–67. https://doi.org/10.1023/A:1011095624717

Cohen, S., & Herbert, T. B. (1996). Health psychology: Psychological factors and physical disease from the perspective of human psychoneuroimmunology. Annual Review of Psychology, 47(1), 113–142. https://doi.org/10.1146/annurev.psych.47.1.113

Coker, A. O., Coker, O. O., & Sanni, D. (2018). Psychometric properties of the 21-item Depression Anxiety Stress Scale (DASS-21). African Research Review, 12(2), 135. https://doi.org/10.4314/afrrev.v12i2.13

Cole, D. A. (1987). Utility of confirmatory factor analysis in test validation research. Journal of Consulting and Clinical Psychology, 55(4), 584–594. https://doi.org/10.1037/0022-006X.55.4.584

Conley, C. S., Shapiro, J. B., Huguenel, B. M., & Kirsch, A. C. (2020). Navigating the college years: Developmental trajectories and gender differences in psychological functioning, cognitive-affective strategies, and social well-being. Emerging Adulthood, 8(2), 103–117. https://doi.org/10.1177/2167696818791603

Crawford, J. R., & Henry, J. D. (2003). The Depression Anxiety Stress Scales (DASS): Normative data and latent structure in a large non-clinical sample. British Journal of Clinical Psychology, 42(2), 111–131. https://doi.org/10.1348/014466503321903544

Daza, P., Novy, D. M., Stanley, M. A., & Averill, P. (2002). The Depression Anxiety Stress Scale-21: Spanish translation and validation with a Hispanic sample. Journal of Psychopathology and Behavioral Assessment, 24(3), 195–205. https://doi.org/10.1023/A:1016014818163

Downs, A., Boucher, L. A., Campbell, D. G., & Dasse, M. (2013). Development and initial validation of the Symptoms and Assets Screening Scale. Journal of American College Health, 61(3), 164–174. https://doi.org/10.1080/07448481.2013.773902

Dreyer, Z., Henn, C., & Hill, C. (2019). Validation of the Depression Anxiety Stress Scale-21 (DASS-21) in a non-clinical sample of South African working adults. Journal of Psychology in Africa, 29(4), 346–353. https://doi.org/10.1080/14330237.2019.1647499

Fliege, H., Rose, M., Arck, P., Walter, O. B., Kocalevent, R. D., Weber, C., & Klapp, B. F. (2005). The Perceived Stress Questionnaire (PSQ) reconsidered: Validation and reference values from different clinical and healthy adult samples. Psychosomatic Medicine, 67(1), 78–88. https://doi.org/10.1097/01.psy.0000151491.80178.78

Furr, R. M. (2011). Scale construction and psychometrics for social and personality psychology. Sage Publications, Inc.

Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2014). A primer on partial least squares structural equation modeling (PLS-SEM). Sage Publications, Inc.

Hekimoglu, L., Altun, Z., Kaya, E., Bayram, N., & Bilgel, N. (2012). Psychometric properties of the Turkish version of the 42 item Depression Anxiety Stress Scale (DASS-42) in a clinical sample. International Journal of Psychiatry in Medicine, 44(3), 183–198. https://doi.org/10.2190/PM.44.3.a

Henkel, V. (2003). Identifying depression in primary care: A comparison of different methods in a prospective cohort study. BMJ, 326(7382), 200–201. https://doi.org/10.1136/bmj.326.7382.200

Henry, J. D., & Crawford, J. R. (2005). The short-form version of the Depression Anxiety Stress Scales (DASS-21): Construct validity and normative data in a large non-clinical sample. British Journal of Clinical Psychology, 44(2), 227–239. https://doi.org/10.1348/014466505X29657

Horn, J. L., & Mcardle, J. J. (1992). A practical and theoretical guide to measurement invariance in aging research. Experimental Aging Research, 18(3), 117–144. https://doi.org/10.1080/03610739208253916

Joplin, S., & Petar Vrklevski, L. (2017). Emotional anaesthesia: A cognitive-behavioural treatment of prolonged grief in a client with complex comorbidities-the importance of reintegrating attachment, memory, and self-identity. Bereavement Care, 36(1), 25–32. https://doi.org/10.1080/02682621.2017.1305048

Kataoka, S. H., Zhang, L., & Wells, K. B. (2002). Unmet need for mental health care among U.S. children: Variation by ethnicity and insurance status. American Journal of Psychiatry, 159(9), 1548–1555. https://doi.org/10.1176/appi.ajp.159.9.1548

Kia-Keating, M., No, U., Moore, S., Furlong, M. J., Liu, S., & You, S. (2018). Structural validity of the Depression, Anxiety, and Stress Scales-21 adapted for U.S. undergraduates. Emerging Adulthood, 6(6), 434–440. https://doi.org/10.1177/2167696817745407

Kline, R. B. (2014). Principles and practices of structural equation modeling (3rd ed.). American Psychological Association.

Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001). The PHQ-9. Journal of General Internal Medicine, 16, 606–613.

Le, M. T. H., Tran, T. D., Holton, S., Nguyen, H. T., Wolfe, R., & Fisher, J. (2017). Reliability, convergent validity and factor structure of the DASS-21 in a sample of Vietnamese adolescents. PLOS ONE, 12(7), e0180557. https://doi.org/10.1371/journal.pone.0180557

Lee, D. (2019). The convergent, discriminant, and nomological validity of the Depression Anxiety Stress Scales-21 (DASS-21). Journal of Affective Disorders, 259, 136–142. https://doi.org/10.1016/j.jad.2019.06.036

Lee, E. H., Moon, S. H., Cho, M. S., Park, E. S., Kim, S. Y., Han, J. S., & Cheio, J. H. (2019). The 21-item and 12-item versions of the Depression Anxiety Stress Scales: Psychometric evaluation in a Korean population. Asian Nursing Research, 13(1), 30–37. https://doi.org/10.1016/j.anr.2018.11.006

Liptzin, B. (2009). Quality improvement, pay for performance, and “outcomes measurement”: What makes sense? Psychiatric Services, 60(1), 108–111. https://doi.org/10.1176/ps.2009.60.1.108

Little, T. D., Cunningham, W. A., Shahar, G., & Widaman, K. F. (2002). To parcel or not to parcel: Exploring the question, weighing the merits. Structural Equation Modeling: A Multidisciplinary Journal, 9(2), 151–173. https://doi.org/10.1207/S15328007SEM0902_1

Lovibond, P. F., & Lovibond, S. H. (1995). The structure of negative emotional states: Comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories. Behaviour Research and Therapy, 33(3), 335–343. https://doi.org/10.1007/BF02511245

Lovibond, S. H., & Lovibond, P. F. (1995). Manual for the Depression Anxiety Stress Scales (2nd. Ed.). Psychology Foundation.

Medvedev, O. N., Krägeloh, C. U., Titkova, E. A., & Siegert, R. J. (2018). Rasch analysis and ordinal-to-interval conversion tables for the Depression, Anxiety and Stress Scale. Journal of Health Psychology, 25(10–11), 1374–1383. https://doi.org/10.1177/1359105318755261

Mellor, D., Vinet, E. V., Xu, X., Hidayah Bt Mamat, N., Richardson, B., & Román, F. (2015). Factorial invariance of the DASS-21 among adolescents in four countries. European Journal of Psychological Assessment, 31(2), 138–142. https://doi.org/10.1027/1015-5759/a000218

Millsap, R. E., & Kwok, O.-M. (2004). Evaluating the impact of partial factorial invariance on selection in two populations. Psychological Methods, 9(1), 93–115. https://doi.org/10.1037/1082-989X.9.1.93

Millsap, R. E., & Olivera-Aguilar, M. (2012). Investigating measurement invariance using confirmatory factor analysis. In R. Hoyle (Ed.), Handbook of structural equation modeling (pp. 380–392). The Guilford Press.

Moore, S. A., Dowdy, E., & Furlong, M. J. (2017). Using the Depression, Anxiety, Stress Scales–21 with U.S. adolescents: An alternate models analysis. Journal of Psychoeducational Assessment, 35(6), 581–598. https://doi.org/10.1177/0734282916651537

Musa, R., Fadzil, M. A., & Zain, Z. (2007). Translation, validation and psychometric properties of Bahasa Malaysia version of the Depression Anxiety and Stress Scales (DASS). ASEAN Journal of Psychiatry, 8(2), 82–89.

Muttaqin, D., Yunanto, T. A. R., Fitria, A. Z. N., Ramadhanty, A. M., & Lempang, G. F. (2020). Properti psikometri Self-Compassion Scale versi Indonesia: Struktur faktor, reliabilitas, dan validitas kriteria. Persona:Jurnal Psikologi Indonesia, 9(2), 189–208. https://doi.org/10.30996/persona.v9i2.3944

Negi, A. S., Khanna, A., & Aggarwal, R. (2019). Psychological health, stressors and coping mechanism of engineering students. International Journal of Adolescence and Youth, 24(4), 511–520. https://doi.org/10.1080/02673843.2019.1570856

Ng, F., Trauer, T., Dodd, S., Callaly, T., Campbell, S., & Berk, M. (2007). The validity of the 21-item version of the Depression Anxiety Stress Scales as a routine clinical outcome measure. Acta Neuropsychiatrica, 19(5), 304–310. https://doi.org/10.1111/j.1601-5215.2007.00217.x

Norton, P. J. (2007). Depression Anxiety and Stress Scales (DASS-21): Psychometric analysis across four racial groups. Anxiety, Stress & Coping, 20(3), 253–265. https://doi.org/10.1080/10615800701309279

Oei, T. P. S., Sawang, S., Goh, Y. W., & Mukhtar, F. (2013). Using the Depression Anxiety Stress Scale 21 (DASS-21) across cultures. In International Journal of Psychology (Vol. 48, Issue 6, pp. 1018–1029). Taylor & Francis. https://doi.org/10.1080/00207594.2012.755535

Osman, A., Wong, J. L., Bagge, C. L., Freedenthal, S., Gutierrez, P. M., & Lozano, G. (2012). The Depression Anxiety Stress Scales-21 (DASS-21): Further examination of dimensions, scale reliability, and correlates. Journal of Clinical Psychology, 68(12), 1322–1338. https://doi.org/10.1002/jclp.21908

Page, A. C., Hooke, G. R., & Morrison, D. L. (2007). Psychometric properties of the Depression Anxiety Stress Scales (DASS) in depressed clinical samples. British Journal of Clinical Psychology, 46(3), 283–297. https://doi.org/10.1348/014466506X158996

Patias, N. D., Machado, W. D. L., Bandeira, D. R., & Dell’Aglio, D. D. (2016). Depression Anxiety and Stress Scale (DASS-21) - Short Form: Adaptation and validation for Brazilian adolescents. Psico-USF, 21(3), 459–469. https://doi.org/10.1590/1413-82712016210302

Radloff, L. S. (1977). The CES-D Scale. Applied Psychological Measurement, 1(3), 385–401. https://doi.org/10.1177/014662167700100306

Randall, D., Thomas, M., Whiting, D., & McGrath, A. (2017). Depression Anxiety Stress Scales (DASS-21): Factor structure in traumatic brain injury rehabilitation. Journal of Head Trauma Rehabilitation, 32(2), 134–144. https://doi.org/10.1097/HTR.0000000000000250

Reise, S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47(5), 667–696. https://doi.org/10.1080/00273171.2012.715555

Ronk, F. R., Korman, J. R., Hooke, G. R., & Page, A. C. (2013). Assessing clinical significance of treatment outcomes using the DASS-21. Psychological Assessment, 25(4), 1103–1110. https://doi.org/10.1037/a0033100

Schnapp, J. E., O’Neal, D. N., & Vaughn, A. A. (2020). Dyadic perceptions of depression and anxiety in romantic relationships. Journal of Social and Personal Relationships, 37(2), 432–449. https://doi.org/10.1177/0265407519867418

Schreiber, J. B., Nora, A., Stage, F. K., Barlow, E. A., & King, J. (2006). Reporting structural equation modeling and confirmatory factor analysis results: A review. The Journal of Educational Research, 99(6), 323–338. https://doi.org/10.3200/JOER.99.6.323-338

Severino, G. A., & Haynes, W. D. G. (2010). Development of an Italian version of the Depression Anxiety Stress Scales. Psychology, Health & Medicine, 15(5), 607–621. https://doi.org/10.1080/13548506.2010.498889

Sinclair, S. J., Siefert, C. J., Slavin-Mulford, J. M., Stein, M. B., Renna, M., & Blais, M. A. (2012). Psychometric evaluation and normative data for the Depression, Anxiety, and Stress Scales-21 (DASS-21) in a nonclinical sample of U.S. adults. Evaluation & the Health Professions, 35(3), 259–279. https://doi.org/10.1177/0163278711424282

Spielberger, C. D., Goruch, R. L., & Lushene, R. E. (1970). Manual for State Trait Anxiety Inventory (STAI Y-II). Consulting Psychologist Press.

Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006). A brief measure for assessing generalized anxiety disorder. Archives of Internal Medicine, 166(10), 1092. https://doi.org/10.1001/archinte.166.10.1092

Tonsing, K. N. (2014). Psychometric properties and validation of Nepali version of the Depression Anxiety Stress Scales (DASS-21). Asian Journal of Psychiatry, 8, 63–66. https://doi.org/10.1016/j.ajp.2013.11.001

Tran, T. D., Tran, T., & Fisher, J. (2013). Validation of the depression anxiety stress scales (DASS) 21 as a screening instrument for depression and anxiety in a rural community-based cohort of northern Vietnamese women. BMC Psychiatry, 13(1), 24. https://doi.org/10.1186/1471-244X-13-24

Tully, P. J., Zajac, I. T., & Venning, A. J. (2009). The structure of Anxiety and Depression in a normative sample of younger and older Australian adolescents. Journal of Abnormal Child Psychology, 37(5), 717–726. https://doi.org/10.1007/s10802-009-9306-4

van de Schoot, R., Lugtig, P., & Hox, J. (2012). A checklist for testing measurement invariance. European Journal of Developmental Psychology, 9(4), 486–492. https://doi.org/10.1080/17405629.2012.686740

Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4–70. https://doi.org/10.1177/109442810031002

Vignola, R. C. B., & Tucci, A. M. (2014). Adaptation and validation of the Depression, Anxiety and Stress Scale (DASS) to Brazilian Portuguese. Journal of Affective Disorders, 155(1), 104–109. https://doi.org/10.1016/j.jad.2013.10.031

Wang, B., You, J., Lin, M. P., Xu, S., & Leung, F. (2017). Developmental trajectories of nonsuicidal self-injury in adolescence and intrapersonal/interpersonal risk factors. Journal of Research on Adolescence, 27(2), 392–406. https://doi.org/10.1111/jora.12273

Watson, D., Clark, L. A., Weber, K., Assenheimer, J. S., Strauss, M. E., & McCormick, R. A. (1995). Testing a tripartite model: II. Exploring the symptom structure of anxiety and depression in student, adult, and patient samples. Journal of Abnormal Psychology, 104(1), 15–25. https://doi.org/10.1037/0021-843X.104.1.15

Xavier, S., João Martins, M., Pereira, A. T., Paula Amaral, A., João Soares, M., Roque, C., & Macedo, A. (2017). Contribution for the Portuguese validation of the Depression, Anxiety and Stress Scales (DASS-21): Comparison between dimensional models in a sample of students. European Psychiatry, 41(S1), S416–S416. https://doi.org/10.1016/j.eurpsy.2017.01.365

Yıldırım, A., Boysan, M., & Kefeli, M. C. (2018). Psychometric properties of the Turkish version of the Depression Anxiety Stress Scale-21 (DASS-21). British Journal of Guidance and Counselling, 46(5), 582–595. https://doi.org/10.1080/03069885.2018.1442558

Yohannes, A. M., Dryden, S., & Hanania, N. A. (2019). Validity and responsiveness of the Depression Anxiety Stress Scales-21 (DASS-21) in COPD. Chest, 155(6), 1166–1177. https://doi.org/10.1016/j.chest.2018.12.010

Zanon, C., Brenner, R. E., Baptista, M. N., Vogel, D. L., Rubin, M., Al-Darmaki, F. R., Gonçalves, M., Heath, P. J., Liao, H. Y., Mackenzie, C. S., Topkaya, N., Wade, N. G., & Zlati, A. (2020). Examining the dimensionality, reliability, and invariance of the Depression, Anxiety, and Stress Scale-21 (DASS-21) across eight countries. Assessment. https://doi.org/10.1177/1073191119887449

Zhang, B., Sun, T., Cao, M., & Drasgow, F. (2020). Using bifactor models to examine the predictive validity of hierarchical constructs: Pros, cons, and solutions. Organizational Research Methods, 109442812091552. https://doi.org/10.1177/1094428120915522

Downloads

Published

2021-05-30

How to Cite

Muttaqin, D., & Ripa, S. (2021). Psychometric properties of the Indonesian version of the Depression Anxiety Stress Scale: Factor structure, reliability, gender, and age measurement invariance. Psikohumaniora: Jurnal Penelitian Psikologi, 6(1), 61–76. https://doi.org/10.21580/pjpp.v6i1.7815

Issue

Section

Articles