Psychometric properties of the Five-executive Function Tests in Indonesian samples

Article Sidebar

PDF
Published: May 30, 2024
DOI: https://doi.org/10.21580/pjpp.v9i1.20957
Keywords:
clinical condition, executive function, neuropsychological adapted test

Main Article Content

Ni Made Swasti Wulanyani
Department of Psychology, Faculty of Medicine, Universitas Udayana, Denpasar
https://orcid.org/0000-0002-9448-7918
Lucia Trisni Widhianingtanti
Department of Psychology, Faculty of Psychology, Universitas Katolik Soegijapranata, Semarang
https://orcid.org/0000-0002-1706-0662
Aria Saloka Immanuel
Department of Psychology, Faculty of Medicine, Universitas Udayana, Denpasar
https://orcid.org/0000-0002-5808-4759
Aireen Rhammy Kinara Aisyah
Department of Psychology, Faculty of Psychology, Universitas Katolik Indonesia Atma Jaya, Jakarta
https://orcid.org/0000-0002-8771-8749
Marc P. H. Hendriks
Donders Institute for Brain, Cognition, and Behaviour, Radboud University, Nijmegen, the Netherlands; Department of Psychology, Faculty of Psychology, Universitas Katolik Indonesia Atma Jaya, Jakarta, Indonesia
https://orcid.org/0000-0002-5321-7970
Yohana Ratrin Hestyanti
Department of Psychology, Faculty of Psychology, Universitas Katolik Indonesia Atma Jaya, Jakarta
https://orcid.org/0000-0001-9091-7944
Angela Oktavia Suryani
Department of Psychology, Faculty of Psychology, Universitas Katolik Indonesia Atma Jaya, Jakarta
https://orcid.org/0000-0001-5016-4802
Gilles van Luijtelaar
Donders Institute for Brain, Cognition, and Behaviour, Radboud University, Nijmegen, the Netherlands; Department of Psychology, Faculty of Psychology, Universitas Kristen Maranatha, Bandung, Indonesia
https://orcid.org/0000-0002-0710-3403

Abstract

Difficulties in executive function (EF) may be causative factors in clinical conditions, including learning disabilities, depression, and anxiety. However, defining the structure of EF is an ongoing issue, although Miyake’s three-factor structure is widely accepted. This study aims to discover the underlying factor structure of EF domains, as measured by five tests and the scores of 840 participants, to establish the domains’ validity and reliability. Five neuropsychological tests were included in the exploratory and confirmatory factor analyses (EFA and CFA): the Digit Span (DS); the Stroop Color Word Test (Stroop Test); the phonemic Verbal Fluency Test (pVFT); the Five Point Test (5PT); and the Trail Making Test (TMT). EFA could be meaningfully performed (KMO = .862, Bartlett’s test: ????2 =1393.169, df 45, p < .001) and yielded three factors closely mirroring the three core domains of EF. CFA of the model in which the 5PT loaded on factor 2 showed the best goodness of fit indicators, although the difference with the other three-factor models was small. Currently, these EF tests are available in Indonesia and suitable for use, although obtaining normative scores adjusted for demographic factors is necessary.

Downloads

Download data is not yet available.

Article Details

How to Cite
Wulanyani, N. M. S., Widhianingtanti, L. T., Immanuel, A. S., Aisyah, A. R. K., Hendriks, M. P. H., Hestyanti, Y. R., … van Luijtelaar, G. (2024). Psychometric properties of the Five-executive Function Tests in Indonesian samples. Psikohumaniora: Jurnal Penelitian Psikologi, 9(1), 125–146. https://doi.org/10.21580/pjpp.v9i1.20957
Issue
Vol. 9 No. 1 (2024)
Section
Articles

The copyright of the accepted article shall be assigned to the publisher of the journal. The intended copyright includes the right to publish the article in various forms (including reprints). The journal maintains the publishing rights to published articles.

In line with the license, authors and any users (readers and other researchers) are allowed to share and adapt the material only for non-commercial purposes. In addition, the material must be given appropriate credit, provided with a link to the license, and indicated if changes were made. If authors remix, transform, or build upon the material, authors must distribute their contributions under the same license as the original.

Author Biographies

Ni Made Swasti Wulanyani, Department of Psychology, Faculty of Medicine, Universitas Udayana, Denpasar

Lucia Trisni Widhianingtanti, Department of Psychology, Faculty of Psychology, Universitas Katolik Soegijapranata, Semarang

Aria Saloka Immanuel, Department of Psychology, Faculty of Medicine, Universitas Udayana, Denpasar

Yohana Ratrin Hestyanti, Department of Psychology, Faculty of Psychology, Universitas Katolik Indonesia Atma Jaya, Jakarta

Angela Oktavia Suryani, Department of Psychology, Faculty of Psychology, Universitas Katolik Indonesia Atma Jaya, Jakarta

Gilles van Luijtelaar, Donders Institute for Brain, Cognition, and Behaviour, Radboud University, Nijmegen, the Netherlands; Department of Psychology, Faculty of Psychology, Universitas Kristen Maranatha, Bandung, Indonesia

References

Aita, S. L., Beach, J. D., Taylor, S. E., Borgogna, N. C., Harrell, M. N., & Hill, B. D. (2019). Executive, language, or both? An examination of the construct validity of verbal fluency measures. Applied Neuropsychology: Adult, 26(5), 441–451. https://doi.org/10.1080/23279095.2018.1439830

Alavi, M., Visentin, D. C., Thapa, D. K., Hunt, G. E., Watson, R., & Cleary, M. (2020). Chi‐square for model fit in confirmatory factor analysis. Journal of Advanced Nursing, 76(9), 2209–2211. https://doi.org/10.1111/jan.14399

Baddeley, A. D., & Hitch, G. (1974). Working memory. In Psychology of Learning and Motivation (pp. 47–89). Academic Press.

Bourrier, S. C., Berman, M. G., & Enns, J. T. (2018). Cognitive strategies and natural environments interact in influencing executive function. Frontiers in Psychology, 9. https://doi.org/10.3389/fpsyg.2018.01248

Brown, T. A. (2015). Confirmatory factor analysis for applied research. Guilford Press.

Canivez, G. L., Watkins, M. W., & McGill, R. J. (2019). Construct validity of the Wechsler Intelligence Scale For Children – Fifth UK Edition: Exploratory and confirmatory factor analyses of the 16 primary and secondary subtests. British Journal of Educational Psychology, 89(2), 195–224. https://doi.org/10.1111/bjep.12230

Chadha, N. K. (2009). Applied psychometry. SAGE Publications India Pvt Ltd. https://doi.org/10.4135/9788132108221

Chan, R., Shum, D., Toulopoulou, T., & Chen, E. (2008). Assessment of executive functions: Review of instruments and identification of critical issues. Archives of Clinical Neuropsychology, 23(2), 201–216. https://doi.org/10.1016/j.acn.2007.08.010

Chan, T., Wang, I., & Ybarra, O. (2021). Leading and managing the workplace: The role of executive functions. Academy of Management Perspectives, 35(1), 142–164. https://doi.org/10.5465/amp.2017.0215

Choi, H. J., Lee, D. Y., Seo, E. H., Jo, M. K., Sohn, B. K., Choe, Y. M., Byun, M. S., Kim, J. W., Kim, S. G., Yoon, J. C., Jhoo, J. H., Kim, K. W., & Woo, J. I. (2014). A normative study of the digit span in an educationally diverse elderly population. Psychiatry Investigation, 11(1), 39–43. https://doi.org/10.4306/pi.2014.11.1.39

Dadín, C. O., Salgado, D. R., & Fernández, E. A. (2009). Natural sex hormone cycles and gender differences in memory. Actas Espanolas de Psiquiatria, 37(2), 68–74. http://www.ncbi.nlm.nih.gov/pubmed/19401854

Danielsson, H., Henry, L., Messer, D., & Rönnberg, J. (2012). Strengths and weaknesses in executive functioning in children with intellectual disability. Research in Developmental Disabilities, 33(2), 600–607. https://doi.org/10.1016/j.ridd.2011.11.004

Danielsson, H., Henry, L., Rönnberg, J., & Nilsson, L.-G. (2010). Executive functions in individuals with intellectual disability. Research in Developmental Disabilities, 31(6), 1299–1304. https://doi.org/10.1016/j.ridd.2010.07.012

Diamond, A. (2013). Executive functions. Annual Review of Psychology, 64(1), 135–168. https://doi.org/10.1146/annurev-psych-113011-143750

Engle, R. W. (2010). Role of working‐memory capacity in cognitive control. Current Anthropology, 51(S1), S17–S26. https://doi.org/10.1086/650572

Ferguson, H. J., Brunsdon, V. E. A., & Bradford, E. E. F. (2021). The developmental trajectories of executive function from adolescence to old age. Scientific Reports, 11(1), 1382. https://doi.org/10.1038/s41598-020-80866-1

Field, A. P. (2013). Discovering statistics using IBM SPSS statistics. SAGE.

Fleming, K. A., Heintzelman, S. J., & Bartholow, B. D. (2016). Specifying associations between conscientiousness and executive functioning: Mental set shifting, not prepotent response inhibition or working memory updating. Journal of Personality, 84(3), 348–360. https://doi.org/10.1111/jopy.12163

Fokkema, M., & Greiff, S. (2017). How performing PCA and CFA on the same data equals trouble. European Journal of Psychological Assessment, 33(6), 399–402. https://doi.org/10.1027/1015-5759/a000460

Friedman, N. P., Miyake, A., Altamirano, L. J., Corley, R. P., Young, S. E., Rhea, S. A., & Hewitt, J. K. (2016). Stability and change in executive function abilities from late adolescence to early adulthood: A longitudinal twin study. Developmental Psychology, 52(2), 326–340. https://doi.org/10.1037/dev0000075

Geerinck, A., Alekna, V., Beaudart, C., Bautmans, I., Cooper, C., De Souza Orlandi, F., Konstantynowicz, J., Montero-Errasquín, B., Topinková, E., Tsekoura, M., Reginster, J.-Y., & Bruyère, O. (2019). Standard error of measurement and smallest detectable change of the Sarcopenia Quality of Life (SarQoL) questionnaire: An analysis of subjects from 9 validation studies. Plos One, 14(4), e0216065. https://doi.org/10.1371/journal.pone.0216065

Giovagnoli, A. R., Del Pesce, M., Mascheroni, S., Simoncelli, M., Laiacona, M., & Capitani, E. (1996). Trail making test: Normative values from 287 normal adult controls. The Italian Journal of Neurological Sciences, 17(4), 305–309. https://doi.org/10.1007/BF01997792

Gläscher, J., Adolphs, R., Damasio, H., Bechara, A., Rudrauf, D., Calamia, M., Paul, L. K., & Tranel, D. (2012). Lesion mapping of cognitive control and value-based decision making in the prefrontal cortex. Proceedings of the National Academy of Sciences, 109(36), 14681–14686. https://doi.org/10.1073/pnas.1206608109

Goebel, S., Fischer, R., Ferstl, R., & Mehdorn, H. M. (2009). Normative data and psychometric properties for qualitative and quantitative scoring criteria of the Five-point Test. The Clinical Neuropsychologist, 23(4), 675–690. https://doi.org/10.1080/13854040802389185

Hale, J. B., Hoeppner, J.-A. B., & Fiorello, C. A. (2002). Analyzing digit span components for assessment of attention processes. Journal of Psychoeducational Assessment, 20(2), 128–143. https://doi.org/10.1177/073428290202000202

Hantoro, W. D., Setyaningrum, C. T. S., & Dahlan, P. (2019). Reliabilitas dan validitas backward digit span test dalam screening gangguan atensi anak sekolah dasar. Berkala NeuroSains, 18(2), 90–93. https://journal.ugm.ac.id/bns/article/view/54992

Hendrawan, D., & Hatta, T. (2010). Evaluation of stimuli for development of the Indonesian version of verbal fluency task using ranking method. Psychologia, 53(1), 14–26. https://doi.org/10.2117/psysoc.2010.14

Himi, S. A., Bühner, M., & Hilbert, S. (2021). Advancing the understanding of the factor structure of executive functioning. Journal of Intelligence, 9(1), 16. https://doi.org/10.3390/jintelligence9010016

Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118

Huizinga, M., Dolan, C. V., & van der Molen, M. W. (2006). Age-related change in executive function: Developmental trends and a latent variable analysis. Neuropsychologia, 44(11), 2017–2036. https://doi.org/10.1016/j.neuropsychologia.2006.01.010

Im‐Bolter, N., Johnson, J., & Pascual‐Leone, J. (2006). Processing limitations in children with specific language impairment: The role of executive function. Child Development, 77(6), 1822–1841. https://doi.org/10.1111/j.1467-8624.2006.00976.x

Ionescu, T. (2012). Exploring the nature of cognitive flexibility. New Ideas in Psychology, 30(2), 190–200. https://doi.org/10.1016/j.newideapsych.2011.11.001

Ito, T. A., Friedman, N. P., Bartholow, B. D., Correll, J., Loersch, C., Altamirano, L. J., & Miyake, A. (2015). Toward a comprehensive understanding of executive cognitive function in implicit racial bias. Journal of Personality and Social Psychology, 108(2), 187–218. https://doi.org/10.1037/a0038557

Jorm, A. F., Anstey, K. J., Christensen, H., & Rodgers, B. (2004). Gender differences in cognitive abilities: The mediating role of health state and health habits. Intelligence, 32(1), 7–23. https://doi.org/10.1016/j.intell.2003.08.001

Khalil, M. S. (2010). Preliminary Arabic normative data of neuropsychological tests: The verbal and design fluency. Journal of Clinical and Experimental Neuropsychology, 32(9), 1028–1035. https://doi.org/10.1080/13803391003672305

Koci, J., & Donaldson, S. I. (2023). Well-being and success for university students: Applying PERMA+4. Routledge - Taylor & Francis.

Kurniawan, A., & Kusrohmaniah, S. (2018). Performa inhibitory control dengan induksi Sing-a-Song Stress Test pada dewasa awal. Jurnal Psikologi, 45(1), 40–51. https://doi.org/10.22146/jpsi.25846

Kyriazos, T. A. (2018). Applied psychometrics: Writing-up a factor analysis construct validation study with eExamples. Psychology, 9(11), 2503–2530. https://doi.org/10.4236/psych.2018.911144

Lebon, T. (2014). Achieve your potential with positive psychology: CBT, mindfulness and practical philosophy for finding lasting happiness. Hachette UK.

Lezak, M. D. (2004). Neuropsychological assessment. Oxford University Press, USA.

Logue, S. F., & Gould, T. J. (2014). The neural and genetic basis of executive function: Attention, cognitive flexibility, and response inhibition. Pharmacology Biochemistry and Behavior, 123, 45–54. https://doi.org/10.1016/j.pbb.2013.08.007

MacLeod, C. M. (2010). Stroop effect. In The Corsini encyclopedia of psychology (pp. 1–2). Wiley. https://doi.org/10.1002/9780470479216.corpsy0952

Matias-Guiu, J. A., Pytel, V., Delgado-Álvarez, A., Delgado-Alonso, C., Cortés-Martínez, A., Fernández-Oliveira, A., & Matías-Guiu, J. (2022). The Five-point Test: Normative data for middle-aged and elderly Spaniards. Applied Neuropsychology: Adult, 29(6), 1323–1331. https://doi.org/10.1080/23279095.2021.1873137

McCabe, D. P., Roediger, H. L., McDaniel, M. A., Balota, D. A., & Hambrick, D. Z. (2010). The relationship between working memory capacity and executive functioning: Evidence for a common executive attention construct. Neuropsychology, 24(2), 222–243. https://doi.org/10.1037/a0017619

Miyake, A., Emerson, M. J., & Friedman, N. P. (2000). Assessment of executive functions in clinical settings: Problems and recommendations. Seminars in Speech and Language, 21(2), 0169–0183. https://doi.org/10.1055/s-2000-7563

Morasch, K. C., & Bell, M. A. (2011). The role of inhibitory control in behavioral and physiological expressions of toddler executive function. Journal of Experimental Child Psychology, 108(3), 593–606. https://doi.org/10.1016/j.jecp.2010.07.003

Mvududu, N. H., & Sink, C. A. (2013). Factor analysis in counseling research and practice. Counseling Outcome Research and Evaluation, 4(2), 75–98. https://doi.org/10.1177/2150137813494766

Myers, N. D., Ahn, S., & Jin, Y. (2011). Sample size and power estimates for a confirmatory factor analytic model in exercise and sport. Research Quarterly for Exercise and Sport, 82(3), 412–423. https://doi.org/10.1080/02701367.2011.10599773

Panerai, S., Tasca, D., Ferri, R., Genitori D’Arrigo, V., & Elia, M. (2014). Executive functions and adaptive behaviour in autism spectrum disorders with and without intellectual disability. Psychiatry Journal, 1–11. https://doi.org/10.1155/2014/941809

Pesau, H. G., & Luijtelaar, G. Van. (2021). Equivalence of traditional and internet-delivered testing of word fluency tasks. Jurnal Psikologi, 20(1), 35–49. https://doi.org/10.14710/jp.20.1.35-49

Peterson, G. (2006). Cultural theory and emotions. In Handbook of the Sociology of Emotions (pp. 114–134). Springer US. https://doi.org/10.1007/978-0-387-30715-2_6

Pires, L., Moura, O., Guerrini, C., Buekenhout, I., Simões, M. R., & Leitão, J. (2019). Confirmatory factor analysis of neurocognitive measures in healthy young adults: The relation of executive functions with other neurocognitive functions. Archives of Clinical Neuropsychology, 34(3), 350–365. https://doi.org/10.1093/arclin/acy040

Ramchandran, K., Colbert, A. E., Brown, K. G., Denburg, N. L., & Tranel, D. (2016). Exploring the neuropsychological antecedents of transformational leadership: The role of executive function. Adaptive Human Behavior and Physiology, 2(4), 325–343. https://doi.org/10.1007/s40750-016-0051-y

Ren, X., Schweizer, K., Wang, T., Chu, P., & Gong, Q. (2017). On the relationship between executive functions of working memory and components derived from fluid intelligence measures. Acta Psychologica, 180, 79–87. https://doi.org/10.1016/j.actpsy.2017.09.002

Scarpina, F., & Tagini, S. (2017). The Stroop Color and Word Test. Frontiers in Psychology, 8. https://doi.org/10.3389/fpsyg.2017.00557

Sherman, E., Tan, J. E., & Hrabok, M. (2022). A compendium of neuropsychological tests: Fundamentals of neuropsychological assessment and test reviews for clinical practice (4th ed.). Oxford University Press.

Snyder, H. R., Miyake, A., & Hankin, B. L. (2015). Advancing understanding of executive function impairments and psychopathology: Bridging the gap between clinical and cognitive approaches. Frontiers in Psychology, 6. https://doi.org/10.3389/fpsyg.2015.00328

Strauss, E., Sherman, E. M. S., & Spreen, O. (2006). A compendium of neuropsychological tests: Administration, norms, and commentary (3rd ed.). Oxford University Press.

Strauss, G. P., Allen, D. N., Jorgensen, M. L., & Cramer, S. L. (2005). Test-retest reliability of Standard and Emotional Stroop Tasks. Assessment, 12(3), 330–337. https://doi.org/10.1177/1073191105276375

Suwartono, C., Halim, M. S., Hidajat, L. L., Hendriks, M. P. H., & Kessels, R. P. C. (2014). Development and reliability of the Indonesian Wechsler Adult Intelligence Scale—Fourth Edition (WAIS-IV). Psychology, 5(14), 1611–1619. https://doi.org/10.4236/psych.2014.514171

Tabachnick, B. G., & Fidell, L. S. (2019). Using multivariate statistics (7th ed.). Pearson.

Testa, R., Bennett, P., & Ponsford, J. (2012). Factor analysis of nineteen executive function tests in a healthy adult population. Archives of Clinical Neuropsychology, 27(2), 213–224. https://doi.org/10.1093/arclin/acr112

Troyer, A. K., Moscovitch, M., & Winocur, G. (1997). Clustering and switching as two components of verbal fluency: Evidence from younger and older healthy adults. Neuropsychology, 11(1), 138–146. https://doi.org/10.1037/0894-4105.11.1.138

Tucha, L., Aschenbrenner, S., Koerts, J., & Lange, K. W. (2012). The Five-point Test: Reliability, validity and normative data for children and adults. Plos One, 7(9), e46080. https://doi.org/10.1371/journal.pone.0046080

Vandierendonck, A. (2021). On the utility of integrated speed-accuracy measures when speed-accuracy trade-off is present. Journal of Cognition, 4(1), 22. https://doi.org/10.5334/joc.154

Vicente, S. G., Rivera, D., Barbosa, F., Gaspar, N., Dores, A. R., Mascialino, G., & Arango-Lasprilla, J. C. (2021). Normative data for tests of attention and executive functions in a sample of European Portuguese adult population. Aging, Neuropsychology, and Cognition, 28(3), 418–437. https://doi.org/10.1080/13825585.2020.1781768

Wahyuningrum, S. E., Sulastri, A., Hendriks, M. P. H., Indonesian NP Consortium, & van Luijtelaar, G. (2022). The Indonesian Neuropsychological Test Battery (INTB): Psychometric properties, preliminary normative scores, the underlying cognitive constructs, and the effects of age and education. Acta Neuropsychologica, 20(4), 445–470. https://doi.org/10.5604/01.3001.0016.1339

Wahyuningrum, S. E., van Luijtelaar, G., & Sulastri, A. (2023). An online platform and a dynamic database for neuropsychological assessment in Indonesia. Applied Neuropsychology: Adult, 30(3), 330–339. https://doi.org/10.1080/23279095.2021.1943397

Whiteside, D. M., Kealey, T., Semla, M., Luu, H., Rice, L., Basso, M. R., & Roper, B. (2016). Verbal fluency: Language or executive function measure? Applied Neuropsychology: Adult, 23(1), 29–34. https://doi.org/10.1080/23279095.2015.1004574

Widhianingtanti, L. T., Luijtelaar, G. Van, Suryani, A. O., Hestyanti, Y. R., & Sulastri, A. (2022). Indonesian Trail Making Test: Analysis of psychometric properties, effects of demographic variables, and norms for Javanese adults. Jurnal Psikologi, 49(2), 104–122. https://doi.org/10.22146/jpsi.68953

Zelazo, P. D. (2020). Executive function and psychopathology: A neurodevelopmental perspective. Annual Review of Clinical Psychology, 16(1), 431–454. https://doi.org/10.1146/annurev-clinpsy-072319-024242