Psychometric properties of the Five-executive Function Tests in Indonesian samples
DOI:
https://doi.org/10.21580/pjpp.v9i1.20957Keywords:
clinical condition, executive function, neuropsychological adapted testAbstract
Difficulties in executive function (EF) may be causative factors in clinical conditions, including learning disabilities, depression, and anxiety. However, defining the structure of EF is an ongoing issue, although Miyake’s three-factor structure is widely accepted. This study aims to discover the underlying factor structure of EF domains, as measured by five tests and the scores of 840 participants, to establish the domains’ validity and reliability. Five neuropsychological tests were included in the exploratory and confirmatory factor analyses (EFA and CFA): the Digit Span (DS); the Stroop Color Word Test (Stroop Test); the phonemic Verbal Fluency Test (pVFT); the Five Point Test (5PT); and the Trail Making Test (TMT). EFA could be meaningfully performed (KMO = .862, Bartlett’s test: ????2 =1393.169, df 45, p < .001) and yielded three factors closely mirroring the three core domains of EF. CFA of the model in which the 5PT loaded on factor 2 showed the best goodness of fit indicators, although the difference with the other three-factor models was small. Currently, these EF tests are available in Indonesia and suitable for use, although obtaining normative scores adjusted for demographic factors is necessary.Downloads
References
Aita, S. L., Beach, J. D., Taylor, S. E., Borgogna, N. C., Harrell, M. N., & Hill, B. D. (2019). Executive, language, or both? An examination of the construct validity of verbal fluency measures. Applied Neuropsychology: Adult, 26(5), 441–451. https://doi.org/10.1080/23279095.2018.1439830
Alavi, M., Visentin, D. C., Thapa, D. K., Hunt, G. E., Watson, R., & Cleary, M. (2020). Chi‐square for model fit in confirmatory factor analysis. Journal of Advanced Nursing, 76(9), 2209–2211. https://doi.org/10.1111/jan.14399
Baddeley, A. D., & Hitch, G. (1974). Working memory. In Psychology of Learning and Motivation (pp. 47–89). Academic Press.
Bourrier, S. C., Berman, M. G., & Enns, J. T. (2018). Cognitive strategies and natural environments interact in influencing executive function. Frontiers in Psychology, 9. https://doi.org/10.3389/fpsyg.2018.01248
Brown, T. A. (2015). Confirmatory factor analysis for applied research. Guilford Press.
Canivez, G. L., Watkins, M. W., & McGill, R. J. (2019). Construct validity of the Wechsler Intelligence Scale For Children – Fifth UK Edition: Exploratory and confirmatory factor analyses of the 16 primary and secondary subtests. British Journal of Educational Psychology, 89(2), 195–224. https://doi.org/10.1111/bjep.12230
Chadha, N. K. (2009). Applied psychometry. SAGE Publications India Pvt Ltd. https://doi.org/10.4135/9788132108221
Chan, R., Shum, D., Toulopoulou, T., & Chen, E. (2008). Assessment of executive functions: Review of instruments and identification of critical issues. Archives of Clinical Neuropsychology, 23(2), 201–216. https://doi.org/10.1016/j.acn.2007.08.010
Chan, T., Wang, I., & Ybarra, O. (2021). Leading and managing the workplace: The role of executive functions. Academy of Management Perspectives, 35(1), 142–164. https://doi.org/10.5465/amp.2017.0215
Choi, H. J., Lee, D. Y., Seo, E. H., Jo, M. K., Sohn, B. K., Choe, Y. M., Byun, M. S., Kim, J. W., Kim, S. G., Yoon, J. C., Jhoo, J. H., Kim, K. W., & Woo, J. I. (2014). A normative study of the digit span in an educationally diverse elderly population. Psychiatry Investigation, 11(1), 39–43. https://doi.org/10.4306/pi.2014.11.1.39
Dadín, C. O., Salgado, D. R., & Fernández, E. A. (2009). Natural sex hormone cycles and gender differences in memory. Actas Espanolas de Psiquiatria, 37(2), 68–74. http://www.ncbi.nlm.nih.gov/pubmed/19401854
Danielsson, H., Henry, L., Messer, D., & Rönnberg, J. (2012). Strengths and weaknesses in executive functioning in children with intellectual disability. Research in Developmental Disabilities, 33(2), 600–607. https://doi.org/10.1016/j.ridd.2011.11.004
Danielsson, H., Henry, L., Rönnberg, J., & Nilsson, L.-G. (2010). Executive functions in individuals with intellectual disability. Research in Developmental Disabilities, 31(6), 1299–1304. https://doi.org/10.1016/j.ridd.2010.07.012
Diamond, A. (2013). Executive functions. Annual Review of Psychology, 64(1), 135–168. https://doi.org/10.1146/annurev-psych-113011-143750
Engle, R. W. (2010). Role of working‐memory capacity in cognitive control. Current Anthropology, 51(S1), S17–S26. https://doi.org/10.1086/650572
Ferguson, H. J., Brunsdon, V. E. A., & Bradford, E. E. F. (2021). The developmental trajectories of executive function from adolescence to old age. Scientific Reports, 11(1), 1382. https://doi.org/10.1038/s41598-020-80866-1
Field, A. P. (2013). Discovering statistics using IBM SPSS statistics. SAGE.
Fleming, K. A., Heintzelman, S. J., & Bartholow, B. D. (2016). Specifying associations between conscientiousness and executive functioning: Mental set shifting, not prepotent response inhibition or working memory updating. Journal of Personality, 84(3), 348–360. https://doi.org/10.1111/jopy.12163
Fokkema, M., & Greiff, S. (2017). How performing PCA and CFA on the same data equals trouble. European Journal of Psychological Assessment, 33(6), 399–402. https://doi.org/10.1027/1015-5759/a000460
Friedman, N. P., Miyake, A., Altamirano, L. J., Corley, R. P., Young, S. E., Rhea, S. A., & Hewitt, J. K. (2016). Stability and change in executive function abilities from late adolescence to early adulthood: A longitudinal twin study. Developmental Psychology, 52(2), 326–340. https://doi.org/10.1037/dev0000075
Geerinck, A., Alekna, V., Beaudart, C., Bautmans, I., Cooper, C., De Souza Orlandi, F., Konstantynowicz, J., Montero-Errasquín, B., Topinková, E., Tsekoura, M., Reginster, J.-Y., & Bruyère, O. (2019). Standard error of measurement and smallest detectable change of the Sarcopenia Quality of Life (SarQoL) questionnaire: An analysis of subjects from 9 validation studies. Plos One, 14(4), e0216065. https://doi.org/10.1371/journal.pone.0216065
Giovagnoli, A. R., Del Pesce, M., Mascheroni, S., Simoncelli, M., Laiacona, M., & Capitani, E. (1996). Trail making test: Normative values from 287 normal adult controls. The Italian Journal of Neurological Sciences, 17(4), 305–309. https://doi.org/10.1007/BF01997792
Gläscher, J., Adolphs, R., Damasio, H., Bechara, A., Rudrauf, D., Calamia, M., Paul, L. K., & Tranel, D. (2012). Lesion mapping of cognitive control and value-based decision making in the prefrontal cortex. Proceedings of the National Academy of Sciences, 109(36), 14681–14686. https://doi.org/10.1073/pnas.1206608109
Goebel, S., Fischer, R., Ferstl, R., & Mehdorn, H. M. (2009). Normative data and psychometric properties for qualitative and quantitative scoring criteria of the Five-point Test. The Clinical Neuropsychologist, 23(4), 675–690. https://doi.org/10.1080/13854040802389185
Hale, J. B., Hoeppner, J.-A. B., & Fiorello, C. A. (2002). Analyzing digit span components for assessment of attention processes. Journal of Psychoeducational Assessment, 20(2), 128–143. https://doi.org/10.1177/073428290202000202
Hantoro, W. D., Setyaningrum, C. T. S., & Dahlan, P. (2019). Reliabilitas dan validitas backward digit span test dalam screening gangguan atensi anak sekolah dasar. Berkala NeuroSains, 18(2), 90–93. https://journal.ugm.ac.id/bns/article/view/54992
Hendrawan, D., & Hatta, T. (2010). Evaluation of stimuli for development of the Indonesian version of verbal fluency task using ranking method. Psychologia, 53(1), 14–26. https://doi.org/10.2117/psysoc.2010.14
Himi, S. A., Bühner, M., & Hilbert, S. (2021). Advancing the understanding of the factor structure of executive functioning. Journal of Intelligence, 9(1), 16. https://doi.org/10.3390/jintelligence9010016
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
Huizinga, M., Dolan, C. V., & van der Molen, M. W. (2006). Age-related change in executive function: Developmental trends and a latent variable analysis. Neuropsychologia, 44(11), 2017–2036. https://doi.org/10.1016/j.neuropsychologia.2006.01.010
Im‐Bolter, N., Johnson, J., & Pascual‐Leone, J. (2006). Processing limitations in children with specific language impairment: The role of executive function. Child Development, 77(6), 1822–1841. https://doi.org/10.1111/j.1467-8624.2006.00976.x
Ionescu, T. (2012). Exploring the nature of cognitive flexibility. New Ideas in Psychology, 30(2), 190–200. https://doi.org/10.1016/j.newideapsych.2011.11.001
Ito, T. A., Friedman, N. P., Bartholow, B. D., Correll, J., Loersch, C., Altamirano, L. J., & Miyake, A. (2015). Toward a comprehensive understanding of executive cognitive function in implicit racial bias. Journal of Personality and Social Psychology, 108(2), 187–218. https://doi.org/10.1037/a0038557
Jorm, A. F., Anstey, K. J., Christensen, H., & Rodgers, B. (2004). Gender differences in cognitive abilities: The mediating role of health state and health habits. Intelligence, 32(1), 7–23. https://doi.org/10.1016/j.intell.2003.08.001
Khalil, M. S. (2010). Preliminary Arabic normative data of neuropsychological tests: The verbal and design fluency. Journal of Clinical and Experimental Neuropsychology, 32(9), 1028–1035. https://doi.org/10.1080/13803391003672305
Koci, J., & Donaldson, S. I. (2023). Well-being and success for university students: Applying PERMA+4. Routledge - Taylor & Francis.
Kurniawan, A., & Kusrohmaniah, S. (2018). Performa inhibitory control dengan induksi Sing-a-Song Stress Test pada dewasa awal. Jurnal Psikologi, 45(1), 40–51. https://doi.org/10.22146/jpsi.25846
Kyriazos, T. A. (2018). Applied psychometrics: Writing-up a factor analysis construct validation study with eExamples. Psychology, 9(11), 2503–2530. https://doi.org/10.4236/psych.2018.911144
Lebon, T. (2014). Achieve your potential with positive psychology: CBT, mindfulness and practical philosophy for finding lasting happiness. Hachette UK.
Lezak, M. D. (2004). Neuropsychological assessment. Oxford University Press, USA.
Logue, S. F., & Gould, T. J. (2014). The neural and genetic basis of executive function: Attention, cognitive flexibility, and response inhibition. Pharmacology Biochemistry and Behavior, 123, 45–54. https://doi.org/10.1016/j.pbb.2013.08.007
MacLeod, C. M. (2010). Stroop effect. In The Corsini encyclopedia of psychology (pp. 1–2). Wiley. https://doi.org/10.1002/9780470479216.corpsy0952
Matias-Guiu, J. A., Pytel, V., Delgado-Álvarez, A., Delgado-Alonso, C., Cortés-Martínez, A., Fernández-Oliveira, A., & Matías-Guiu, J. (2022). The Five-point Test: Normative data for middle-aged and elderly Spaniards. Applied Neuropsychology: Adult, 29(6), 1323–1331. https://doi.org/10.1080/23279095.2021.1873137
McCabe, D. P., Roediger, H. L., McDaniel, M. A., Balota, D. A., & Hambrick, D. Z. (2010). The relationship between working memory capacity and executive functioning: Evidence for a common executive attention construct. Neuropsychology, 24(2), 222–243. https://doi.org/10.1037/a0017619
Miyake, A., Emerson, M. J., & Friedman, N. P. (2000). Assessment of executive functions in clinical settings: Problems and recommendations. Seminars in Speech and Language, 21(2), 0169–0183. https://doi.org/10.1055/s-2000-7563
Morasch, K. C., & Bell, M. A. (2011). The role of inhibitory control in behavioral and physiological expressions of toddler executive function. Journal of Experimental Child Psychology, 108(3), 593–606. https://doi.org/10.1016/j.jecp.2010.07.003
Mvududu, N. H., & Sink, C. A. (2013). Factor analysis in counseling research and practice. Counseling Outcome Research and Evaluation, 4(2), 75–98. https://doi.org/10.1177/2150137813494766
Myers, N. D., Ahn, S., & Jin, Y. (2011). Sample size and power estimates for a confirmatory factor analytic model in exercise and sport. Research Quarterly for Exercise and Sport, 82(3), 412–423. https://doi.org/10.1080/02701367.2011.10599773
Panerai, S., Tasca, D., Ferri, R., Genitori D’Arrigo, V., & Elia, M. (2014). Executive functions and adaptive behaviour in autism spectrum disorders with and without intellectual disability. Psychiatry Journal, 1–11. https://doi.org/10.1155/2014/941809
Pesau, H. G., & Luijtelaar, G. Van. (2021). Equivalence of traditional and internet-delivered testing of word fluency tasks. Jurnal Psikologi, 20(1), 35–49. https://doi.org/10.14710/jp.20.1.35-49
Peterson, G. (2006). Cultural theory and emotions. In Handbook of the Sociology of Emotions (pp. 114–134). Springer US. https://doi.org/10.1007/978-0-387-30715-2_6
Pires, L., Moura, O., Guerrini, C., Buekenhout, I., Simões, M. R., & Leitão, J. (2019). Confirmatory factor analysis of neurocognitive measures in healthy young adults: The relation of executive functions with other neurocognitive functions. Archives of Clinical Neuropsychology, 34(3), 350–365. https://doi.org/10.1093/arclin/acy040
Ramchandran, K., Colbert, A. E., Brown, K. G., Denburg, N. L., & Tranel, D. (2016). Exploring the neuropsychological antecedents of transformational leadership: The role of executive function. Adaptive Human Behavior and Physiology, 2(4), 325–343. https://doi.org/10.1007/s40750-016-0051-y
Ren, X., Schweizer, K., Wang, T., Chu, P., & Gong, Q. (2017). On the relationship between executive functions of working memory and components derived from fluid intelligence measures. Acta Psychologica, 180, 79–87. https://doi.org/10.1016/j.actpsy.2017.09.002
Scarpina, F., & Tagini, S. (2017). The Stroop Color and Word Test. Frontiers in Psychology, 8. https://doi.org/10.3389/fpsyg.2017.00557
Sherman, E., Tan, J. E., & Hrabok, M. (2022). A compendium of neuropsychological tests: Fundamentals of neuropsychological assessment and test reviews for clinical practice (4th ed.). Oxford University Press.
Snyder, H. R., Miyake, A., & Hankin, B. L. (2015). Advancing understanding of executive function impairments and psychopathology: Bridging the gap between clinical and cognitive approaches. Frontiers in Psychology, 6. https://doi.org/10.3389/fpsyg.2015.00328
Strauss, E., Sherman, E. M. S., & Spreen, O. (2006). A compendium of neuropsychological tests: Administration, norms, and commentary (3rd ed.). Oxford University Press.
Strauss, G. P., Allen, D. N., Jorgensen, M. L., & Cramer, S. L. (2005). Test-retest reliability of Standard and Emotional Stroop Tasks. Assessment, 12(3), 330–337. https://doi.org/10.1177/1073191105276375
Suwartono, C., Halim, M. S., Hidajat, L. L., Hendriks, M. P. H., & Kessels, R. P. C. (2014). Development and reliability of the Indonesian Wechsler Adult Intelligence Scale—Fourth Edition (WAIS-IV). Psychology, 5(14), 1611–1619. https://doi.org/10.4236/psych.2014.514171
Tabachnick, B. G., & Fidell, L. S. (2019). Using multivariate statistics (7th ed.). Pearson.
Testa, R., Bennett, P., & Ponsford, J. (2012). Factor analysis of nineteen executive function tests in a healthy adult population. Archives of Clinical Neuropsychology, 27(2), 213–224. https://doi.org/10.1093/arclin/acr112
Troyer, A. K., Moscovitch, M., & Winocur, G. (1997). Clustering and switching as two components of verbal fluency: Evidence from younger and older healthy adults. Neuropsychology, 11(1), 138–146. https://doi.org/10.1037/0894-4105.11.1.138
Tucha, L., Aschenbrenner, S., Koerts, J., & Lange, K. W. (2012). The Five-point Test: Reliability, validity and normative data for children and adults. Plos One, 7(9), e46080. https://doi.org/10.1371/journal.pone.0046080
Vandierendonck, A. (2021). On the utility of integrated speed-accuracy measures when speed-accuracy trade-off is present. Journal of Cognition, 4(1), 22. https://doi.org/10.5334/joc.154
Vicente, S. G., Rivera, D., Barbosa, F., Gaspar, N., Dores, A. R., Mascialino, G., & Arango-Lasprilla, J. C. (2021). Normative data for tests of attention and executive functions in a sample of European Portuguese adult population. Aging, Neuropsychology, and Cognition, 28(3), 418–437. https://doi.org/10.1080/13825585.2020.1781768
Wahyuningrum, S. E., Sulastri, A., Hendriks, M. P. H., Indonesian NP Consortium, & van Luijtelaar, G. (2022). The Indonesian Neuropsychological Test Battery (INTB): Psychometric properties, preliminary normative scores, the underlying cognitive constructs, and the effects of age and education. Acta Neuropsychologica, 20(4), 445–470. https://doi.org/10.5604/01.3001.0016.1339
Wahyuningrum, S. E., van Luijtelaar, G., & Sulastri, A. (2023). An online platform and a dynamic database for neuropsychological assessment in Indonesia. Applied Neuropsychology: Adult, 30(3), 330–339. https://doi.org/10.1080/23279095.2021.1943397
Whiteside, D. M., Kealey, T., Semla, M., Luu, H., Rice, L., Basso, M. R., & Roper, B. (2016). Verbal fluency: Language or executive function measure? Applied Neuropsychology: Adult, 23(1), 29–34. https://doi.org/10.1080/23279095.2015.1004574
Widhianingtanti, L. T., Luijtelaar, G. Van, Suryani, A. O., Hestyanti, Y. R., & Sulastri, A. (2022). Indonesian Trail Making Test: Analysis of psychometric properties, effects of demographic variables, and norms for Javanese adults. Jurnal Psikologi, 49(2), 104–122. https://doi.org/10.22146/jpsi.68953
Zelazo, P. D. (2020). Executive function and psychopathology: A neurodevelopmental perspective. Annual Review of Clinical Psychology, 16(1), 431–454. https://doi.org/10.1146/annurev-clinpsy-072319-024242
Downloads
Published
How to Cite
Issue
Section
License
The copyright of the accepted article shall be assigned to the publisher of the journal. The intended copyright includes the right to publish the article in various forms (including reprints). The journal maintains the publishing rights to published articles.
In line with the license, authors and any users (readers and other researchers) are allowed to share and adapt the material only for non-commercial purposes. In addition, the material must be given appropriate credit, provided with a link to the license, and indicated if changes were made. If authors remix, transform, or build upon the material, authors must distribute their contributions under the same license as the original.
