Psychometric properties of the Five-executive Function Tests in Indonesian samples

Ni Made Swasti Wulanyani*    -  Department of Psychology, Faculty of Medicine, Universitas Udayana, Denpasar, Indonesia
Lucia Trisni Widhianingtanti    -  Department of Psychology, Faculty of Psychology, Universitas Katolik Soegijapranata, Semarang, Indonesia
Aria Saloka Immanuel    -  Department of Psychology, Faculty of Medicine, Universitas Udayana, Denpasar, Indonesia
Aireen Rhammy Kinara Aisyah    -  Department of Psychology, Faculty of Psychology, Universitas Katolik Indonesia Atma Jaya, Jakarta, Indonesia
Marc P. H. Hendriks    -  Donders Institute for Brain, Cognition, and Behaviour, Radboud University, Nijmegen, the Netherlands; Department of Psychology, Faculty of Psychology, Universitas Katolik Indonesia Atma Jaya, Jakarta, Indonesia
Yohana Ratrin Hestyanti    -  Department of Psychology, Faculty of Psychology, Universitas Katolik Indonesia Atma Jaya, Jakarta, Indonesia
Angela Oktavia Suryani    -  Department of Psychology, Faculty of Psychology, Universitas Katolik Indonesia Atma Jaya, Jakarta, Indonesia
Gilles van Luijtelaar    -  Donders Institute for Brain, Cognition, and Behaviour, Radboud University, Nijmegen, the Netherlands; Department of Psychology, Faculty of Psychology, Universitas Kristen Maranatha, Bandung, Indonesia

(*) Corresponding Author
DOI: 10.21580/pjpp.v9i1.20957
Difficulties in executive function (EF) may be causative factors in clinical conditions, including learning disabilities, depression, and anxiety. However, defining the structure of EF is an ongoing issue, although Miyake’s three-factor structure is widely accepted. This study aims to discover the underlying factor structure of EF domains, as measured by five tests and the scores of 840 participants, to establish the domains’ validity and reliability. Five neuropsychological tests were included in the exploratory and confirmatory factor analyses (EFA and CFA): the Digit Span (DS); the Stroop Color Word Test (Stroop Test); the phonemic Verbal Fluency Test (pVFT); the Five Point Test (5PT); and the Trail Making Test (TMT). EFA could be meaningfully performed (KMO = .862, Bartlett’s test: 𝜒2 =1393.169, df 45, p < .001) and yielded three factors closely mirroring the three core domains of EF. CFA of the model in which the 5PT loaded on factor 2 showed the best goodness of fit indicators, although the difference with the other three-factor models was small. Currently, these EF tests are available in Indonesia and suitable for use, although obtaining normative scores adjusted for demographic factors is necessary.

Keywords: clinical condition; executive function; neuropsychological adapted test

  1. Aita, S. L., Beach, J. D., Taylor, S. E., Borgogna, N. C., Harrell, M. N., & Hill, B. D. (2019). Executive, language, or both? An examination of the construct validity of verbal fluency measures. Applied Neuropsychology: Adult, 26(5), 441–451. https://doi.org/10.1080/23279095.2018.1439830
  2. Alavi, M., Visentin, D. C., Thapa, D. K., Hunt, G. E., Watson, R., & Cleary, M. (2020). Chi‐square for model fit in confirmatory factor analysis. Journal of Advanced Nursing, 76(9), 2209–2211. https://doi.org/10.1111/jan.14399
  3. Baddeley, A. D., & Hitch, G. (1974). Working memory. In Psychology of Learning and Motivation (pp. 47–89). Academic Press.
  4. Bourrier, S. C., Berman, M. G., & Enns, J. T. (2018). Cognitive strategies and natural environments interact in influencing executive function. Frontiers in Psychology, 9. https://doi.org/10.3389/fpsyg.2018.01248
  5. Brown, T. A. (2015). Confirmatory factor analysis for applied research. Guilford Press.
  6. Canivez, G. L., Watkins, M. W., & McGill, R. J. (2019). Construct validity of the Wechsler Intelligence Scale For Children – Fifth UK Edition: Exploratory and confirmatory factor analyses of the 16 primary and secondary subtests. British Journal of Educational Psychology, 89(2), 195–224. https://doi.org/10.1111/bjep.12230
  7. Chadha, N. K. (2009). Applied psychometry. SAGE Publications India Pvt Ltd. https://doi.org/10.4135/9788132108221
  8. Chan, R., Shum, D., Toulopoulou, T., & Chen, E. (2008). Assessment of executive functions: Review of instruments and identification of critical issues. Archives of Clinical Neuropsychology, 23(2), 201–216. https://doi.org/10.1016/j.acn.2007.08.010
  9. Chan, T., Wang, I., & Ybarra, O. (2021). Leading and managing the workplace: The role of executive functions. Academy of Management Perspectives, 35(1), 142–164. https://doi.org/10.5465/amp.2017.0215
  10. Choi, H. J., Lee, D. Y., Seo, E. H., Jo, M. K., Sohn, B. K., Choe, Y. M., Byun, M. S., Kim, J. W., Kim, S. G., Yoon, J. C., Jhoo, J. H., Kim, K. W., & Woo, J. I. (2014). A normative study of the digit span in an educationally diverse elderly population. Psychiatry Investigation, 11(1), 39–43. https://doi.org/10.4306/pi.2014.11.1.39
  11. Dadín, C. O., Salgado, D. R., & Fernández, E. A. (2009). Natural sex hormone cycles and gender differences in memory. Actas Espanolas de Psiquiatria, 37(2), 68–74. http://www.ncbi.nlm.nih.gov/pubmed/19401854
  12. Danielsson, H., Henry, L., Messer, D., & Rönnberg, J. (2012). Strengths and weaknesses in executive functioning in children with intellectual disability. Research in Developmental Disabilities, 33(2), 600–607. https://doi.org/10.1016/j.ridd.2011.11.004
  13. Danielsson, H., Henry, L., Rönnberg, J., & Nilsson, L.-G. (2010). Executive functions in individuals with intellectual disability. Research in Developmental Disabilities, 31(6), 1299–1304. https://doi.org/10.1016/j.ridd.2010.07.012
  14. Diamond, A. (2013). Executive functions. Annual Review of Psychology, 64(1), 135–168. https://doi.org/10.1146/annurev-psych-113011-143750
  15. Engle, R. W. (2010). Role of working‐memory capacity in cognitive control. Current Anthropology, 51(S1), S17–S26. https://doi.org/10.1086/650572
  16. Ferguson, H. J., Brunsdon, V. E. A., & Bradford, E. E. F. (2021). The developmental trajectories of executive function from adolescence to old age. Scientific Reports, 11(1), 1382. https://doi.org/10.1038/s41598-020-80866-1
  17. Field, A. P. (2013). Discovering statistics using IBM SPSS statistics. SAGE.
  18. Fleming, K. A., Heintzelman, S. J., & Bartholow, B. D. (2016). Specifying associations between conscientiousness and executive functioning: Mental set shifting, not prepotent response inhibition or working memory updating. Journal of Personality, 84(3), 348–360. https://doi.org/10.1111/jopy.12163
  19. Fokkema, M., & Greiff, S. (2017). How performing PCA and CFA on the same data equals trouble. European Journal of Psychological Assessment, 33(6), 399–402. https://doi.org/10.1027/1015-5759/a000460
  20. Friedman, N. P., Miyake, A., Altamirano, L. J., Corley, R. P., Young, S. E., Rhea, S. A., & Hewitt, J. K. (2016). Stability and change in executive function abilities from late adolescence to early adulthood: A longitudinal twin study. Developmental Psychology, 52(2), 326–340. https://doi.org/10.1037/dev0000075
  21. Geerinck, A., Alekna, V., Beaudart, C., Bautmans, I., Cooper, C., De Souza Orlandi, F., Konstantynowicz, J., Montero-Errasquín, B., Topinková, E., Tsekoura, M., Reginster, J.-Y., & Bruyère, O. (2019). Standard error of measurement and smallest detectable change of the Sarcopenia Quality of Life (SarQoL) questionnaire: An analysis of subjects from 9 validation studies. Plos One, 14(4), e0216065. https://doi.org/10.1371/journal.pone.0216065
  22. Giovagnoli, A. R., Del Pesce, M., Mascheroni, S., Simoncelli, M., Laiacona, M., & Capitani, E. (1996). Trail making test: Normative values from 287 normal adult controls. The Italian Journal of Neurological Sciences, 17(4), 305–309. https://doi.org/10.1007/BF01997792
  23. Gläscher, J., Adolphs, R., Damasio, H., Bechara, A., Rudrauf, D., Calamia, M., Paul, L. K., & Tranel, D. (2012). Lesion mapping of cognitive control and value-based decision making in the prefrontal cortex. Proceedings of the National Academy of Sciences, 109(36), 14681–14686. https://doi.org/10.1073/pnas.1206608109
  24. Goebel, S., Fischer, R., Ferstl, R., & Mehdorn, H. M. (2009). Normative data and psychometric properties for qualitative and quantitative scoring criteria of the Five-point Test. The Clinical Neuropsychologist, 23(4), 675–690. https://doi.org/10.1080/13854040802389185
  25. Hale, J. B., Hoeppner, J.-A. B., & Fiorello, C. A. (2002). Analyzing digit span components for assessment of attention processes. Journal of Psychoeducational Assessment, 20(2), 128–143. https://doi.org/10.1177/073428290202000202
  26. Hantoro, W. D., Setyaningrum, C. T. S., & Dahlan, P. (2019). Reliabilitas dan validitas backward digit span test dalam screening gangguan atensi anak sekolah dasar. Berkala NeuroSains, 18(2), 90–93. https://journal.ugm.ac.id/bns/article/view/54992
  27. Hendrawan, D., & Hatta, T. (2010). Evaluation of stimuli for development of the Indonesian version of verbal fluency task using ranking method. Psychologia, 53(1), 14–26. https://doi.org/10.2117/psysoc.2010.14
  28. Himi, S. A., Bühner, M., & Hilbert, S. (2021). Advancing the understanding of the factor structure of executive functioning. Journal of Intelligence, 9(1), 16. https://doi.org/10.3390/jintelligence9010016
  29. Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
  30. Huizinga, M., Dolan, C. V., & van der Molen, M. W. (2006). Age-related change in executive function: Developmental trends and a latent variable analysis. Neuropsychologia, 44(11), 2017–2036. https://doi.org/10.1016/j.neuropsychologia.2006.01.010
  31. Im‐Bolter, N., Johnson, J., & Pascual‐Leone, J. (2006). Processing limitations in children with specific language impairment: The role of executive function. Child Development, 77(6), 1822–1841. https://doi.org/10.1111/j.1467-8624.2006.00976.x
  32. Ionescu, T. (2012). Exploring the nature of cognitive flexibility. New Ideas in Psychology, 30(2), 190–200. https://doi.org/10.1016/j.newideapsych.2011.11.001
  33. Ito, T. A., Friedman, N. P., Bartholow, B. D., Correll, J., Loersch, C., Altamirano, L. J., & Miyake, A. (2015). Toward a comprehensive understanding of executive cognitive function in implicit racial bias. Journal of Personality and Social Psychology, 108(2), 187–218. https://doi.org/10.1037/a0038557
  34. Jorm, A. F., Anstey, K. J., Christensen, H., & Rodgers, B. (2004). Gender differences in cognitive abilities: The mediating role of health state and health habits. Intelligence, 32(1), 7–23. https://doi.org/10.1016/j.intell.2003.08.001
  35. Khalil, M. S. (2010). Preliminary Arabic normative data of neuropsychological tests: The verbal and design fluency. Journal of Clinical and Experimental Neuropsychology, 32(9), 1028–1035. https://doi.org/10.1080/13803391003672305
  36. Koci, J., & Donaldson, S. I. (2023). Well-being and success for university students: Applying PERMA+4. Routledge - Taylor & Francis.
  37. Kurniawan, A., & Kusrohmaniah, S. (2018). Performa inhibitory control dengan induksi Sing-a-Song Stress Test pada dewasa awal. Jurnal Psikologi, 45(1), 40–51. https://doi.org/10.22146/jpsi.25846
  38. Kyriazos, T. A. (2018). Applied psychometrics: Writing-up a factor analysis construct validation study with eExamples. Psychology, 9(11), 2503–2530. https://doi.org/10.4236/psych.2018.911144
  39. Lebon, T. (2014). Achieve your potential with positive psychology: CBT, mindfulness and practical philosophy for finding lasting happiness. Hachette UK.
  40. Lezak, M. D. (2004). Neuropsychological assessment. Oxford University Press, USA.
  41. Logue, S. F., & Gould, T. J. (2014). The neural and genetic basis of executive function: Attention, cognitive flexibility, and response inhibition. Pharmacology Biochemistry and Behavior, 123, 45–54. https://doi.org/10.1016/j.pbb.2013.08.007
  42. MacLeod, C. M. (2010). Stroop effect. In The Corsini encyclopedia of psychology (pp. 1–2). Wiley. https://doi.org/10.1002/9780470479216.corpsy0952
  43. Matias-Guiu, J. A., Pytel, V., Delgado-Álvarez, A., Delgado-Alonso, C., Cortés-Martínez, A., Fernández-Oliveira, A., & Matías-Guiu, J. (2022). The Five-point Test: Normative data for middle-aged and elderly Spaniards. Applied Neuropsychology: Adult, 29(6), 1323–1331. https://doi.org/10.1080/23279095.2021.1873137
  44. McCabe, D. P., Roediger, H. L., McDaniel, M. A., Balota, D. A., & Hambrick, D. Z. (2010). The relationship between working memory capacity and executive functioning: Evidence for a common executive attention construct. Neuropsychology, 24(2), 222–243. https://doi.org/10.1037/a0017619
  45. Miyake, A., Emerson, M. J., & Friedman, N. P. (2000). Assessment of executive functions in clinical settings: Problems and recommendations. Seminars in Speech and Language, 21(2), 0169–0183. https://doi.org/10.1055/s-2000-7563
  46. Morasch, K. C., & Bell, M. A. (2011). The role of inhibitory control in behavioral and physiological expressions of toddler executive function. Journal of Experimental Child Psychology, 108(3), 593–606. https://doi.org/10.1016/j.jecp.2010.07.003
  47. Mvududu, N. H., & Sink, C. A. (2013). Factor analysis in counseling research and practice. Counseling Outcome Research and Evaluation, 4(2), 75–98. https://doi.org/10.1177/2150137813494766
  48. Myers, N. D., Ahn, S., & Jin, Y. (2011). Sample size and power estimates for a confirmatory factor analytic model in exercise and sport. Research Quarterly for Exercise and Sport, 82(3), 412–423. https://doi.org/10.1080/02701367.2011.10599773
  49. Panerai, S., Tasca, D., Ferri, R., Genitori D’Arrigo, V., & Elia, M. (2014). Executive functions and adaptive behaviour in autism spectrum disorders with and without intellectual disability. Psychiatry Journal, 1–11. https://doi.org/10.1155/2014/941809
  50. Pesau, H. G., & Luijtelaar, G. Van. (2021). Equivalence of traditional and internet-delivered testing of word fluency tasks. Jurnal Psikologi, 20(1), 35–49. https://doi.org/10.14710/jp.20.1.35-49
  51. Peterson, G. (2006). Cultural theory and emotions. In Handbook of the Sociology of Emotions (pp. 114–134). Springer US. https://doi.org/10.1007/978-0-387-30715-2_6
  52. Pires, L., Moura, O., Guerrini, C., Buekenhout, I., Simões, M. R., & Leitão, J. (2019). Confirmatory factor analysis of neurocognitive measures in healthy young adults: The relation of executive functions with other neurocognitive functions. Archives of Clinical Neuropsychology, 34(3), 350–365. https://doi.org/10.1093/arclin/acy040
  53. Ramchandran, K., Colbert, A. E., Brown, K. G., Denburg, N. L., & Tranel, D. (2016). Exploring the neuropsychological antecedents of transformational leadership: The role of executive function. Adaptive Human Behavior and Physiology, 2(4), 325–343. https://doi.org/10.1007/s40750-016-0051-y
  54. Ren, X., Schweizer, K., Wang, T., Chu, P., & Gong, Q. (2017). On the relationship between executive functions of working memory and components derived from fluid intelligence measures. Acta Psychologica, 180, 79–87. https://doi.org/10.1016/j.actpsy.2017.09.002
  55. Scarpina, F., & Tagini, S. (2017). The Stroop Color and Word Test. Frontiers in Psychology, 8. https://doi.org/10.3389/fpsyg.2017.00557
  56. Sherman, E., Tan, J. E., & Hrabok, M. (2022). A compendium of neuropsychological tests: Fundamentals of neuropsychological assessment and test reviews for clinical practice (4th ed.). Oxford University Press.
  57. Snyder, H. R., Miyake, A., & Hankin, B. L. (2015). Advancing understanding of executive function impairments and psychopathology: Bridging the gap between clinical and cognitive approaches. Frontiers in Psychology, 6. https://doi.org/10.3389/fpsyg.2015.00328
  58. Strauss, E., Sherman, E. M. S., & Spreen, O. (2006). A compendium of neuropsychological tests: Administration, norms, and commentary (3rd ed.). Oxford University Press.
  59. Strauss, G. P., Allen, D. N., Jorgensen, M. L., & Cramer, S. L. (2005). Test-retest reliability of Standard and Emotional Stroop Tasks. Assessment, 12(3), 330–337. https://doi.org/10.1177/1073191105276375
  60. Suwartono, C., Halim, M. S., Hidajat, L. L., Hendriks, M. P. H., & Kessels, R. P. C. (2014). Development and reliability of the Indonesian Wechsler Adult Intelligence Scale—Fourth Edition (WAIS-IV). Psychology, 5(14), 1611–1619. https://doi.org/10.4236/psych.2014.514171
  61. Tabachnick, B. G., & Fidell, L. S. (2019). Using multivariate statistics (7th ed.). Pearson.
  62. Testa, R., Bennett, P., & Ponsford, J. (2012). Factor analysis of nineteen executive function tests in a healthy adult population. Archives of Clinical Neuropsychology, 27(2), 213–224. https://doi.org/10.1093/arclin/acr112
  63. Troyer, A. K., Moscovitch, M., & Winocur, G. (1997). Clustering and switching as two components of verbal fluency: Evidence from younger and older healthy adults. Neuropsychology, 11(1), 138–146. https://doi.org/10.1037/0894-4105.11.1.138
  64. Tucha, L., Aschenbrenner, S., Koerts, J., & Lange, K. W. (2012). The Five-point Test: Reliability, validity and normative data for children and adults. Plos One, 7(9), e46080. https://doi.org/10.1371/journal.pone.0046080
  65. Vandierendonck, A. (2021). On the utility of integrated speed-accuracy measures when speed-accuracy trade-off is present. Journal of Cognition, 4(1), 22. https://doi.org/10.5334/joc.154
  66. Vicente, S. G., Rivera, D., Barbosa, F., Gaspar, N., Dores, A. R., Mascialino, G., & Arango-Lasprilla, J. C. (2021). Normative data for tests of attention and executive functions in a sample of European Portuguese adult population. Aging, Neuropsychology, and Cognition, 28(3), 418–437. https://doi.org/10.1080/13825585.2020.1781768
  67. Wahyuningrum, S. E., Sulastri, A., Hendriks, M. P. H., Indonesian NP Consortium, & van Luijtelaar, G. (2022). The Indonesian Neuropsychological Test Battery (INTB): Psychometric properties, preliminary normative scores, the underlying cognitive constructs, and the effects of age and education. Acta Neuropsychologica, 20(4), 445–470. https://doi.org/10.5604/01.3001.0016.1339
  68. Wahyuningrum, S. E., van Luijtelaar, G., & Sulastri, A. (2023). An online platform and a dynamic database for neuropsychological assessment in Indonesia. Applied Neuropsychology: Adult, 30(3), 330–339. https://doi.org/10.1080/23279095.2021.1943397
  69. Whiteside, D. M., Kealey, T., Semla, M., Luu, H., Rice, L., Basso, M. R., & Roper, B. (2016). Verbal fluency: Language or executive function measure? Applied Neuropsychology: Adult, 23(1), 29–34. https://doi.org/10.1080/23279095.2015.1004574
  70. Widhianingtanti, L. T., Luijtelaar, G. Van, Suryani, A. O., Hestyanti, Y. R., & Sulastri, A. (2022). Indonesian Trail Making Test: Analysis of psychometric properties, effects of demographic variables, and norms for Javanese adults. Jurnal Psikologi, 49(2), 104–122. https://doi.org/10.22146/jpsi.68953
  71. Zelazo, P. D. (2020). Executive function and psychopathology: A neurodevelopmental perspective. Annual Review of Clinical Psychology, 16(1), 431–454. https://doi.org/10.1146/annurev-clinpsy-072319-024242

Open Access Copyright (c) 2024 Psikohumaniora: Jurnal Penelitian Psikologi
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

Publisher:
Faculty of Psychology and Health, Universitas Islam Negeri Walisongo Semarang
Jl. Prof. Dr. HAMKA, Kampus III, Tambakaji Ngaliyan Semarang 50185 Central Java - Indonesia
website: fpk.walisongo.ac.id

 
Visitor Statistics
apps