Pengembangan Instrumen Asesmen Literasi Matematika Berbasis PISA dengan Computer-Baset Test pada Siswa Jenjang Menengah Atas
Keywords:
assessment instrument, PISA, mathematical literacy, computer-based test, ADDIEAbstract
This study aims to develop a computer-based test (CBT) mathematical literacy assessment instrument that adapts the 2022 Programme for International Student Assessment (PISA) framework. This need stems from the scarcity of assessment instruments for the senior high school level, given that the PISA programme itself only reaches the junior high school level. The study employed the ADDIE (Analyze, Design, Develop, Implement, Evaluate) development model; the instrument, comprising nine items, was trialled on 65 eleventh-grade senior high school students at the Evaluate stage. The data were analysed using Pearson correlation (item validity), Cronbach's Alpha reliability, difficulty index, and discrimination index. The results show that all nine items are empirically valid, with an instrument reliability of 0.641. Seven items were deemed suitable to retain, and two items required revision. This study contributes to the development of a PISA-referenced mathematical literacy assessment instrument that is ready to be adapted for measuring the mathematical literacy of senior high school students while familiarising them with taking tests in a computer-based mode that resembles international assessment conditions.
Downloads
References
Ahmad, N. A., Mayouf, A. A., Elias, N. F., & Mohamed, H. (2024). Learning management system instrument development based on Aiken’s V technique. International Journal of Evaluation and Research in Education, 13(5), 3211–3219. https://doi.org/10.11591/ijere.v13i5.28925
Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1). https://doi.org/10.1177/0013164485451012
Charmila, N., Zulkardi, Z., & Darmawijoyo, D. (2016). Pengembangan soal matematika model PISA menggunakan Konteks Jambi. Jurnal Penelitian Dan Evaluasi Pendidikan, 20(2), 198–207. https://doi.org/10.21831/pep.v20i2.7444
Cruz Neri, N., & Retelsdorf, J. (2022). The role of linguistic features in science and math comprehension and performance: A systematic review and desiderata for future research. Educational Research Review, 36, 100460. https://doi.org/10.1016/j.edurev.2022.100460
Desy Rizbudiani, A., Jaedun, A., Rahim, A., & Nurrahman, A. (2021). Rasch model item response theory (IRT) to analyze the quality of mathematics final semester exam test on system of linear equations in two variables(SLETV). In Jurnal Pendidikan Matematika (Vol. 12, Number 2). http://ejournal.radenintan.ac.id/index.php/al-jabar/index
Edwar, Putri, R. ilma I., Zulkardi, & Darmawijoyo. (2023). Developing a workshop model for high school mathematics teachers constructing HOTS questions through the Pendidikan Matematika Realistik Indonesia approach. Journal on Mathematics Education, 14(4), 603–626. https://doi.org/10.22342/jme.v14i4.pp603-626
Hari Sugiharto Setyaedhi. (2025). PISA Model Numeracy Questions to Improve Student Competence. JPI (Jurnal Pendidikan Indonesia), 14(1), 200–211. https://doi.org/10.23887/jpiundiksha.v14i1.84401
Jannah, R. D., & Putri, R. I. I. (2019). Soft tennis and volleyball contexts in asian games for pisa-like mathematics problems. Journal on Mathematics Education, 10(1), 157–169. https://doi.org/10.22342/jme.10.1.5248.157-170
Maskar, S., & Herman, T. (2024). The relation between teacher and students’ mathematical mindsets to the student’s comprehension of mathematics concepts. In Journal on Mathematics Education (Vol. 15, Number 1, pp. 27–54). Sriwijaya University. https://doi.org/10.22342/jme.v15i1.pp27-54
Maxnun, L., Kristiani, K., & Sulistyaningrum, C. D. (2024). Development of hots-based cognitive assessment instruments: ADDIE model. Journal of Education and Learning, 18(2), 489–498. https://doi.org/10.11591/edulearn.v18i2.21079
Meryansumayeka, Zulkardi, Putri, R. I. I., & Hiltrimartin, C. (2022). Designing geometrical learning activities assisted with ICT media for supporting students’ higher order thinking skills. Journal on Mathematics Education, 13(1), 135–148. https://doi.org/10.22342/jme.v13i1.pp135-148
Mirandah, S., & Putri, R. I. I. (2025). Development of PISA-Type Questions in Election Context to Strengthen Students’ Mathematical Reasoning Skills. Mathematics Education Journal, 19(4), 785–806. https://doi.org/10.22342/mej.v19i4.pp785-806
Niss, M., & Højgaard, T. (2019). Mathematical competencies revisited. Educational Studies in Mathematics, 102(1), 9–28. https://doi.org/10.1007/s10649-019-09903-9
Nusantara, D. S., Zulkardi, Z., & Putri, R. I. I. (2021). DESIGNING PISA-LIKE MATHEMATICS TASK USING A COVID-19 CONTEXT (PISACOMAT). Journal on Mathematics Education, 12(2), 349–364. https://doi.org/10.22342/jme.12.2.13181.349-364
OECD. (2023a). PISA 2022 Assessment and Analytical Framework. OECD. https://doi.org/10.1787/dfe0bf9c-en
OECD. (2023b). PISA 2022 Results The State of Learning and Equity in Education. In Journal Pendidikan: I. PISA, OECD Publishing, Paris. https://doi.org/10.1787/53f23881-en
Pratiwi, I., & Putri, R. I. I. (2019). Long jump in asian games: Context of pisa-like mathematics problems. Journal on Mathematics Education, 10(1), 81–92. https://doi.org/10.22342/jme.10.1.5250.81-92
Priyani, T., & Sugiharto, B. (2024). Analysis of biology midterm exam items using a comparison of the classical theory test and the Rasch model. JPBI (Jurnal Pendidikan Biologi Indonesia), 10(3), 939–958. https://doi.org/10.22219/jpbi.v10i3.34345
Rahmaningtyas, F., Purwati, H., & Nugroho, A. A. (2021). Analisis Kemampuan Koneksi Matematis Ditinjau dari Tipe Kepribadian Sanguinis dan Melancholis Siswa SMP. Square : Journal of Mathematics and Mathematics Education, 3(2), 107–116. https://doi.org/10.21580/square.2021.3.2.8527
Retnawati, H. (2016). Proving content validity of self-regulated learning scale (The comparison of Aiken index and expanded Gregory index). REID (Research and Evaluation in Education), 2(2), 155–164. https://doi.org/10.21831/reid.v2i2.11029
Sistyawati, R. I., & Sitisyarah, K. (2022). The Development of PISA Questions and Activities Using Social Distancing Context During Pandemic. Mathematics Education Journal, 16(3), 239–256. https://doi.org/10.22342/jpm.16.3.17358.239-256
Suwarno, M., & Ardani, R. A. (2022). Kemampuan Literasi Matematika Siswa Berdasarkan PISA Level 4. Square : Journal of Mathematics and Mathematics Education, 4(2), 107–115. https://doi.org/10.21580/square.2022.4.2.12401
Syifa’, A. M., & Rohman, A. A. (2023). Analisis Kemampuan Berpikir Kreatif Guilford Berdasarkan Gaya Berpikir Siswa. Square : Journal of Mathematics and Mathematics Education, 5(2), 67–81. https://doi.org/10.21580/square.2023.5.2.18387
Tanjung, A. L., Zulkardi, Z., & Putri, R. I. I. (2023). The development of PISA-like problems using immunity context during pandemic. Jurnal Elemen, 9(1), 31–48. https://doi.org/10.29408/jel.v9i1.6152
Verschaffel, L., Schukajlow, S., Star, J., & Van Dooren, W. (2020). Word problems in mathematics education: a survey. ZDM, 52(1), 1–16. https://doi.org/10.1007/s11858-020-01130-4
Wijaya, T. T., Hidayat, W., Hermita, N., Alim, J. A., & Talib, C. A. (2024). Exploring contributing factors to PISA 2022 mathematics achievement: Insights from Indonesian teachers. Infinity Journal, 13(1), 139–156. https://doi.org/10.22460/infinity.v13i1.p139-156
Zulkardi, Z., Meryansumayeka, M., Putri, R. I. I., Alwi, Z., Nusantara, D. S., Ambarita, S. M., Maharani, Y., & Puspitasari, L. (2020). HOW STUDENTS WORK WITH PISA-LIKE MATHEMATICAL TASKS USING COVID-19 CONTEXT. Journal on Mathematics Education, 11(3), 405–416. https://doi.org/10.22342/jme.11.3.12915.405-416
Downloads
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
The Authors submitting a manuscript do so on the understanding that if accepted for publication, copyright of the article shall be assigned to Square: Journal of Mathematics and Mathematics Education as the publisher of the journal. The copyright form should be signed originally and send to the Editorial Office in the form of original mail, scanned document to [email protected]
Square : Journal of Mathematics and Mathematics Education by Mathematics Department UIN Walisongo Semarang is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
