Developing a Technology-Integrated Authentic Pragmatic Portfolio Assessment for Mahārah al-Kalām in the Malzamah Akbarnas Program

Authors

  • Fajrotuz Zahroh Universitas Islam Negeri Sunan Kalijaga Yogyakarta, Indonesia
  • R. Umi Baroroh Universitas Islam Negeri Sunan Kalijaga Yogyakarta, Indonesia
  • Triani Agustin Universitas Islam Negeri Sunan Kalijaga Yogyakarta, Indonesia
  • Khaerul Muttakin Universitas Islam Negeri Sunan Kalijaga Yogyakarta, Indonesia
  • Agna Hawari International Islamic University Islamabad, Pakistan

DOI:

https://doi.org/10.21580/alsina.8.1.30985

Keywords:

Arabic speaking skills, assessment rubric, authentic pragmatic approach, portfolio assessment, technology-integrated assessment

Abstract

This study aims to develop a technology-integrated portfolio assessment instrument and rubric for mahārah al-Kalām, based on an authentic, pragmatic approach in the Malzamah Program Akbarnas book. Conventional assessment of mahārah al-Kalām tends to focus on structural linguistic aspects and memorization, so it does not fully represent students' Arabic language skills in the context of real communication. The study applied a Research and Development (R&D) design using the Define–Design–Develop (3D) model. Expert validation involved five experts in Arabic language education and educational assessment. The instrument achieved strong content validity (Aiken's V = 0.87) and high internal consistency (Cronbach's Alpha = 0.91), indicating high validity and reliability. A limited trial involving 32 students demonstrated the instrument's practicality and usability in real learning settings. The resulting assessment framework integrates authentic pragmatic tasks, structured rubrics, and digital portfolio documentation to assess speaking competence in contextual and communicative settings. This model offers a replicable framework for Arabic language educators seeking to implement more authentic, systematic, and technology-supported speaking assessments.

Downloads

Download data is not yet available.

References

Abrar-ul-Hassan, Shahid et al. “Revisiting Second Language Portfolio Assessment in a New Age.” System 103 (2021): 102652. https://doi.org/10.1016/j.system.2021.102652.

Aburub, Imad. “An Evaluation of the Arabic Language Textbook for First Grade From the Teachers’ Point of View.” Journal of Higher Education Theory and Practice 23, no. 9 (2023): 131–42. https://doi.org/10.33423/jhetp.v23i9.6133.

Ahmed AbdelAl Ibrahim, Khaled, and Yasha Rakhshani. “Portfolio Assessment among Upper-Intermediate Learners: Effects on Learners’ Willingness to Communicate, Grit Tendencies, and Motivation.” Asian-Pacific Journal of Second and Foreign Language Education 9, no. 1 (2024): 36. https://doi.org/10.1186/s40862-024-00257-1.

Aiken, Lewis R. “Three Coefficients for Analyzing the Reliability and Validity of Ratings.” Educational and Psychological Measurement 45, no. 1 (1985): 131–42. https://doi.org/10.1177/0013164485451012.

Al-Mallahma, Mohammed Saleem Ismail. “Integrating Technology in Arabic Language Instruction: Enhancing Learner Engagement and Proficiency.” In Business Resilience and Business Innovation for Sustainability, 1341–53, 2025. https://doi.org/10.1007/978-3-031-87584-7_97.

Alduais, Ahmed et al. “Arabic Validation of the Pragmatic Language Skills Inventory to Assess Pragmatic Language Development in Preschoolers with and without Pragmatic Language Impairment.” Children 9, no. 6 (2022): 809. https://doi.org/10.3390/children9060809.

Alkaabi, Ahmed Mohammed, and Asma Khaleel Abdallah. “Portfolio Practices in the Principal Evaluation Process: A Qualitative Case Study.” Heliyon 10, no. 21 (2024): e39467. https://doi.org/10.1016/j.heliyon.2024.e39467.

Almelhes, Sultan. “Enhancing Arabic Language Acquisition: Effective Strategies for Addressing Non-Native Learners’ Challenges.” Education Sciences 14, no. 10 (2024): 1116. https://doi.org/10.3390/educsci14101116.

Alzouebi, Khadeegha. “Electronic Portfolio Development and Narrative Reflections in Higher Education: Part and Parcel of the Culture?” Education and Information Technologies 25, no. 2 (2020): 997–1011. https://doi.org/10.1007/s10639-019-09992-2.

Asrori, Imam et al. Evaluasi Dalam Pembelajaran Bahasa Arab. 5th ed. Malang: Misykat Indonesia, 2019.

Avana, Nurlev. Asesmen Pembelajaran: Strategi Evaluasi, Teknik Penyusunan Soal, dan Pelaporan Hasil Belajar. Purwokerto: PT Revormasi Jangkar Philosophia, 2025.

Baroroh, R. Umi, and Nafisatun Nisa. “Non-Test Assessment Innovation Performance for Maharah Kalam Through Youtube in the Pandemic Era.” Ijaz Arabi Journal of Arabic Learning 5, no. 1 (2022): 222–33. https://doi.org/10.18860/ijazarabi.v5i1.14789.

Darmo, Santi Yudhawati. “Asesmen Pembelajaran Inklusif.” In Asesmen Pembelajaran: Teori dan Praktik, edited by Andri Cahyo Purnomo. Serang: Sada Kurnia Pustaka, 2025.

ElSayary, Areej. “The Impact of a Professional Upskilling Training Programme on Developing Teachers’ Digital Competence.” Journal of Computer Assisted Learning 39, no. 4 (2023): 1154–66. https://doi.org/10.1111/jcal.12788.

Fischer, Johann. “The Underlying Action-Oriented and Task-Based Approach of the CEFR and Its Implementation in Language Testing and Assessment at University.” Language Learning in Higher Education 10, no. 2 (2020): 301–16. https://doi.org/10.1515/cercles-2020-2021.

Fulcher, Glenn. “Assessment Literacy for the Language Classroom.” Language Assessment Quarterly 9, no. 2 (2012): 113–32. https://doi.org/10.1080/15434303.2011.642041.

Galante, Angelica, and Le Chen. “Advancing Plurilingual and Pluricultural Competence in the Language Classroom.” In Activating Linguistic and Cultural Diversity in the Language Classroom, edited by Enrica Piccardo et al., 259–81. Cham: Springer International Publishing, 2022. https://doi.org/10.1007/978-3-030-87124-6_10.

Grant P. Wiggins. Educative Assessment: Designing Assessments to Inform and Improve Student Performance. San Francisco: Jossey-Bass Publishers, 1998.

Hu, Anjin et al. “Digital Technologies in Authentic Assessment in Higher Education: A Systematic Literature Review and Narrative Synthesis.” SAGE Open 15, no. 3 (2025). https://doi.org/10.1177/21582440251357198.

Kamath, Alser. Language Testing and Assessment. New Rochelle: Magnum, 2024.

Latif, Muhammad M. M. Abdel, and Majed M. Alhamad. “Emergency Remote Teaching of Foreign Languages at Saudi Universities: Teachers’ Reported Challenges, Coping Strategies and Training Needs.” Education and Information Technologies 28, no. 7 (2023): 8919–44. https://doi.org/10.1007/s10639-022-11512-8.

Mahyudin, Erta et al. Strategi Mengembangkan Keterampilan Berbahasa Arab Aktif Produktif dan Reseptif. Jakarta: Publica Indonesia Utama, 2025.

Majadly, Haifaa, and Athar Haj Yahya. “Beyond the Language: Arabic Language Textbooks in Arab–Palestinian Society as Tools for Developing Social–Emotional Skills.” Education Sciences 14, no. 10 (2024): 1088. https://doi.org/10.3390/educsci14101088.

Makruf, Imam, and Anisatul Barokah. “Improving the Quality of ICT-Based Arabic Learning Assessment With Online Applications.” Journal of Higher Education Theory and Practice 23, no. 11 (2023): 32–40. https://doi.org/10.33423/jhetp.v23i11.6216.

Marinho, Paulo et al. “The Digital Portfolio as an Assessment Strategy for Learning in Higher Education.” Distance Education 42, no. 2 (2021): 253–67. https://doi.org/10.1080/01587919.2021.1911628.

Masaeed, Khaled Al. “Researching and Measuring Second Language Pragmatic Development in Study Abroad: Insight from Arabic.” In Designing Second Language Study Abroad Research: Critical Reflections on Methods and Data, edited by Janice McGregor and John L. Plews, 155–70. Cham: Springer International Publishing, 2022. https://doi.org/10.1007/978-3-031-05053-4_8.

Maskuri, Maskuri et al. “Analisis Kesalahan dalam Menggunakan Lahjah Arabiyah pada Maharah Kalam.” Lahjah Arabiyah: Jurnal Bahasa Arab dan Pendidikan Bahasa Arab 4, no. 2 (2023): 159–70. https://doi.org/10.35316/lahjah.v4i2.159-170.

McCombie, Seth, and Khaled Al Masaeed. “L2 Arabic Pragmatics in the Classroom: Insights from Language Instructors’ Beliefs and Practices.” System 128 (2025): 103546. https://doi.org/10.1016/j.system.2024.103546.

Mohamed, Salwa. “Text Classification and Gradation in Arabic Textbooks.” The Language Learning Journal 52, no. 6 (2024): 629–49. https://doi.org/10.1080/09571736.2023.2213695.

Morady Moghaddam, Mostafa. “Enhancing Language Learners’ Pragmatic Skills through Augmented Reality: The Speech Act of Request in the Spotlight.” Innovation in Language Learning and Teaching, 2025, 1–21. https://doi.org/10.1080/17501229.2025.2544018.

Mukaromah, Muhimmatul et al. “Adaptasi Maharah Kalam dalam Kehidupan Sehari-hari Peserta Didik Kelas VII MTs Sulamul Huda Ponorogo.” Jurnal Ihtimam 6, no. 1 (2023): 107–20. https://doi.org/10.36668/jih.v6i1.463.

Munip, Abdul. Penilaian Pembelajaran Bahasa Arab. Yogyakarta: Fakultas Ilmu Tarbiyah dan Keguruan, UIN Sunan Kalijaga Yogyakarta, 2017.

Nakatsuhara, Fumiyo, and Vivien Berry. “Use of Innovative Technology in Oral Language Assessment.” Assessment in Education: Principles, Policy & Practice 28, no. 4 (2021): 343–49. https://doi.org/10.1080/0969594X.2021.2004530.

Nasir, Aco. Mengenal Keterampilan Berbicara Dasar. Yogyakarta: KBM Indonesia, 2021.

Nassiri, Naoual et al. “Approaches, Methods, and Resources for Assessing the Readability of Arabic Texts.” ACM Transactions on Asian and Low-Resource Language Information Processing 22, no. 4 (2023): 1–30. https://doi.org/10.1145/3571510.

Nugraha, Novanda Alim Setya et al. “Development of a Speaking Skills Assessment Rubric Through the English Reporting News Project for High School Students in Kampung Inggris Purbalingga.” Journal on English Language, Teaching and Learning, Linguistic and Literature 13, no. 1 (2025): 1842–50. https://doi.org/10.24256/ideas.v13i1.7039.

Pasau, Arini Daeng, and Imam Fauji. “Assessment Innovation of Mahārah Kalam in Arabic Language Textbooks for First Grade of Islamic Elementary School.” Research and Development in Education (RaDEn) 5, no. 1 (2025): 644–51. https://doi.org/10.22219/raden.v5i1.39459.

Purnomo, Hamdan Hadi et al. “Inovasi Penerapan Penilaian Portofolio dalam Mahārah Qirā’ah Mata Pelajaran Bahasa Arab.” Jurnal Alfazuna : Jurnal Pembelajaran Bahasa Arab dan Kebahasaaraban 9, no. 2 (2025): 243–62. https://doi.org/10.15642/alfazuna.v9i2.4565.

Riswar, Hanan, and Umi Baroroh. “Inovasi Tes Maharah Kalam pada Buku Durus Al-Lughah Al-‘Arabiyah Jilid 3 Berbasis Penilaian Kurikulum Merdeka.” JIIP - Jurnal Ilmiah Ilmu Pendidikan 8, no. 2 (2025): 1531–39. https://doi.org/10.54371/jiip.v8i2.6850.

Saad, Roslizawati et al. “The Use of Digital Teaching Tools to Support Arabic Speaking Skills in Secondary School: A Systematic Literature Review.” Educational Process International Journal 17, no. 1 (2025): e2025404. https://doi.org/10.22521/edupij.2025.17.404.

Saher, Al-Sabbah et al. “Traditional versus Authentic Assessments in Higher Education.” Pegem Journal of Education and Instruction 12, no. 1 (2022): 283–91. https://doi.org/10.47750/pegegog.12.01.29.

Sapawi, Mior Syazril Mohamed, and Nik Mohd Rahimi Nik Yusoff. “Integrating Technology into the Arabic Language Curriculum: A Systematic Review of Trends, Strategies and Cultural Dimensions.” Social Sciences & Humanities Open 12 (2025): 101974. https://doi.org/10.1016/j.ssaho.2025.101974.

Seplyana, Desy et al. Metodologi Penelitian dalam Evaluasi Pendidikan. Bandung: Widina Media Utama, 2025.

Setyawan, Cahya Edi et al. “Implementasi Penilaian Non-Tes Mahārah Kalām: Studi Kasus Multisitus di Perguruan Tinggi Yogyakarta.” Alsina : Journal of Arabic Studies 7, no. 1 (2025): 1–28. https://doi.org/10.21580/alsina.7.1.26108.

Shannaq, Boumedyen. “Digital Formative Assessment as a Transformative Educational Technology.” In Advances in Information and Communication, edited by Kohei Arai, 471–81. Cham: Springer, 2024. https://doi.org/10.1007/978-3-031-54053-0_32.

Spoto, Andrea et al. “Improving Content Validity Evaluation of Assessment Instruments through Formal Content Validity Analysis.” Psychological Methods 30, no. 2 (2025): 203–22. https://doi.org/10.1037/met0000545.

Ubaidillah, Moch et al. “Digital Portfolio as an Authentic Assessment Instrument in Arabic Language Learning: A Literature Review.” Jurnal Penelitian Ilmu Pendidikan Indonesia 4, no. 2 (2025): 838–46. https://doi.org/10.31004/jpionv4i2.486.

Vo, Sonca. “Exploring the Construct of Interactional Competence in Different Types of Oral Communication Assessment.” Interaction Studies. Social Behaviour and Communication in Biological and Artificial Systems 25, no. 1 (2024): 1–35. https://doi.org/10.1075/is.00022.vo.

Wicaksana, Muhlis Fajar. Belajar Mengembangkan Model Penilaian Autentik dalam Pembelajaran Bahasa Indonesia. Yogyakarta: CV Budi Utama, 2020.

Widodo, Slamet et al. Buku Ajar Metodologi Penelitian. Pangkal Pinang: CV Science Techno Direct, 2023.

Wiggins, Grant. “The Case for Authentic Assessment.” Practical Assessment, Research, and Evaluation 2, no. 2 (1990): 1–3. https://doi.org/10.7275/ffb1-mm19.

Yuristira, Afif Naufal Andrean et al. “Inovasi Penilaian Otentik Maharah Kalam dengan Pendekatan Komunikatif pada Buku Bahasa Arab MI Kelas III.” Al Mi’yar: Jurnal Ilmiah Pembelajaran Bahasa Arab dan Kebahasaaraban 8, no. 2 (2025): 558–68. https://doi.org/10.35931/am.v8i2.5226.

Downloads

Published

2026-02-28

How to Cite

Zahroh, F., Baroroh, R. U., Agustin, T., Muttakin, K., & Hawari, A. (2026). Developing a Technology-Integrated Authentic Pragmatic Portfolio Assessment for Mahārah al-Kalām in the Malzamah Akbarnas Program. Alsina : Journal of Arabic Studies, 8(1), 97–130. https://doi.org/10.21580/alsina.8.1.30985

Issue

Vol. 8 No. 1 (2026)

Section

Articles

License

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

Copyright

The copyright of the received article shall be assigned to the publisher of the journal. The intended copyright includes the right to publish the article in various forms (including reprints). The journal maintains the publishing rights to published articles. Authors are allowed to use their articles for any legal purposes deemed necessary without written permission from the journal, but with an acknowledgment to this journal of initial publication.

Licensing

Creative Commons License

Copyright Transfer Agreement

In order for Alsina: Journal of Arabic Studies to publish and distribute research articles, the editors need publishing rights (transferred from author to publisher). This agreement relates to the transfer/publishing copyright license to Alsina: Journal of Arabic Studies but the authors still have significant rights to use and share their published articles. 

Alsina: Journal of Arabic Studies supports the need for writers to share, disseminate and maximize the impact of their research and their rights on any database. As a journal article writer, you have the right to various uses of your articles, including that by the institution or company where you work. Copyright can be used without the need for special permission. Authors who publish articles in the Alsina: Journal of Arabic Studies have broad rights to use their work for teaching and scientific purposes without requesting permission, including:

  1. Use by the author for lectures, presentations, or conferences, with distribution of copies to participants;
  2. Distribution to colleagues for research use;
  3. Use in compilations of the author's subsequent work;
  4. inclusion in a thesis or dissertation;
  5. Reuse of sections or excerpts from articles in other works (with full acknowledgment of the final article);
  6. Preparation of derivative works (other than commercial purposes) (with full acknowledgment of the final article);
  7. Voluntary posting on open websites operated by authors’ or writers' agencies for scientific purposes

When submitting a manuscript, authors do so on the understanding that if accepted for publication, the copyright for publishing (publishing right) of the article shall be assigned/transferred to Alsina: Journal of Arabic Studies. 

Authors whose articles are accepted for publication will receive confirmation via email and sent a Copyright Transfer Agreement.