Development of a Three-Tier Chemical Equilibrium Multiple-Choice Test to Assess Higher-Order Thinking Skills Based on Brookhart’s Categories

Neneng Fauziyah*  -  Department of Chemistry Education, Universitas Islam Negeri Syarif Hidayatullah Jakarta, Indonesia
Tonih Feronika  -  Department of Chemistry Education, Universitas Islam Negeri Syarif Hidayatullah Jakarta, Indonesia
Luki Yunita  -  Department of Chemistry Education, Universitas Islam Negeri Syarif Hidayatullah Jakarta, Indonesia

(*) Corresponding Author
DOI: 10.21580/jec.2023.5.2.12438
This study aimed to develop and validate the Three-Tier Chemical Equilibrium Multiple-Choice Test–HOTS (TTCEMCT–HOTS) instrument. The method employed in this study was Research and Development (R&D) based on Brookhart’s (2010) indicators of higher-order thinking skills. The development procedure began with a preliminary study, followed by product draft planning and product development. These stages were succeeded by an empirical analysis of the TTCEMCT–HOTS to determine the test instrument’s validity, reliability, difficulty level, and discriminating power. The TTCEMCT–HOTS instrument was implemented with Class XI students of SMAN 4 in South Tangerang City. The results of the study were as follows: (1) the developed TTCEMCT–HOTS instrument met the criteria of 32 valid questions, with a reliability coefficient of 0.82 in the “very high” category, a “moderate” difficulty level, and “good” discriminating power; (2) 46.42% of students could solve HOTS questions, while 53.58% could not; (3) the TTCEMCT–HOTS instrument received a positive response from 80.6% of participants, placing it in the “good” category. This study is expected to provide an alternative method for measuring students' higher-order thinking skills using a three-tier test instrument integrated with HOTS indicators.

Keywords: chemical equilibrium; higher-order thinking skills; three-tier multiple choice

  1. Agustina, L., Feronika, T., & Yunita, L. (2021). Analysis of Higher Order Thinking Skills Questions in the Brookhart Category in High School Chemistry Textbook: Curriculum 2013. Journal of Educational Chemistry (JEC), 3(1), 23–34.
  2. Arikunto, S. (2013). Prosedur Penelitian: Suatu Pendekatan Praktik Edisi Revisi. Jakarta: PT Rineka Cipta.
  3. Azmi, L. N., Nurhayati, S., Priatmoko, S., & Wardani, S. (2021). Pengembangan Instrumen Tes untuk Mengukur Hots Peserta Didik pada Materi Laju Reaksi. School Science and Mathematics, 2(3), 133–139.
  4. Brookhart, S. M. (2010). How to Assess Thinking Higher-Order Skills in Your Classroom. ASCD.
  5. Caleon, I., & Subramaniam, R. (2010). Development and Application of a Three-Tier Diagnostic Test to Assess Secondary Students’ Understanding of Waves. International Journal of Science Education, 32(7), 939–961.
  6. Dewati, D., Hadiarti, D., & Fadhilah, R. (2016). Pengembangan Instrumen Penilaian Tes Diagnostik Pilihan Ganda Dua Tingkat untuk Mengukur Hasil Belajar Siswa Materi Hidrokarbon di SMA 10 Negeri Pontianak. AR-RAZI Jurnal Ilmiah, 4(2), 23–32.
  7. Fitria, A. (2014). Miskonsepsi Mahasiswa dalam Menentukan Grup pada Struktur Aljabar Menggunakan Certainty of Response Index (CRI) di Jurusan Pendidikan Matematika IAIN Antasari. JPM IAIN Antasari, 01(2), 45–60.
  8. GTK Pendidikan Dasar. (2021). Modul Belajar Mandiri Calon Guru Aparatur Sipil Negara (ASN) Pegawai Pemerintah dengan Perjanjian Kerja (PPPK) (pp. 1–184). Direktorat Jenderal Guru dan Tenaga Kependidikan. Diakses tanggal 13 Juli 2022 dari http://repositori.kemdikbud.go.id/id/eprint/22649
  9. Hidayatullah, A. R., Yamtinah, S., & Masykuri, M. (2022). Development of A Two-Tier Multiple-Choice Instrument Based on Higher Order Thinking Skills (HOTS) on Acids, Bases, and Salts. Jurnal Penelitian Pendidikan IPA, 8(2), 932–938.
  10. Hikmah, H., & Amin, N. (2019). Pengembangan Instrumen untuk Mengukur Kemampuan Berpikir Tingkat Tinggi dalam Mata Pelajaran Matematika di SMA Kabupaten Majene. Saintifik, 5(1), 1–7.
  11. Juliarti, H., Widiarti, H. R., & Nazriati. (2019). Prosiding Kajian Literatur : Kemampuan Berpikir Tingkat Tinggi dalam Pembelajaran Kimia. Prosiding, November, 313–317.
  12. Kusaeri, & Suprananto. (2012). Pengukuran dan Penilaian Pendidikan (1st ed.). Yogyakarta: Graha Ilmu.
  13. Laeli, C. M. H., Gunarhadi, & Muzzazinah. (2021). Development of Three Tier Multiple Choice Diagnostic Test to Identify Misconception and Improve Critical Thinking Skill in Science Learning. İlköğretim Online, 20(2), 277–287.
  14. Laksono, P. J. (2020). Pengembangan Three Tier Multiple Choice Test Pada Materi Kesetimbangan Kimia Mata Kuliah Kimia Dasar Lanjut. Orbital: Jurnal Pendidikan Kimia, 4(1), 44–63.
  15. Magdalena, I., Fauziah, S. N., Faziah, S. N., & Nupus, F. S. (2021). Analisis Validitas, Reliabilitas, Tingkat Kesulitan dan Daya Beda Butir Soal Ujian Akhir Semester Tema 7 Kelas III SDN Karet 1 Sepatan. BINTANG : Jurnal Pendidikan Dan Sains, 3(2), 198–214.
  16. Mamondol, M. R. (2019). Dasar-Dasar Statistika. Surabaya: Scopindo Media Pustaka.
  17. Mubarak, S., Susilaningsih, E., & Cahyono, E. (2016). Pengembangan Tes Diagnostik Three Tier Multiple Choice Untuk Mengidentifikasi Miskonsepsi Peserta Didik Kelas Xi. Journal of Innovative Science Education, 5(2), 101–110.
  18. Mushlihuddin, R., Wahyuni, S., Harahap, T. H., & Hafni, R. C. (2021). Penerapan Pembelajaran dan Penilaian Berorientasi HOTS pada Masa Pandemi COVID 19 bagi Guru-guru Muhammadiyah. JURNAL PRODIKMAS Hasil Pengabdian Kepada Masyarakat, 6(2), 144–148.
  19. Nabilah, L. Y., Ruslan, R., & Rusli, R. (2019). Pengembangan Instrumen Diagnostik Three Tier Test pada Materi Pecahan Kelas VII. Issues in Mathematics Education (IMED), 3(2), 184–193.
  20. Netri, N., Holiwarni, B., & Abdullah. (2018). Development of Test Instruments Based Higher Order Thinking Skill (HOTS) on Chemical Equilibrium at Second Grade in Senior High School. Jurnal Online Mahasiswa Fakultas Keguruan Dan Ilmu Pendidikan, 5(2), 1–11.
  21. Peşman, H., & Eryilmaz, A. (2010). Development of a three-tier test to assess misconceptions about simple electric circuits. Journal of Educational Research, 103(3), 208–222.
  22. Pradana, I. G. Y., Suma, K., & Sujanem, R. (2021). Pengembangan Tes Keterampilan Berpikir Tingkat Tinggi Tiga Level (Three-Tier) Berbasis Marzano Dimensions Of Learning. Wahana Matematika Dan Sains: Jurnal Matematika, Sains, Dan Pembelajarannya, 15(3), 119–128.
  23. Putri, R. H., & Ofianto. (2019). Efektivitas Analisis Butir Menggunakan Anajohn, Anates dan Iteman Studi Soal USBN Pelajaran Sejarah Kota Padang. Jurnal Mahasiswa Ilmu Sejarah Dan Pendidikan, 1(2), 1–11.
  24. Ramadhan, G., Dwijananti, P., & Wahyuni, S. (2018). Analisis Kemampuan Berpikir Tingkat Tinggi (High Order Thinking Skills) Menggunakan Instrumen Two Tier Multiple Choice Materi Konsep Dan Fenomena Kuantum Siswa Sma Di Kabupaten Cilacap. UPEJ Unnes Physics Education Journal, 7(3), 85–90.
  25. Sari, N. W. N., Sunyono, S., & Abdurrahman, A. (2019). Development Of The Three Tier Diagnostic Test Based “Higher Order Thinking Skills” Instrument. Dinamika Jurnal Ilmiah Pendidikan Dasar, 11(2), 86–93.
  26. Shidiq, A., Masykuri, M., & Van Hayus, E. S. (2014). Pengembangan Instrumen Penilaian Two-Tier Multiple Choice Untuk Mengukur Keterampilan Berpikir Tingkat Tinggi (Higher Order Thinking Skills) Pada Materi Kelarutan Dan Hasil Kali Kelarutan Untuk Siswa Sma/Ma Kelas Xi. Jurnal Pendidikan Kimia, 3(4), 83–92.
  27. Subakti, Y. R. (2021). Tantangan Guru Sejarah dalam Mengajar dan Belajar Berbasis HOTS. HISTORIA VITAE, 01(01), 52–71.
  28. Sudijono, A. (2013). Pengantar Evaluasi Pendidikan. Yogyakarta: Raja Grafindo Persada.
  29. Sutiana, Silitonga, H. T. M., & Oktavianty, E. (2018). Pengembangan Tes Diagnostik Three Tier Test pada Materi Suhu dan Kalor Untuk SMP. Gastrointestinal Endoscopy, 10(1), 279–288.
  30. Ulum, M. (2017). Analisis Butir soal Ulangan Harian pada Mata Pelajaran Ekonomi KD 3.1 Pendapatan Nasional Kelas XI IPS 1 di SMA Negeri 1 Gresik. Jurnal Pendidikan Ekonomi, 5(3), 1–5.
  31. Wahyudi, F., Didik, L. A., Bahtiar. (2021). Pengembangan Instrumen Three Tier Test Diagnostik untuk Menganalisis Tingkat Pemahaman dan Miskonsepsi Siswa Materi Elastisitas. RELATIVITAS: Jurnal Riset Inovasi Pendidikan Fisika, 4(2), 48–58.
  32. Widiyaningrum, D. K., Syamsiah, N., & Septiani, R. (2020). Analisis Kualitas Butir Soal Multiple Choice pada Tes Akademik Matematika Seleksi Penerimaan Mahasiswa Baru Sekolah Tinggi Sandi Negara (SPMB STSN) Tahun Akademik 2019/2020. Jurnal IPSIKOM, 8(2), 1–12.

Open Access Copyright (c) 2023 Journal of Educational Chemistry (JEC)
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

Journal of Educational Chemistry (JEC)
Published by Chemistry Education Department of Science and Technology Faculty, Universitas Islam Negeri Walisongo Semarang, Indonesia
Jl Prof. Dr. Hamka Km. 01 Kampus III Ngaliyan Semarang 50185
Phone: 6285640307383
Website: http://fst.walisongo.ac.id/
Email: jec@walisongo.ac.id

ISSN: 2715-3029 (Print)
ISSN: 2685-4880 (Online)

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License

Get a feed by atom here, RRS2 here and OAI Links here

 
apps