Development of a Quizizz-Based Higher-Order Thinking Skills (HOTS) Test for the Basic Mechanical Engineering Principles Element
DOI:
https://doi.org/10.52060/jpvs.v5i1.4852Abstract
Teachers of Basic Mechanical Engineering at a vocational high school in Jakarta still write test items mostly at the remembering, understanding, and applying levels, whereas the Merdeka Curriculum calls for assessment that trains higher-order thinking. This study aimed to describe the development procedure, examine the validity, and assess the practicality of a Quizizz-based higher-order thinking cognitive test for Phase E students. We used an exploratory sequential design within research and development, covering analysis, design, development, and implementation. Twenty multiple-choice items at the analyzing, evaluating, and creating levels were reviewed by content, item review, and language experts, administered to 90 machining students, and analyzed with the Rasch model in QUEST. Aiken's V for content validation reached 0.847 (high), the item review rating was 82.8%, the language rating 100%, and the teacher response 90.9% (very practical). The mean infit mean square was 1.04 and the reliability of estimate 0.89. Fifteen items fitted the model, thirteen items showed discrimination above 0.40, and fifteen items fell in the moderate difficulty range. Six items failed to discriminate, five of which were evaluating-level items. Evaluating-level multiple-choice items, particularly their distractors, need further review before the test is used more widely.
References
Abdullah, A. H., Abidin, N. L. Z., & Ali, M. (2015). Analysis of students’ errors in solving higher order thinking skills (HOTS) problems for the topic of fraction. Asian Social Science, 11(21), 133–142. https://doi.org/10.5539/ass.v11n21p133
Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1), 131–142. https://doi.org/10.1177/0013164485451012
Anderson, L. W., & Krathwohl, D. R. (Eds.). (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom’s taxonomy of educational objectives. Longman.
Boone, W. J. (2016). Rasch analysis for instrument development: Why, when, and how? CBE—Life Sciences Education, 15(4), rm4. https://doi.org/10.1187/cbe.16-04-0148
Creswell, J. W., & Creswell, J. D. (2018). Research design: Qualitative, quantitative, and mixed methods approaches (5th ed.). SAGE Publications.
Göksün, D. O., & Gürsoy, G. (2019). Comparing success and engagement in gamified learning experiences via Kahoot and Quizizz. Computers & Education, 135, 15–29. https://doi.org/10.1016/j.compedu.2019.02.015
Hadi, S., Retnawati, H., Munadi, S., Apino, E., & Wulandari, N. F. (2018). The difficulties of high school students in solving higher-order thinking skills problems. Problems of Education in the 21st Century, 76(4), 520–532. https://doi.org/10.33225/pec/18.76.520
Hamidah, M. H., & Wulandari, S. S. (2021). Pengembangan instrumen penilaian berbasis HOTS menggunakan aplikasi “Quizizz”. Efisiensi: Kajian Ilmu Administrasi, 18(1), 105–124. https://doi.org/10.21831/efisiensi.v18i1.36997
Istiyono, E., Dwandaru, W. S. B., Lede, Y. A., Rahayu, F., & Nadapdap, A. (2019). Developing IRT-based physics critical thinking skill test: A CAT to answer 21st century challenge. International Journal of Instruction, 12(4), 267–280. https://doi.org/10.29333/iji.2019.12417a
Istiyono, E., Mardapi, D., & Suparno. (2014). Pengembangan tes kemampuan berpikir tingkat tinggi fisika (PysTHOTS) peserta didik SMA. Jurnal Penelitian dan Evaluasi Pendidikan, 18(1), 1–12. https://doi.org/10.21831/pep.v18i1.2120
Licorish, S. A., Owen, H. E., Daniel, B., & George, J. L. (2018). Students’ perception of Kahoot!’s influence on teaching and learning. Research and Practice in Technology Enhanced Learning, 13, Article 9. https://doi.org/10.1186/s41039-018-0078-8
Narassati, N. A., Saleh, R., & Arthur, R. (2021). Pengembangan alat evaluasi berbasis HOTS menggunakan aplikasi Quizizz pada mata pelajaran mekanika teknik dalam pembelajaran jarak jauh. Jurnal Pendidikan Teknik Sipil, 3(2), 169–180. https://doi.org/10.21831/jpts.v3i2.43919
Nisa, S., & Pahlevi, T. (2021). Pengembangan instrumen penilaian HOTS berbantuan Quizizz pada mata pelajaran kearsipan SMK. Edukatif: Jurnal Ilmu Pendidikan, 3(5), 2146–2159. https://doi.org/10.31004/edukatif.v3i5.756
Retnawati, H., Djidu, H., Kartianom, Apino, E., & Anazifa, R. D. (2018). Teachers’ knowledge about higher-order thinking skills and its learning strategy. Problems of Education in the 21st Century, 76(2), 215–230. https://doi.org/10.33225/pec/18.76.215
Sukatiman, Akhyar, M., Siswandari, & Roemintoyo. (2020). Enhancing higher-order thinking skills in vocational education through scaffolding-problem based learning. Open Engineering, 10(1), 612–619. https://doi.org/10.1515/eng-2020-0070
Tanujaya, B., Mumu, J., & Margono, G. (2017). The relationship between higher order thinking skills and academic performance of student in mathematics instruction. International Education Studies, 10(11), 78–85. https://doi.org/10.5539/ies.v10n11p78
Wang, A. I., & Tahir, R. (2020). The effect of using Kahoot! for learning – A literature review. Computers & Education, 149, 103818. https://doi.org/10.1016/j.compedu.2020.103818
Zhao, F. (2019). Using Quizizz to integrate fun multiplayer activity in the accounting classroom. International Journal of Higher Education, 8(1), 37–43. https://doi.org/10.5430/ijhe.v8n1p37
| Keywords | : |
Keywords:
higher-order thinking, assessment instrument, Rasch model, Quizizz, mechanical engineering
|
| Galleys | : | |
| Published | : |
2026-09-29
|
| Issue | : |
Copyright (c) 2026 Jurnal Pendidikan Vokasi dan Seni
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
.png)
