Rasch Model Analysis of Senior High School Physics Test Items in an Academic Competition in North Sulawesi
DOI:
https://doi.org/10.14421/impulse.2026.61-03Keywords:
Item Analysis, Quest Program, Rasch Model, Temu FisikaAbstract
Evaluating the quality of test items is crucial for accurately assessing student competence in academic competitions such as physics olympiads. This study aims to analyze the quality of physics olympiad test items used in the Temu Fisika 2024 competition for senior high school students across North Sulawesi. A total of 40 multiple-choice items from the preliminary round of the Temu Fisika 2024 physics olympiad were analyzed. The responses of 35 high school students who participated in the competition were examined using the Rasch model through the QUEST program. The analysis covered item fit, reliability (item and person), difficulty level, and distractor effectiveness as complementary CTT analysis. The results showed that 33 items (82.5%) fit the Rasch model, while seven items showed misfit. The Rasch reliability indices were good (Item Reliability = 0.82, Person Reliability = 0.84). The difficulty levels were appropriately distributed, with 50% of items categorized as moderate, 22.5% easy, 20% difficult, 2.5% very easy, and 5% very difficult. However, distractor analysis revealed a significant shortcoming: only 15% of items had all distractors functioning effectively. This study is the first Rasch analysis of the Temu Fisika olympiad, providing empirical evidence that while the test is generally reliable, specific improvements are needed. The findings highlight the importance of revising misfitting items and non-functional distractors to improve the discriminating power of the test, particularly among high-ability participants. This study also provides a practical reference for improving item development and validation processes in academic competitions.
References
Abdulfattah, A., & Supahar. (2019). The development of high school physics problem solving skills test instruments based problem-based learning. Journal for the Education of Gifted Young Scientists, 7(4), 1037–1052. https://doi.org/10.17478/jegys.602291
Arikunto, S. (2015). Dasar-dasar Evaluasi Pendidikan. Bumi Aksara.
Azwar, S. (2015). Reliability and Validity (fourth). Pustaka Pelajar.
Bond, T. G., Yan, Z., & Heene, M. (2021). Applying the Rasch Model, Fundamental Measurement in the Human Sciences. Routledge. https://doi.org/10.4324/9781410614575
Boone, W. J., Staver, J. R., & Yale, M. S. (2014). Rasch Analysis in The Human Sciences. Springer.
Ceuppens, S., Deprez, J., Dehaene, W., & De Cock, M. (2018). Design and validation of a test for representational fluency of 9th grade students in physics and mathematics: The case of linear functions. Physical Review Physics Education Research, 14(2), 20105. https://doi.org/10.1103/PhysRevPhysEducRes.14.020105
D’Sa, J. L., & Visbal-Dionaldo, M. L. (2017). Analysis of Multiple Choice Questions: Item Difficulty, Discrimination Index and Distractor Efficiency. International Journal of Nursing Education, 9(3), 109. https://doi.org/10.5958/0974-9357.2017.00079.4
George, D., & Mallery, P. (2020). IBM SPSS Statistics 26 Step by Step: A Simple Guide and Reference (Sixteenth). Routledge. https://doi.org/10.4324/9780429056765
Hanna, W. F., & Retnawati, H. (2022). Analisis Kualitas Butir Soal Matematika Menggunakan Model Rasch Dengan Bantuan Software Quest. AKSIOMA: Jurnal Program Studi Pendidikan Matematika, 11(4), 3695. https://doi.org/10.24127/ajpm.v11i4.5908
Istiyono, E. (2018). Pengembangan Instrumen Penilaian dan Analisis Hasil Belajar Fisika dengan Teori Tes Klasik dan Modern. UNY Press.
Kamilah, D. S., & Suwarna, I. P. (2016). Pengembangan Three-Tier Test Digital Untuk Mengidentifikasi Miskonsepsi Pada Konsep Fluida Statis. Edusains, 8(2), 212–220. https://doi.org/10.15408/es.v8i2.5192
Linacre, J. M. (1994). Sample Size and Item Calibration or Person Measure Stability. Rasch Measurement Transactions, 7(4), 328.
Nirmala, M. F. T., Tumanggor, A. M. R., & Supahar. (2021). Analysis of Validity and Reliability of Diagnostic Test of Picture Representation Ability in High School Physics Learning. Proceedings of the 7th International Conference on Research, Implementation, and Education of Mathematics and Sciences (ICRIEMS 2020), 528(Icriems 2020), 538–546. https://doi.org/10.2991/assehr.k.210305.079
Smith, K. N., Jaeger, A. J., & Thomas, D. (2021). “Science Olympiad Is Why I’m Here”: The Influence of an Early STEM Program on College and Major Choice. Research in Science Education, 51, 443–459. https://doi.org/10.1007/s11165-019-09897-7
Sumintono, B., & Widhiarso, W. (2015). Aplikasi Pemodelan Rasch pada Assessment Pendidikan. Trim Komunikata Publishing House.
Syarif, E. A., & Syamsurizal, S. (2019). Analyzed Quality of Senior High School Biology Olympiad Questions at West Sumatera, Riau, Jambi, and Bengkulu in 2018. Bioeducation Journal, 3(2), 142–150. https://doi.org/10.24036/bioedu.v3i2.194
Tschisgale, P. L., Steegh, A., Petersen, S., Kubsch, M., Wulff, P., & Neumann, K. (2024). Are science competitions meeting their intentions? A case study on affective and cognitive predictors of success in the Physics Olympiad. Disciplinary and Interdisciplinary Science Education Research, 6(1). https://doi.org/10.1186/s43031-024-00102-y
Tumanggor, A. M. R., Jumadi, J., Wilujeng, I., & Ringo, E. S. (2019). The Profile of Students’ Physics Problem Solving Ability in Optical Instruments. Jurnal Penelitian & Pengembangan Pendidikan Fisika, 5(1), 29–40. https://doi.org/10.21009/1.05104
Tumanggor, A. M. R., & Supahar. (2021). Dissemination of Online Diagnostic Test Instrument to Diagnose High School Students’ Mathematical Representation Ability: The Case of Work and Energy. Proceedings of the 6th International Seminar on Science Education (ISSE 2020), 541, 528–537. https://doi.org/10.2991/assehr.k.210326.076
Tumanggor, A. M. R., Supahar, & Nirmala, M. F. T. (2021). The Development of Diagnostic Test Instrument for Verbal Representation Ability in High School Physics Learning. Proceedings of the 7th International Conference on Research, Implementation, and Education of Mathematics and Sciences (ICRIEMS 2020), 528, 471–476. https://doi.org/10.2991/assehr.k.210305.069
Tumanggor, A. M. R., & Supahar, S. (2020). The development of diagnostic test instrument for mathematical representation ability (PhysDTRA) in high school physics learning. Journal for the Education of Gifted Young Scientists, 8(4), 1439–1453. https://doi.org/10.17478/jegys.777425
Tumanggor, A. M. R., Supahar, S., Ringo, E. S., & Harliadi, M. D. (2020). Detecting Students’ Misconception in Simple Harmonic Motion Concepts Using Four-Tier Diagnostic Test Instruments. Jurnal Ilmiah Pendidikan Fisika Al-Biruni, 9(1), 21–31. https://doi.org/10.24042/jipfalbiruni.v9i1.4571
Wright, B. D., & Stone, M. H. (1979). Best Test Design: Rasch Measurement. Dalam Mesa Press. Routledge.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Impulse: Journal of Research and Innovation in Physics Education
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
