Utilizing Item Response Theory Approach for Calibrating Items in the Final Assessment of Islamic Cultural History Subject
##plugins.themes.bootstrap3.article.main##
Abstract
Purpose –The aim of this exploratory descriptive study with a IRT approach is to evaluate the quality of items used in the final assessment of 10th grade Islamic cultural history subject at Madrasah Aliyah Negeri (MAN) 2 Bantul Yogyakarta.
Design/methods/approach–Data was collected through documentation of student responses at the end of the year assessment. Student response data were analyzed using the item response theory approach.
Findings – Based on the analysis of 25 questions on the Islamic Cultural History subject at MAN 2 Bantul, the study concludes that the instrument fits the 1 PL model (Logistics parameter), as indicated by the results of the model fit test. The parameter analysis of item difficulty level with the 1 PL model reveals that 7 items fall under the very easy category, 5 items under the easy category, 9 items under the medium category, and 4 items under the very difficult category. Notably, none of the items fall under the difficult category in this 1 PL model.
Research implications/limitations –The findings on the distribution of item difficulty levels could guide educators in revising and improving the quality of assessment tools, ensuring that the questions are well-balanced and challenging enough to effectively evaluate students' knowledge and skills. Moreover, the absence of items falling under the difficult category in the 1 PL model suggests a need for more rigorous and challenging items to enhance the validity and reliability of the assessment instrument.
Originality/value–The research value of this study lies in its contribution to the development of a valid and reliable assessment tool in the field of Islamic cultural history subject.
Keywords:
Downloads
##plugins.themes.bootstrap3.article.details##
Copyright

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Copyright Notice
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
References
Arikunto, S. (2008). Penelitian tindakan kelas/Suharsimi Arikunto. Bumu Aksara.
Djemari, M. (2008). Teknik penyusunan instrumen tes dan nontes. Mitra Cendekia.
Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1985). Principles and applications of item response theory. Kluwer-Nijhoff Publishing Company.
Hasnah, H. (2017). Analisis kualitas soal matematika Ujian Sekolah kelas XII IPA SMA Negeri di Watansoppeng berdasarkan Teori Respon Butir. PEP Educational Assessment, 1(1), 27–34.
Istiyono, E. (2018). Pengembangan Instrumen Penilaian dan Analisis Hasil Belajar Fisika dengan Teori Tes Klasik dan Modern. UNY Press.
Istiyono, E., Dwandaru, W. S. B., Setiawan, R., & Megawati, I. (2020). Developing of Computerized Adaptive Testing to Measure Physics Higher Order Thinking Skills of Senior High School Students and Its Feasibility of Use. European Journal of Educational Research, 9(1), 91–101.
Karkal, Y. R., & Kundapur, G. S. (2016). Item analysis of multiple choice questions of undergraduate pharmacology examinations in an International Medical School in India. Journal of Dr. NTR University of Health Sciences, 5(3), 183.
Kartowagiran, B. (2009). Pengantar Teori Tes Klasik. Pascasarjana UNY & Dinas Pendidikan Propinsi Yogyakarta.
Kemendikbud. (2017). Panduan Penilaian oleh Pendidik dan Satuan Pendidikan untuk Sekolah Menengah Pertama. Kementerian Pendidikan dan Kebudayaan Direktorat Jenderal Pendidikan Dasar dan Menengah Direktorat Pembinaan Sekolah Menengah Pertama.
Kheyami, D., Jaradat, A., Al-Shibani, T., & Ali, F. A. (2018). Item analysis of multiple choice questions at the department of paediatrics, Arabian Gulf University, Manama, Bahrain. Sultan Qaboos University Medical Journal, 18(1), e68.
Kurniawan, R. Y., Prakoso, A. F., Hakim, L., Dewi, R. M., & Widayanti, I. (2017). Pemberian Pelatihan Analisis Butir Soal Bagi Guru di Kabupaten Jombang: Efektif? Jurnal Pemberdayaan Masyarakat Madani (JPMM), 1(2), 179–193.
Mardapi, D. (2012). Pengukuran Penilaian dan Evaluasi Pendidikan. Nuha Medika.
Nurcahyo, F. A. (2016). Aplikasi IRT dalam analisis aitem tes kognitif. Buletin Psikologi, 24(2), 64–75.
Oktarina, A., & Fatonah, S. (2021). Pengamatan Tentang Pembelajaran Dan Penilaian Pada Anak Usia Dini Di Era Pandemi Covid-19. Cakrawala Dini: Jurnal Pendidikan Anak Usia Dini, 12(1), 31–40.
Perdana, S. A. (2018). Analisis kualitas instrumen pengukuran pemahaman konsep persamaan kuadrat melalui teori tes klasik dan rasch model. Jurnal Kiprah, 6(1), 41–48.
Prihatin, R. P., & Hamami, T. (2022). Learning Assessment Model for Islamic Religious Education. Nusantara: Jurnal Pendidikan Indonesia, 2(2), 373–390.
Purwanto. (2010). Evaluasi Hasil Belajar. Pustaka Pelajar.
Ratnaningsih, D. J., & Isfarudi, I. (2013). Analisis butir tes objektif ujian akhir semester mahasiswa Universitas Terbuka berdasarkan teori tes modern. Jurnal Pendidikan Terbuka Dan Jarak Jauh, 14(2), 98–109.
Retnawati, H. (2014). Teori respons butir dan penerapannya: Untuk peneliti, praktisi pengukuran dan pengujian, mahasiswa pascasarjana. Nuha Medika.
Setemen, K. (2018). Pengembangan Dan Pengujian Validitas Butir Instrumen Kecerdasan Logis-Matematis. Jurnal Pendidikan Teknologi Dan Kejuruan, 15(2).
Sudaryono, S. (2011). Implementasi Teori Responsi Butir (Item Response Theory) Pada Penilaian Hasil Belajar Akhir di Sekolah. Jurnal Pendidikan Dan Kebudayaan, 17(6), 719–732.
Sudjana, N. (2009). Penilaian Hasil Proses Belajar Mengajar. Remaja Rosda Karya.
Sumiati, A., Widiastuti, U., & Suhud, U. (2018). Workshop Teknik Menganalisis Butir Soal dalam Meningkatkan Kompetensi Guru di SMK Cileungsi Bogor. Jurnal Pemberdayaan Masyarakat Madani (JPMM), 2(1), 136–153.
Syafii, A., Haryanto, H., Ahmad, I. F., & Fauziah, A. (2021). Analysis of Items with Item Response Theory (IRT) Approach on Final Assessment for Al-Quran Hadith Subjects. Jurnal Pendidikan Agama Islam, 18(1), 167–194.
Wening, S. (2012). Materi Evaluasi Pembelajaran. Fakultas Teknik Universitas Negeri Yogyakarta.
Yusron, E., Retnawati, H., & Rafi, I. (2020). Bagaimana hasil penyetaraan paket tes USBN pada mata pelajaran matematika dengan teori respon butir? Jurnal Riset Pendidikan Matematika, 7(1), 1–12.
205
Views
169
Downloads