Program Evaluation Study on Islamic Religious Education in Pesantren: Addressing Educational Degradation in the Digital Era

Published: on JPAI: Jun 30, 2025
Zawaqi Afdal Jamil
Nurhuda
Alfian
Siti Mariah Ulfah
Rasidin
Ahmed Youssef
Pages: 122-139

##plugins.themes.bootstrap3.article.main##

Download PDF Share Copyright

Abstract

Purpose – This study aims to evaluate the forms and underlying causes of educational degradation in pesantren (Islamic boarding schools) within the context of the digital era. It is to identify Islamic Boarding schools which are prepared to adopt technology in their teaching systems

Design/methodology/approach – The study employed a program evaluation method using a formative evaluation model. Data collection and analysis were conducted through a mixed-methods approach. Quantitative data were gathered through questionnaires and analyzed using descriptive statistics, while qualitative data were collected through in-depth interviews and analyzed thematically.

Findings – The evaluation results revealed that the average scores for the aspects related to educational degradation and its contributing factors were extremely low, at only 16.4% and 19.5%, respectively. These findings suggest that the limited use of technology in pesantren teaching reflects an institutional decline. This condition is attributed to inadequate infrastructure, low digital literacy, resistance to cultural change, and the absence of curricula and policies aligned with contemporary developments. The study highlights the urgent need for strategic interventions to enhance infrastructure, digital competence, and curriculum reform to prevent pesantren from falling further behind in the digital era.

Research implications/limitations – The study implies that the low level of digital adoption necessitates strategic planning for infrastructure provision and teacher training to improve digital literacy. However, the study is limited in scope to the analysis of Islamic education degradation within pesantren. Future research should consider broader investigations using inferential statistical analysis to measure the impact of technology adoption across different pesantren contexts.

Originality/value – This research offers a novel contribution by proposing a data-driven approach, the use of digital platforms, and innovation in teaching methods as practical solutions to ensure the continuity of Islamic education in pesantren without compromising its core spiritual values

Keywords:

Digital Transformation Educational Degradation Islamic Education Reform Pesantren Education Program evaluation Technology Adoption

Downloads

Download data is not yet available.

##plugins.themes.bootstrap3.article.details##

References

Admiraal, W., J. Vermeulen, and J. Bulterman-Bos. 2020. “Teaching with Learning Analytics:How to Connect Computer-Based Assessment Data with Classroom Instruction?” Technology, Pedagogy and Education 29(5):577–91. doi: 10.1080/1475939X.2020.1825992.

Al-Rikabi, Y. K., and G. A. Montazer. 2024. “Designing an E-Learning Readiness Assessment Model for Iraqi Universities Employing Fuzzy Delphi Method.” Education and Information Technologies 29(2):2217–57. doi: 10.1007/s10639-023-11889-0.

Alshehri, A., M. J. Rutter, and S. Smith. 2019. “An Implementation of the UTAUT Model for Understanding Students’ Perceptions of Learning Management Systems: A Study within Tertiary Institutions in Saudi Arabia.” International Journal of Distance Education Technologies 17(3):1–24. doi: 10.4018/IJDET.2019070101.

Ambiyar, and Muharika Dewi. 2019. Metodologi Penelitian Evaluasi Program. 1st ed. Bandung: Alfabeta.

Arifin, Zainal. 2019. Evaluasi Program: Teori Dan Praktek Dalam Konteks Pendidikan Dan Nonpendidikan. 1st ed. edited by N. A. N. Bandung: Remaja Rosdakarya.

Awad, A., M. Shemais, and M. Al-Embabi. 2024. “Driving HR Performance through Digital Transformation in Educational Directorates: A Strategic Imperative.” Problems and Perspectives in Management 22(4):163–73. doi: 10.21511/ppm.22(4).2024.13.

Azizah, N., E. Nurdianzah, M. M. Wijaya, T. Azami, and A. Rohman. 2023. “Religious Moderation in The Industrial Era 4.0: Deradicalization Through The Development of Intellectual Traditions at Fadhlul Fadhlan Islamic Boarding School Semarang.” Jurnal Pendidikan Agama Islam 20(2):233–46. doi: 10.14421/jpai.v20i2.7771.

Azkiyah, S. N. 2017. “Educational Effectiveness Research as the Knowledge Base of Improving Education.” Pertanika Journal of Social Sciences and Humanities 25(3):1019–38.

Boskovic, D., D. Husremovic, M. Muslic, and A. Kapo. 2023. “Teachers and Students as Promoters or Repressors of Sustainable Education: Navigating the Blended Learning Landscape.” Sustainability (Switzerland) 15(24). doi: 10.3390/su152416812.

Boukrouh, I., F. Tayalati, and A. Azmani. 2024. “A Comprehensive Framework for Supplier Selection: Using Subjective, Objective, and Hybrid Multi-Criteria Decision-Making Techniques With Sensitivity Analysis.” IEEE Access 12:145550–69. doi: 10.1109/ACCESS.2024.3462348.

Bragstad, L. K., B. A. Bronken, U. Sveen, E. G. Hjelle, G. Kitzmüller, R. Martinsen, K. J. Kvigne, M. Mangset, and M. Kirkevold. 2019. “Implementation Fidelity in a Complex Intervention Promoting Psychosocial Well-Being Following Stroke: An Explanatory Sequential Mixed Methods Study.” BMC Medical Research Methodology 19(1). doi: 10.1186/s12874-019-0694-z.

Brooks, H., I. Irmansyah, A. K. Syarif, R. Pedley, L. Renwick, A. P. Rahayu, C. Manik, B. Prawira, M. Hann, H. Brierley, K. Lovell, and P. Bee. 2023. “Evaluating a Prototype Digital Mental Health Literacy Intervention for Children and Young People Aged 11–15 in Java, Indonesia: A Mixed Methods, Multi-Site Case Study Evaluation.” Child and Adolescent Psychiatry and Mental Health 17(1). doi: 10.1186/s13034-023-00608-9.

Codina, D., and M. Estebanell. 2023. “Teachers’ Digital Competence as a Key Factor in the Process of Technological Adoption in Schools.” Aloma 41(1):27–34. doi: 10.51698/aloma.2023.41.1.27-34.

Cotet, G. B., N. L. Carutasu, and F. Chiscop. 2020. “Industry 4.0 Diagnosis from an Imillennial Educational Perspective.” Education Sciences 10(1). doi: 10.3390/educsci10010021.

Darwanto, A., R. C. I. Prahmana, A. Susanti, and I. A. Khalil. 2024. “Transformation of Boarding School Management Models in Enhancing Student Accessibility and Educational Quality.” Jurnal Pendidikan Agama Islam 21(1):145–64. doi: 10.14421/jpai.v21i1.8632.

Dogan, E. 2018. “An Application of the Partial Credit IRT Model in Identifying Benchmarks for Polytomous Rating Scale Instruments.” Practical Assessment, Research and Evaluation 23(7):1–10.

Elwy, A. R., A. D. Wasan, A. G. Gillman, K. L. Johnston, N. Dodds, C. McFarland, and C. M. Greco. 2020. “Using Formative Evaluation Methods to Improve Clinical Implementation Efforts: Description and an Example.” Psychiatry Research 283. doi: 10.1016/j.psychres.2019.112532.

Fakhri, Jamal, Heru Juabdin Sada, M. Indra Saputra, Syahril Jamil, and Dian Mursyidah. 2023. “Performing Hybrid Learning At Islamic Higher Education Institusions for Mitigating Learning Loss.” Jurnal Pendidikan Islam 9(2):223–40. doi: 10.15575/jpi.v9i2.28874.

Gaddis, M. L. 2020. “Faculty and Student Technology Use to Enhance Student Learning.” International Review of Research in Open and Distributed Learning 21(4):40–55. doi: 10.19173/IRRODL.V21I3.4600.

Gross, S., C. Hankeln, K. A. Rösike, and S. Prediger. 2024. “How Do Expert and Novice Teachers Monitor and Enhance Student Understanding? Qualitative Comparisons Informing the Design of a Digital Formative Assessment Platform.” Technology, Knowledge and Learning. doi: 10.1007/s10758-024-09755-0.

Halevi Hochwald, I., G. Green, Y. Sela, Z. Radomyslsky, R. Nissanholtz-Gannot, and O. Hochwald. 2023. “Converting Qualitative Data into Quantitative Values Using a Matched Mixed-Methods Design: A New Methodological Approach.” Journal of Advanced Nursing 79(11):4398–4410. doi: 10.1111/jan.15649.

Han, X. 2025. “Research on English E-Learning Teaching Model Based on Digital Entertainment and Gamification Experience: Interactive Teaching Experience.” Entertainment Computing 52. doi: 10.1016/j.entcom.2024.100867.

Hefner, C. 2022. “Morality, Religious Authority, and the Digital Edge: Indonesian Muslim Schoolgirls Online.” American Ethnologist 49(3):359–73. doi: 10.1111/amet.13088.

Hillman, V. 2023. “Bringing in the Technological, Ethical, Educational and Social-Structural for a New Education Data Governance.” Learning, Media and Technology 48(1):122–37. doi: 10.1080/17439884.2022.2052313.

Hong, J. C., H. Y. Ho, M. C. Liu, and K. H. Tai. 2024. “Live-Streaming Performance in Inquiry-Based Science Learning With Action: Teachers’ Perspectives.” Journal of Baltic Science Education 23(1):9–19. doi: 10.33225/jbse/24.23.09.

Honson, V., T. Vu, T. P. Tran, and W. Tejada Estay. 2024. “Using Learning Analytics to Alleviate Course and Student Support Administrative Load for Large Classes: A Case Study.” Journal of Work-Applied Management 16(2):303–15. doi: 10.1108/JWAM-11-2023-0121.

Huda, N., B. S. Widodo, and M. Aseri. 2024. “Strategies for Strengthening Character Education in Islamic Boarding Schools Through Extracurricular Activities.” Munaddhomah 5(3):354–66. doi: 10.31538/munaddhomah.v5i3.1397.

Ilin, V. 2022. “The Role of User Preferences in Engagement with Online Learning.” E-Learning and Digital Media 19(2):189–208. doi: 10.1177/20427530211035514.

Isaías, P. 2018. “Model for the Enhancement of Learning in Higher Education through the Deployment of Emerging Technologies.” Journal of Information, Communication and Ethics in Society 16(4):401–12. doi: 10.1108/JICES-04-2018-0036.

Jung, J., S. Choi, and M. Fanguy. 2024. “Exploring Teachers’ Digital Literacy Experiences.” International Review of Research in Open and Distributed Learning 25(2):41–59. doi: 10.19173/irrodl.v25i2.7572.

Karanth, D., S. Abu Arqub, and C. Dolce. 2024. “The Applications of Digital Technology in Postgraduate Orthodontic Education.” Seminars in Orthodontics 30(4):436–42. doi: 10.1053/j.sodo.2024.03.003.

Khanipoor, F., and Z. Karimian. 2024. “Unleashing the Power of Data: The Promising Future of Learning Analytics in Medical Education: A Commentary.” Education and Information Technologies. doi: 10.1007/s10639-024-13273-y.

Kuznetsova, E. 2019. “Evaluation and Interpretation of Student Satisfaction with the Quality of the University Educational Program in Applied Mathematics.” Teaching Mathematics and Its Applications 38(2):107–19. doi: 10.1093/teamat/hry005.

Li, J., R. He, and T. Wang. 2022. “A Data-Driven Decision-Making Framework for Personnel Selection Based on LGBWM and IFNs.” Applied Soft Computing 126. doi: 10.1016/j.asoc.2022.109227.

Lochmiller, C. R. 2021. “Conducting Thematic Analysis with Qualitative Data.” Qualitative Report 26(6):2029–44. doi: 10.46743/2160-3715/2021.5008.

Ma’arif, M. A., M. Rokhman, M. A. Fatikh, A. Kartiko, and M. S. Hasan. 2025. “Kiai’s Leadership Strategies in Strengthening Religious Moderation In Islamic Boarding Schools.” Jurnal Ilmiah Peuradeun 13(1):23–48. doi: 10.26811/peuradeun.v13i1.1168.

Major, L., G. A. Francis, and M. Tsapali. 2021. “The Effectiveness of Technology-Supported Personalised Learning in Low- and Middle-Income Countries: A Meta-Analysis.” British Journal of Educational Technology 52(5):1935–64. doi: 10.1111/bjet.13116.

Mattos, L. K. D., L. Flach, A. M. Costa, and R. P. O. Moré. 2023. “Effectiveness and Sustainability Indicators in Higher Education Management.” Sustainability (Switzerland) 15(1). doi: 10.3390/su15010298.

Maulidati, Z., and P. Abbott. 2024. “A Postphenomenological Study of the Digital Experience of Islamic Boarding School Graduates Transitioning to University Education.” Communications of the Association for Information Systems 55.

Messina Dahlberg, G., and S. Bagga-Gupta. 2014. “Understanding Glocal Learning Spaces. An Empirical Study of Languaging and Transmigrant Positions in the Virtual Classroom.” Learning, Media and Technology 39(4):468–87. doi: 10.1080/17439884.2014.931868.

Minc, S. D., P. P. Chandanabhumma, C. L. Sedney, T. S. Haggerty, D. M. Davidov, and R. A. Pollini. 2022. “Mixed Methods Research: A Primer for the Vascular Surgeon.” Seminars in Vascular Surgery 35(4):447–55. doi: 10.1053/j.semvascsurg.2022.09.003.

Montenegro-Rueda, M., and J. Fernández-Cerero. 2023. “Digital Competence of Special Education Teachers: An Analysis from the Voices of Members of School Management Teams.” Societies 13(4). doi: 10.3390/soc13040084.

Mukhlis, M., M. Jufri, Y. I. Arowosaiye, E. Garunja, and H. Boemiya. 2024. “The Legal Culture to Prevent Radical Islamism by a Pesantren in Madura.” De Jure: Jurnal Hukum Dan Syar’iah 16(1):58–87. doi: 10.18860/j-fsh.v16i1.26216.

Naga, Dali S. 1992. Pengantar Teori Sekor Pada Pengukuran Pendidikan. Jakarta: Gunadarma.

Nelson, M. J., R. Voithofer, and S. L. Cheng. 2019. “Mediating Factors That Influence the Technology Integration Practices of Teacher Educators.” Computers and Education 128:330–44. doi: 10.1016/j.compedu.2018.09.023.

Pangrazio, L., G. Auld, J. Lynch, C. Sawatzki, G. Duffy, S. Hannigan, and J. O’Mara. 2024. “Data Justice in Education: Toward a Research Agenda.” Educational Philosophy and Theory. doi: 10.1080/00131857.2024.2320196.

Polupan, K. L. 2018. “Interactive Intellectual Environment as a Digital Technology of Continuous Education.” Vysshee Obrazovanie v Rossii 27(11):90–95. doi: 10.31992/0869-3617-2018-27-11-90-95.

Prosek, E. A. 2020. “An Introduction to Mixed Methods Design in Program Evaluation.” Counseling Outcome Research and Evaluation 11(2):60–70. doi: 10.1080/21501378.2019.1590688.

Qin, R., and Z. Yu. 2024. “Extending the UTAUT Model of Tencent Meeting for Online Courses by Including Community of Inquiry and Collaborative Learning Constructs.” International Journal of Human-Computer Interaction 40(18):5279–97. doi: 10.1080/10447318.2023.2233129.

Ramos, T. B., M. Montaño, J. Joanaz De Melo, M. P. Souza, C. C. D. Lemos, A. R. Domingues, and A. Polido. 2015. “Strategic Environmental Assessment in Higher Education: Portuguese and Brazilian Cases.” Journal of Cleaner Production 106:222–28. doi: 10.1016/j.jclepro.2014.12.088.

Reis-Andersson, J. 2024. “Leading the Digitalisation Process in K–12 Schools – The School Leaders’ Perspective.” Education and Information Technologies 29(3):2585–2603. doi: 10.1007/s10639-023-11935-x.

Riski, A., and A. Chande. 2024. “Implementation of a Digital Leadership Model in Improving the Quality of Islamic Boarding Schools.” Munaddhomah 5(2):185–94. doi: 10.31538/munaddhomah.v5i2.566.

Saleh, M. N. I. 2025. “Perceptions of Pesantren Leaders towards Islamic Moderation Approaches in Combating Radicalism and Terrorism.” Cogent Arts and Humanities 12(1). doi: 10.1080/23311983.2025.2474826.

Summers, R. J., H. E. Higson, and E. Moores. 2021. “Measures of Engagement in the First Three Weeks of Higher Education Predict Subsequent Activity and Attainment in First Year Undergraduate Students: A UK Case Study.” Assessment and Evaluation in Higher Education 46(5):821–36. doi: 10.1080/02602938.2020.1822282.

Teasdale, Rebecca M. 2022. “Representing the Values of Program Participants: Endogenous Evaluative Criteria.” Evaluation and Program Planning 94:102123. doi: 10.1016/j.evalprogplan.2022.102123.

Tiernan, P. 2015. “An Inquiry into the Current and Future Uses of Digital Video in University Teaching.” Education and Information Technologies 20(1):75–90. doi: 10.1007/s10639-013-9266-8.

Tomei, Gabriele. 2023. “DOME: A Mixed-Method Evaluation of the Impacts of Complex Programmes Against Educational Poverty.” Evaluation 29(2):190–207. doi: 10.1177/13563890231166979.

Tømte, C. E., and S. Wollscheid. 2024. “The Changing Role of ICT-Coordinators in Schools: A Longitudinal Study.” European Journal of Teacher Education. doi: 10.1080/02619768.2024.2406893.

Tran, K., and T. Nguyen. 2021. “Preliminary Research on the Social Attitudes toward the Ai’s Involved Christian Education in Vietnam: Promoting Ai Technology for Religious Education.” Religions 12(3):1–20. doi: 10.3390/rel12030208.

Vanermen, L., J. Vlieghe, and M. Decuypere. 2022. “Curriculum Meets Platform: A Reconceptualisation of Flexible Pathways in Open and Higher Education.” Curriculum Inquiry 52(4):443–68. doi: 10.1080/03626784.2022.2120347.

Veytia Bucheli, M. G., J. Gómez-Galán, M. L. Cáceres Mesa, and L. López Catalán. 2024. “Digital Technologies as Enablers of Universal Design for Learning: Higher Education Students’ Perceptions in the Context of SDG4.” Discover Sustainability 5(1). doi: 10.1007/s43621-024-00699-0.

Wiseman, A. W. 2022. “The ‘New’ Norms of Education Policy in the 21st Century: Polemics, Pandemics, and ‘Cloaking’ Persistent Inequality in Education Worldwide.” Revista Espanola de Educacion Comparada (40):15–34. doi: 10.5944/reec.40.2022.31298.

Yildiz, H., and S. I. K. Gonen. 2024. “Automated Writing Evaluation System for Feedback in The Digital World: An Online Learning Opportunity for English as A Foreign Language Students.” Turkish Online Journal of Distance Education 25(3):184–206. doi: 10.17718/TOJDE.1169727.

Zainal, S., M. A. Manumanoso Prasetyo, C. M. Aziz Yaacob, and Y. Jamali. 2022. “Adopting Pesantren-Based Junior High School Programs: The Pesantren Change Its Educational System Without Conflict.” Jurnal Ilmiah Islam Futura 22(2):260–76. doi: 10.22373/JIIF.V22I2.13525.

Zhang, J., and Y. Wu. 2025. “Impact of University Teachers’ Digital Teaching Skills on Teaching Quality in Higher Education.” Cogent Education 12(1). doi: 10.1080/2331186X.2024.2436706.

Zhao, X., F. Pan, X. Ma, S. A. Raza, and X. Zhou. 2023. “New Challenges in Mitigating Climate Change: Digital Teaching for the Sustainable Development and Innovation.” Heliyon 9(12). doi: 10.1016/j.heliyon.2023.e22829.

789

Views

536

Downloads

Open Access
Related Article: