Between Machines and the Tafsīr Tradition: Reorienting Tafsīr bi al-Ma’ṡūr in the Age of Computational Interpretation

Authors

  • Saifullah Universitas Islam Negeri Kiai Ageng Muhammad Besari Ponorogo
  • Soleh Hasan Wahid Universitas Islam Internasional Indonesia image/svg+xml
  • Muhammad Ihza Fazrian Universitas Islam Internasional Indonesia image/svg+xml

DOI:

https://doi.org/10.14421/qh.v27i1.7499

Keywords:

tafsīr bi al-ma’ṡūr, interpretive authority, source attribution, fī sabīlillāh, language models

Abstract

This study examines authority and attribution in Qur’anic interpretation mediated by artificial intelligence. The phrase fī sabīlillāh in Q 9:60 serves as a test case because its meaning has been disputed since the earliest period, its transmission is layered, and its implications extend to zakat distribution. The same interpretive question was submitted to seven mainstream language models and assessed through tafsīr bi al-ma’ṡūr, understood as an evaluative hermeneutic centered on traceable attribution, isnād, tarjīḥ, and fidelity to sources. Interpretations by al-Ṭabarī, al-Qurṭubī, and Ibn Kaṡīr provided the basis for an analytic rubric. Two raters independently evaluated 28 model responses and reconciled their judgments through consensus, producing 248 audited error findings. Although the models generally identified the three exegetes and their works, they performed poorly in preserving isnād, narration structure, citation accuracy, and attribution. Unsupported additions and shifts of meaning dominated the errors. Higher-performing models produced more polished answers but did not eliminate source-level failures. The findings indicate that greater model capacity alone cannot secure credible machine-mediated tafsir; verification must restore the attributional discipline of tafsīr bi al-ma’ṡūr.

References

Abdelgelil, M. F. M., B. S. Tahir, and S. N. B. Syed Bidin. “Challenges of Artificial Intelligence (AI) and Its Impact on Qur’anic Qira’at: A Thematic Review Analysis.” QURANICA – International Journal of Quranic Research 17, no. 2 (2025): 74–96. http://mjs.um.edu.my/index.php/quranica/article/view/64938.

Adel, Y., M. Dorrah, A. Ashraf, A. ElSaadany, M. Mohamed, M. Wael, and G. Khoriba. “AraQA: An Arabic Generative Question-Answering Model for Authentic Religious Text.” In 2023 11th International Japan-Africa Conference on Electronics, Communications, and Computations (JAC-ECC), 235–39. IEEE, 2023. https://doi.org/10.1109/JAC-ECC61002.2023.10479645.

Ahmad Syahir, A. N., M. S. Zainal Abidin, C. Z. Sa’ari, and M. Z. Abdul Rahman. “Artificial Intelligence and Digital Transformation in Qur’anic Studies: A Systematic Literature Review.” QURANICA – International Journal of Quranic Research 17, no. 2 (2025): 542–85. http://mjs.um.edu.my/index.php/quranica/article/view/65005.

Al-Jābirī, Muḥammad ‘Ābid. al-Turāṡ wa al-ḥadāṯa: Dirāsāt wa munāqasyāt. Beirut: Markaz Dirāsāt al-Waḥda al-‘Arabiyya, 1991.

Al-Qaṭṭān, Mannā‘ Khalīl. Mabāḥiṯ fī ‘Ulūm al-Qur’ān. Cairo: Maktabah Wahbah, 2007.

Al-Qurṭubī, Muḥammad b. Aḥmad. Al-Jāmi‘ li Aḥkām al-Qur’ān. Edited by A. al-Bardūnī and I. Aṭfaysy. Vol. 8. Cairo: Dār al-Kutub al-Miṣriyya, 1964.

Al-Suyūṭī, Jalāl al-Dīn. Al-Durr al-Manṡūr fī al-Tafsīr bi al-Ma’ṯūr. Beirut: Dār al-Fikr, 1993.

Al-Ṭabarī, Ibn Jarīr. Tafsīr al-Ṭabarī: Jāmi‘ al-Bayān. Edited by M. M. Syākir. Vol. 14. Cairo: Maktaba Ibn Taymiyya, 1994.

Al-Żahabī, Muḥammad Ḥusain. At-Tafsīr wa’l-Mufassirūn. Cairo: Dār al-Ḥadīṡ, 2002.

Alan, A. Y., Ö. Aydın, and E. Karaarslan. “A RAG-Based Question Answering System Proposal for Understanding Islam: MufassirQAS LLM.” SSRN Electronic Journal, 2024. https://doi.org/10.2139/ssrn.4707470.

Anggraini, R. N. E., D. Tursina, and R. Sarno. “Islamic QA with Chatbot System Using Convolutional Neural Network.” Iraqi Journal of Science 65, no. 4 (2024): 2232–41. https://doi.org/10.24996/ijs.2024.65.4.38.

Arnaldez, R. “al-Ḳurṭbī.” In Encyclopaedia of Islam, 2nd ed., edited by P. Bearman, Th. Bianquis, C. E. Bosworth, E. van Donzel, and W. P. Heinrichs, Vol. 5. Leiden: Brill, 1986. https://doi.org/10.1163/1573-3912_islam_SIM_4553.

Balya B., M. R. “Hukum menggunakan artificial intelligence untuk rujukan agama.” NU Online Jatim, April 18, 2025. https://jatim.nu.or.id/keislaman/hukum-menggunakan-artificial-intelligence-untuk-rujukan-agama-G3hei.

Brookhart, S. M. “Appropriate Criteria: Key to Effective Rubrics.” Frontiers in Education 3 (2018): 22. https://doi.org/10.3389/feduc.2018.00022.

Calder, N. “Tafsīr from Ṭabarī to Ibn Kaṡīr: Problems in the Description of a Genre, Illustrated with Reference to the Story of Abraham.” In Approaches to the Qur’ān, edited by G. R. Hawting and A.-K. A. Shareef, 101–40. London: Routledge, 1993.

Campbell, J. L., C. Quincy, J. Osserman, and O. K. Pedersen. “Coding In-Depth Semistructured Interviews: Problems of Unitization and Intercoder Reliability and Agreement.” Sociological Methods & Research 42, no. 3 (2013): 294–320. https://doi.org/10.1177/0049124113500475.

Cohen, J. “A Coefficient of Agreement for Nominal Scales.” Educational and Psychological Measurement 20, no. 1 (1960): 37–46. https://doi.org/10.1177/001316446002000104.

Cohen, J. “Weighted Kappa: Nominal Scale Agreement with Provision for Scaled Disagreement or Partial Credit.” Psychological Bulletin 70, no. 4 (1968): 213–20. https://doi.org/10.1037/h0026256.

Contreras, R. “AI Stumbles on Questions of Faith.” Axios, June 1, 2026. https://www.axios.com/2026/06/01/ai-religious-bias-catholics-chatbots.

Feinstein, Alvan R., and Domenic V. Cicchetti. "High Agreement but Low Kappa: I. The Problems of Two Paradoxes." Journal of Clinical Epidemiology 43, no. 6 (1990): 543–549. https://doi.org/10.1016/0895-4356(90)90158-L.

Fenton, A. J., and C. Shannahan. “AI Godbots: Religious Leaders Warn of ‘Alarming Consequences’ When Machines Speak in the Name of God.” BusinessWorld, June 10, 2026. https://bworldonline.com/opinion/2026/06/10/755584/ai-godbots-religious-leaders-warn-of-alarming-consequences-when-machines-speak-in-the-name-of-god-2/.

Freitag, M., G. Foster, D. Grangier, V. Ratnakar, Q. Tan, and W. Macherey. “Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translation.” Transactions of the Association for Computational Linguistics 9 (2021): 1460–74. https://doi.org/10.1162/tacl_a_00437.

Globethics. “GEF2025: Harnessing the Power of AI: Safe and Ethical Integration.” Globethics, 2025. https://globethics.net/gef2025-harnessing-power-ai-safe-and-ethical-integration.

Graham, W. A. “Traditionalism in Islam: An Essay in Interpretation.” Journal of Interdisciplinary History 23, no. 3 (1993): 495–522. https://doi.org/10.2307/206100.

Ḥanafī, Ḥasan. al-Turāṡ wa al-tajdīd: Mawqifunā min al-turāṯ al-qadīm. Cairo: al-Markaz al-‘Arabī li al-Baḥṡ wa al-Nasyr, 1980.

Hasan, M. A., M. Hasanain, F. Ahmad, S. R. Laskar, S. Upadhyay, V. N. Sukhadia, M. Kutlu, S. A. Chowdhury, and F. Alam. “NativQA: Multilingual Culturally-Aligned Natural Query for LLMs.” arXiv, 2025. https://doi.org/10.48550/arXiv.2407.09823.

Ibn Kaṡīr, ‘Imād al-Dīn. Tafsīr al-Qur’ān al-‘Aẓīm. Edited by M. Ḥusain S. al-Dīn. Vol. 4. Beirut: Dār al-Kutub al-‘Ilmiyya, 1998.

Ji, Z., N. Lee, R. Frieske, T. Yu, D. Su, Y. Xu, E. Ishii, Y. J. Bang, A. Madotto, and P. Fung. “Survey of Hallucination in Natural Language Generation.” ACM Computing Surveys 55, no. 12 (2023): 1–38. https://doi.org/10.1145/3571730.

Jonsson, A., and G. Svingby. “The Use of Scoring Rubrics: Reliability, Validity and Educational Consequences.” Educational Research Review 2, no. 2 (2007): 130–44. https://doi.org/10.1016/j.edurev.2007.05.002.

Kamali, M. H. “Tajdīd, Iṣlāḥ and Civilisational Renewal in Islam.” Islam and Civilisational Renewal 4, no. 4 (2013): 484–511.

Khullar, S. “People Are Turning to AI Chatbots for Religious Guidance.” WIRED Middle East, February 12, 2026. https://www.wired.me/story/people-are-turning-to-ai-chatbots-for-religious-guidance.

Kojima, T., S. S. Gu, M. Reid, Y. Matsuo, and Y. Iwasawa. “Large Language Models Are Zero-Shot Reasoners.” Advances in Neural Information Processing Systems 35 (2023): 22199–213. https://doi.org/10.48550/arXiv.2205.11916.

Lommel, A., H. Uszkoreit, and A. Burchardt. “Multidimensional Quality Metrics (MQM): A Framework for Declaring and Describing Translation Quality Metrics.” Tradumàtica 12 (2014): 455–63. https://doi.org/10.5565/rev/tradumatica.77.

Lukman, F. “Digital Hermeneutics and a New Face of the Qur’an Commentary: The Qur’an in Indonesian’s Facebook.” Al-Jāmi‘ah: Journal of Islamic Studies 56, no. 1 (2018): 95–120. https://doi.org/10.14421/ajis.2018.561.95-120.

Majit, A., and M. Miski. “Pembelajaran al-Qur’an secara digital: Pergeseran sistem isnad dan peneguhan otoritas baru.” Jurnal SMART (Studi Masyarakat, Religi, dan Tradisi) 9, no. 1 (2023): 133–46. https://doi.org/10.18784/smart.v9i1.1795.

Maynez, J., S. Narayan, B. Bohnet, and R. McDonald. “On Faithfulness and Factuality in Abstractive Summarization.” In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 1906–19. Association for Computational Linguistics, 2020. https://doi.org/10.18653/v1/2020.acl-main.173.

Mirza, Y. Y. “Was Ibn Kaṡīr the ‘Spokesperson’ for Ibn Taymiyya? Jonah as a Prophet of Obedience.” Journal of Qur’ānic Studies 16, no. 1 (2014): 1–19. https://doi.org/10.3366/jqs.2014.0130.

Mohamed Nazir, A. N. U., N. K. Mohd Ithnin, I. Suliaman, and M. T. Amat Famsir @ Amat Tamsir. “Challenges in AI-Mediated Engagement with Quranic Verses: An Ethical Framework Based on Ḥadīṡ Methodology.” QURANICA – International Journal of Quranic Research 17, no. 2 (2025): 271–303. http://mjs.um.edu.my/index.php/quranica/article/view/64969.

Mohammed, M. Y., S. A. Ali, S. K. Ali, A. A. Majeed, and E. H. Mohamed. “Aftina: Enhancing Stability and Preventing Hallucination in AI-Based Islamic Fatwa Generation Using LLMs and RAG.” Neural Computing and Applications, 2025. https://doi.org/10.1007/s00521-025-11229-y.

Moskal, B. M., and J. A. Leydens. “Scoring Rubric Development: Validity and Reliability.” Practical Assessment, Research, and Evaluation 7, no. 10 (2000): 1–6. https://doi.org/10.7275/q7rm-gg74.

Nur, A., Mustakim, M. Yasir, and Z. Fatni. “The Comparison of Nearest Neighbor Algorithm as Modeling in Conclusion of Interpretation of Bil Ma’tsur and Bil Ra’yi.” In 2021 4th International Conference of Computer and Informatics Engineering (IC2IE), 101–5. IEEE, 2021. https://doi.org/10.1109/IC2IE53219.2021.9649246.

O’Connor, C., and H. Joffe. “Intercoder Reliability in Qualitative Research: Debates and Practical Guidelines.” International Journal of Qualitative Methods 19 (2020): 1–13. https://doi.org/10.1177/1609406919899220.

“PBNU Diminta Buat Chat GPT Islami.” Republika, September 21, 2023. https://www.republika.id/posts/45738/pbnu-diminta-buat-chat-gpt-islami.

Qamar, F., S. Latif, and R. Latif. “A Benchmark Dataset with Larger Context for Non-Factoid Question Answering over Islamic Text.” arXiv, 2024. https://doi.org/10.48550/arXiv.2409.09844.

Raja Yusof, R. J., M. A. Norasid, M. Abdullah, N. A. A. Nasaruddin, N. Badrol Hisham, A. A. G. Saged, and A. A. Ramchahi. “Digital al-Qur’an Applications and Artificial Intelligence (AI): An Overview.” QURANICA – International Journal of Quranic Research 17, no. 2 (2025): 646–76. http://mjs.um.edu.my/index.php/quranica/article/view/65011.

Rashkin, H., V. Nikolaev, M. Lamm, L. Aroyo, M. Collins, D. Das, S. Petrov, G. S. Tomar, I. Turc, and D. Reitter. “Measuring Attribution in Natural Language Generation Models.” Computational Linguistics 49, no. 4 (2023): 777–840. https://doi.org/10.1162/coli_a_00486.

Rosenthal, F., trans. The History of al-Ṭabarī, Vol. 1: General Introduction and from the Creation to the Flood. Albany: State University of New York Press, 1989.

Sahimi, M. S., M. H. Abdul Rahim, A. A. Rushihi, A. Kirin, and N. Zakaria. “Preserving the Authenticity of Quranic Exegesis through Artificial Intelligence: A Proposed Framework for Digital Verification.” QURANICA – International Journal of Quranic Research 17, no. 2 (2025): 325–44. http://mjs.um.edu.my/index.php/quranica/article/view/64982.

Sihotang, M. T., I. Jaya, A. Hizriadi, and S. M. Hardi. “Answering Islamic Questions with a Chatbot Using Fuzzy String-Matching Algorithm.” Journal of Physics: Conference Series 1566, no. 1 (2020): 012007. https://doi.org/10.1088/1742-6596/1566/1/012007.

Sun, Y., D. Sheng, Z. Zhou, and Y. Wu. “AI Hallucination: Towards a Comprehensive Classification of Distorted Information in Artificial Intelligence-Generated Content.” Humanities and Social Sciences Communications 11 (2024): 1278. https://doi.org/10.1057/s41599-024-03811-x.

Taylor, C. A Secular Age. Cambridge, MA: The Belknap Press of Harvard University Press, 2007. https://www.hup.harvard.edu/books/9780674026766.

The MQM Council. MQM: The Multidimensional Quality Metrics Framework. Specification. 2023. https://themqm.org/.

Voll, J. O. “Renewal and Reform in Islamic History: Tajdid and Islah.” In Voices of Resurgent Islam, edited by J. L. Esposito, 32–47. New York: Oxford University Press, 1983.

Wei, J., X. Wang, D. Schuurmans, M. Bosma, B. Ichter, F. Xia, E. Chi, Q. Le, and D. Zhou. “Chain-of-Thought Prompting Elicits Reasoning in Large Language Models.” arXiv, 2023. https://doi.org/10.48550/arXiv.2201.11903.

Wijaya, A., A. Z. Abidin, and M. Syaifudin. “State-Sponsored Qur’ānic Exegesis and Interreligious Relations: A Comparative Study of Egypt, Saudi Arabia, and Indonesia.” Ascarya: Journal of Islamic Science, Culture, and Social Studies 5, no. 2 (2025): 280–92. https://doi.org/10.53754/iscs.v5i2.854.

Zainadun, N., M. N. Mohamad Salleh, A. I. Jamil, A. A. Rekan, and M. T. Ajmain @ Jima’ain. “Exploring the Potential of Artificial Intelligence in Enhancing Quranic Teachers’ Pedagogy: A Systematic Literature Review.” QURANICA – International Journal of Quranic Research 17, no. 2 (2025): 501–41. http://mjs.um.edu.my/index.php/quranica/article/view/65001.

Downloads

Published

04-08-2026

Issue

Section

Research Articles (English)

How to Cite

Saifullah, Soleh Hasan Wahid, and Muhammad Ihza Fazrian. “Between Machines and the Tafsīr Tradition: Reorienting Tafsīr Bi Al-Ma’ṡūr in the Age of Computational Interpretation”. Jurnal Studi Ilmu-ilmu Al-Qur’an dan Hadis 27, no. 2 (August 4, 2026): 458–493. Accessed August 21, 2026. https://ejournal.uin-suka.ac.id/ushuluddin/alquran/article/view/7499.