Keywords
diabetes_prediction
disease_detection
feature_selection
prediction_accuracy
How to Cite
Abstract
Diabetes affects about 1.9% of the global population, mainly through Type 2 diabetes. Machine learning (ML) serves a pivotal role in enhancing diabetes prediction by analyzing complex datasets. Feature selection, a crucial ML pre-processing step, improved prediction accuracy by identifying relevant data and discarding irrelevant features. This study investigates the combination of metaheuristic algorithms and ML techniques to enhance diabetes prediction accuracy and computational efficiency. Utilizing the PIMA, Early Stage, and Vanderbilt datasets, experiments evaluated ten algorithm-model combinations based on metrics like accuracy, precision, the Wilcoxon test, and convergence curves. Key findings included that Firefly Algorithm-Logistic Regression, Bat Algorithm-Logistic Regression, and Cuckoo Search-Logistic Regression achieved 74.72% accuracy on PIMA; Firefly Algorithm-Support Vector Machine and Cuckoo Search-Naïve Bayes achieved 83.39% accuracy and 96.15% precision on Early Stage; and Firefly Algorithm-Naïve Bayes achieved 92.88% accuracy and precision on Vanderbilt. These results highlighted the potential of integrating metaheuristics with ML methods to improve clinical diagnostics. Future research is recommended to validate algorithm robustness across diverse datasets to further optimize diabetes prediction strategies.
References
[1] L. Rydén, G. Ferrannini, and E. Standl, “Risk prediction in patients with diabetes: is SCORE 2D the perfect solution?,” Eur. Heart J., vol. 44, no. 28, pp. 2557–2559, Jul. 2023, doi: 10.1093/eurheartj/ehad263.
[2] A. Ahdiat, “Indonesia Punya Penderita Diabetes Tipe 1 Terbanyak di ASEAN.” Accessed: Jul. 05, 2024. [Online]. Available: https://databoks.katadata.co.id/layanan-konsumen-kesehatan/statistik/a822f3958a20761/indonesia-punya-penderita-diabetes-tipe-1-terbanyak-di-asean
[3] McKinsey, “Technology Trends Outlook 2023,” McKinsey Digital, no. July, p. 5, 2023.
[4] P. Solanki, D. Baldaniya, D. Jogani, B. Chaudhary, M. Shah, and A. Kshirsagar, “Artificial intelligence: New age of transformation in petroleum upstream,” Petroleum Research, vol. 7, no. 1, pp. 106–114, 2022, doi: https://doi.org/10.1016/j.ptlrs.2021.07.002.
[5] R. Liu, Y. Rong, and Z. Peng, “A review of medical artificial intelligence,” Global Health Journal, vol. 4, no. 2, pp. 42–45, 2020, doi: https://doi.org/10.1016/j.glohj.2020.04.002.
[6] R. B. Lukmanto, Suharjito, A. Nugroho, and H. Akbar, “Early Detection of Diabetes Mellitus using Feature Selection and Fuzzy Support Vector Machine,” Procedia Comput. Sci., vol. 157, pp. 46–54, 2019, doi: https://doi.org/10.1016/j.procs.2019.08.140.
[7] A. Roihan, P. A. Sunarya, and A. S. Rafika, “Pemanfaatan Machine Learning dalam Berbagai Bidang: Review Paper,” Jurnal Khatulistiwa Informatika, vol. 5, no. 1, 2020, doi: 10.31294/ijcit.v5i1.7951.
[8] S. S. Hameed, O. O. Petinrin, A. O. Hashi, and F. Saeed, “Filter-wrapper combination and embedded feature selection for gene expression data,” International Journal of Advances in Soft Computing and its Applications, vol. 10, no. 1, pp. 90–105, 2018.
[9] F. Navazi, Y. Yuan, and N. Archer, “An examination of the hybrid meta-heuristic machine learning algorithms for early diagnosis of type II diabetes using big data feature selection,” Healthcare Analytics, vol. 4, Dec. 2023, doi: 10.1016/j.health.2023.100227.
[10] C. Bielza and P. Larranaga, Data-Driven Computational Neuroscience: Machine Learning and Statistical Models. 2020. doi: 10.1017/9781108642989.
[11] P. Agrawal, H. F. Abutarboush, T. Ganesh, and A. W. Mohamed, “Metaheuristic algorithms on feature selection: A survey of one decade of research (2009-2019),” IEEE Access, vol. 9, pp. 26766–26791, 2021, doi: 10.1109/ACCESS.2021.3056407.
[12] T. M. Le, T. M. Vo, T. N. Pham, and S. V. T. Dao, “A Novel Wrapper-Based Feature Selection for Early Diabetes Prediction Enhanced with a Metaheuristic,” IEEE Access, vol. 9, pp. 7869–7884, 2021, doi: 10.1109/ACCESS.2020.3047942.
[13] H. D. Prasetyo, P. A. Hogantara, and I. N. Isnainiyah, “A Web-Based Diabetes Prediction Application Using XGBoost Algorithm,” Data Science: Journal of Computing and Applied Informatics, vol. 5, no. 2, pp. 49–59, 2021, doi: 10.32734/jocai.v5.i2-6290.
[14] L. W. Astuti, I. Saluza, E. Yulianti, and D. Dhamayanti, “Feature Selection Menggunakan Binary Wheal Optimizaton Algorithm (BWOA) pada Klasifikasi Penyakit Diabetes,” Jurnal Ilmiah Informatika Global, vol. 13, no. 1, Mar. 2022, doi: 10.36982/jiig.v13i1.2057.
[15] S. S. G. and M. K., “Diagnosis of diabetes diseases using optimized fuzzy rule set by grey wolf optimization,” Pattern Recognit. Lett., vol. 125, pp. 432–438, 2019, doi: https://doi.org/10.1016/j.patrec.2019.06.005.
[16] U. M. Learning and K. T. Bot, “Pima Indians Diabetes Database.” Accessed: Apr. 25, 2024. [Online]. Available: https://www.kaggle.com/datasets/uciml/pima-indians-diabetes-database
[17] U. I. M. L. Repository, “Early Stage Diabetes Risk Prediction.” Accessed: Apr. 25, 2024. [Online]. Available: https://archive.ics.uci.edu/dataset/529/early+stage+diabetes+risk+prediction+dataset
[18] R. Hoyt, “Type 2 Diabetes.” Accessed: Apr. 25, 2024. [Online]. Available: https://doi.org/10.6084/m9.figshare.8011535
[19] O. Tarkhaneh, T. T. Nguyen, and S. Mazaheri, “A novel wrapper-based feature subset selection method using modified binary differential evolution algorithm,” Inf. Sci. (N. Y)., vol. 565, pp. 278–305, Jul. 2021, doi: 10.1016/j.ins.2021.02.061.
[20] N. Bacanin, K. Venkatachalam, T. Bezdan, M. Zivkovic, and M. Abouhawwash, “A novel firefly algorithm approach for efficient feature selection with COVID-19 dataset,” Microprocess. Microsyst., vol. 98, Apr. 2023, doi: 10.1016/j.micpro.2023.104778.
[21] Y. Ramadhani, A. Mubarok, S. Hidayatullah, and W. Wiguna, “Attribute Optimization: Genetic Algorithms and Neural Network for Voice Analysis Classification of Parkinson’s Disease,” no. Icri 2018, pp. 3074–3079, 2020, doi: 10.5220/0009947030743079.
[22] F. Jia, S. Luo, G. Yin, and Y. Ye, “A Novel Variant of the Salp Swarm Algorithm for Engineering Optimization,” Journal of Artificial Intelligence and Soft Computing Research, vol. 13, no. 3, pp. 131–149, Jun. 2023, doi: 10.2478/jaiscr-2023-0011.
[23] H. Das, B. Naik, and H. S. Behera, “A Jaya algorithm based wrapper method for optimal feature selection in supervised classification,” Journal of King Saud University - Computer and Information Sciences, vol. 34, no. 6, pp. 3851–3863, Jun. 2022, doi: 10.1016/j.jksuci.2020.05.002.
[24] Y. Ramadhani, A. Mubarok, S. Hidayatullah, and W. Wiguna, “Attribute Optimization: Genetic Algorithms and Neural Network for Voice Analysis Classification of Parkinson’s Disease,” Scitepress, Aug. 2020, pp. 3074–3079. doi: 10.5220/0009947030743079.
[25] J. Kennedy and R. Eberhart, “Particle swarm optimization,” in Proceedings of ICNN’95 - International Conference on Neural Networks, 1995, pp. 1942–1948 vol.4. doi: 10.1109/ICNN.1995.488968.
[26] J. Too, A. R. Abdullah, and N. Mohd Saad, “Hybrid Binary Particle Swarm Optimization Differential Evolution-Based Feature Selection for EMG Signals Classification,” 2019. doi: 10.3390/axioms8030079.
[27] R. B. Mohamed, M. M. Yusof, N. Wahid, N. Murli, and M. Othman, “Bat algorithm and k-means techniques for classification performance improvement,” Indonesian Journal of Electrical Engineering and Computer Science, vol. 15, no. 3, pp. 1411–1418, Sep. 2019, doi: 10.11591/ijeecs.v15.i3.pp1411-1418.
[28] M. Alzaqebah et al., “Memory based cuckoo search algorithm for feature selection of gene expression dataset,” Inform. Med. Unlocked, vol. 24, Jan. 2021, doi: 10.1016/j.imu.2021.100572.
[29] Q. Al-Tashi, H. Md Rais, S. J. Abdulkadir, S. Mirjalili, and H. Alhussian, “A Review of Grey Wolf Optimizer-Based Feature Selection Methods for Classification,” in Evolutionary Machine Learning Techniques, 2020, pp. 273–286. doi: 10.1007/978-981-32-9990-0_13.
[30] M. Bansal, A. Goyal, and A. Choudhary, “A comparative analysis of K-Nearest Neighbor, Genetic, Support Vector Machine, Decision Tree, and Long Short Term Memory algorithms in machine learning,” Decision Analytics Journal, vol. 3, p. 100071, Jun. 2022, doi: 10.1016/j.dajour.2022.100071.
[31] Y. Ramdhani, D. F. Apra, and D. P. Alamsyah, “Feature selection optimization based on genetic algorithm for support vector classification varieties of raisin,” Indonesian Journal of Electrical Engineering and Computer Science, vol. 30, no. 1, p. 192, Apr. 2023, doi: 10.11591/ijeecs.v30.i1.pp192-199.
[32] R. Patil, S. Tamane, S. A. Rawandale, and K. Patil, “A modified mayfly-SVM approach for early detection of type 2 diabetes mellitus,” International Journal of Electrical and Computer Engineering, vol. 12, no. 1, pp. 524–533, Feb. 2022, doi: 10.11591/ijece.v12i1.pp524-533.
[33] M. Vishwakarma and N. Kesswani, “A new two-phase intrusion detection system with Naïve Bayes machine learning for data classification and elliptic envelop method for anomaly detection,” Decision Analytics Journal, vol. 7, p. 100233, 2023, doi: https://doi.org/10.1016/j.dajour.2023.100233.
[34] I. Lishania, R. Goejantoro, and Y. N. Nasution, “Perbandingan Klasifikasi Metode Naive Bayes dan Metode Decision Tree Algoritma (J48) pada Pasien Penderita Penyakit Stroke di RSUD Abdul Wahab Sjahranie Samarinda,” Eksponensial, vol. 10, no. 2, pp. 135–142, 2020.
[35] J. Daniel and J. H. Martin, “Logistic Regression,” in Speech and Language Processing, vol. 1, California: Stanford University, 2024, ch. 5, pp. 1–25. Accessed: Jul. 13, 2024. [Online]. Available: https://web.stanford.edu/~jurafsky/slp3/5.pdf
[36] D. Westari, “Performa Comparison of the K-Means Method for Classification in Diabetes Patients Using Two Normalization Methods,” International Journal of Multidisciplinary Research and Analysis, vol. 04, no. 01, pp. 18–23, 2021, doi: 10.47191/ijmra/v4-i1-03.
[37] I. M. Karo-karo and Hendriyana, “Klasifikasi Penderita Diabetes Menggunakan Algoritma Machine Learning dan Z-SCORE,” Jurnal Teknologi Terpadu, vol. 8, no. 2, pp. 94–99, 2022, doi: https://doi.org/10.54914/jtt.v8i2.564.
[38] M. R. Belgaum et al., “Enhancing the Efficiency of Diabetes Prediction through Training and Classification using PCA and LR Model,” Annals of Emerging Technologies in Computing, vol. 7, no. 3, pp. 78–91, 2023, doi: 10.33166/AETiC.2023.03.004.
[39] V. Diranisha, Agung Triayudi, and Ratih Titi Komalasari, “Implementation of K-Nearest Neighbour (KNN) Algorithm and Random Forest Algorithm in Identifying Diabetes,” SAGA: Journal of Technology and Information System, vol. 2, no. 2, pp. 234–244, 2024, doi: 10.58905/saga.v2i2.253.
[40] N. Nipa, M. H. Riyad, S. Satu, Walliullah, K. C. Howlader, and M. A. Moni, “Clinically adaptable machine learning model to identify early appreciable features of diabetes,” Intelligent Medicine, vol. 4, no. 1, pp. 22–32, Feb. 2024, doi: 10.1016/j.imed.2023.01.003.
[41] S. Wei, X. Zhao, and C. Miao, “A comprehensive exploration to the machine learning techniques for diabetes identification,” in 2018 IEEE 4th World Forum on Internet of Things (WF-IoT), 2018, pp. 291–295. doi: 10.1109/WF-IoT.2018.8355130.
[42] R. D. Joshi and C. K. Dhakal, “Predicting type 2 diabetes using logistic regression and machine learning approaches,” Int. J. Environ. Res. Public Health, vol. 18, no. 14, Jul. 2021, doi: 10.3390/ijerph18147346.
[43] D. Sanghavi, D. Sanghavi, and N. Patil, “Early-Stage Diabetes mellitus Risk Prediction And Symptom Association: A Comparative Analysis Using Feature Importance,” Educational Administration Theory and Practices, vol. 30, no. 1, pp. 2997–3006, 2024, doi: 10.53555/kuey.v30i1.6939.
[44] P. Zhang, C. Fonnesbeck, D. C. Schmidt, J. White, S. Kleinberg, and S. A. Mulvaney, “Understanding Barriers to Self-Management Using Machine Learning and Momentary Assessment in Youth with Diabetes: An Observational Study,” JMIR Mhealth Uhealth, vol. 10, no. 3, 2020, doi: 10.2196/21959.
[45] P. Rajendra and S. Latifi, “Prediction of diabetes using logistic regression and ensemble techniques,” Computer Methods and Programs in Biomedicine Update, vol. 1, Jan. 2021, doi: 10.1016/j.cmpbup.2021.100032.
[46] S. Gill and P. Pathwar, “Prediction of Diabetes Using Various Feature Selection and Machine Learning Paradigms,” in Modern Approaches in Machine Learning & Cognitive Science: A Walkthrough, V. K. Gunjan and J. M. Zurada, Eds., Cham: Springer International Publishing, 2022, pp. 133–146. doi: 10.1007/978-3-030-96634-8_12.
[47] K. Verma and P. Harshavardhanan, “Type-2 Diabetes Prediction using Machine Learning Algorithms and Ensembles with Hyperparameters,” JScholar Publishers J Metab Disord Diabetes, vol. 2, p. 105, 2024, [Online]. Available: http://creativecommons.org/licenses/by/3.0/,whichper-mitsunrestricteduse,providedtheoriginalauthorandsourcearecredited.
[48] G. T. Reddy and N. Khare, “Hybrid Firefly-Bat optimized fuzzy artificial neural network based classifier for diabetes diagnosis,” International Journal of Intelligent Engineering and Systems, vol. 10, no. 4, pp. 18–27, Aug. 2017, doi: 10.22266/ijies2017.0831.03.
[49] N. Hartono, “Multi-Objective Bees Algorithm for Feature Selection,” in The 1st International Conference on Emerging Issues in Technology, Engineering and Science (ICE-TES 2021), Bandung, 2022, pp. 358–369. doi: 10.5220/0010754200003113.
[50] N. Hartono, “Multi-Objective Bees Algorithm for Feature Selection,” Scitepress, Dec. 2022, pp. 358–369. doi: 10.5220/0010754200003113.
[51] L. W. Astuti, I. Saluza, E. Yulianti, and D. Dhamayanti, “Feature Selection Menggunakan Binary Wheal Optimizaton Algorithm (BWOA) pada Klasifikasi Penyakit Diabetes,” Jurnal Ilmiah Informatika Global, vol. 13, no. 1, Mar. 2022, doi: 10.36982/jiig.v13i1.2057.
[52] S. Hassan, T. Akter, F. Tasnim, and M. K. Newaz, “Machine Learning Models to Identify Discriminatory Factors of Diabetes Subtypes,” in Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, Springer Science and Business Media Deutschland GmbH, 2023, pp. 55–67. doi: 10.1007/978-3-031-34622-4_5.
[53] R. P. Bhatta, “Comparative Study of Diabetes Prediction using Machine Learning Approaches,” NPRC Journal of Multidisciplinary Research, vol. 2, no. 14, pp. 1–15, 2025, doi: 10.3126/nprcjmr.v2i14.86923.
[54] V. Vakil, S. Pachchigar, C. Chavda, and S. Soni, “Explainable predictions of different machine learning algorithms used to predict Early Stage diabetes,” no. Ml, 2021, [Online]. Available: http://arxiv.org/abs/2111.09939
[55] P. Rajendra and S. Latifi, “Prediction of diabetes using logistic regression and ensemble techniques,” Computer Methods and Programs in Biomedicine Update, vol. 1, Jan. 2021, doi: 10.1016/j.cmpbup.2021.100032.
[56] S. Balasubramanian, R. Kashyap, S. Teja Cvn, and M. Anuradha, Hybrid Prediction Model For Type-2 Diabetes With Class Imbalance. 2020. doi: 10.1109/ICMLANT50963.2020.9355975.
[57] Edgar Ceh-Varela, L. Maes, and Sarbagya Ratna Shakya, “Machine Learning Analysis of Factors Contributing to Diabetes Development,” Cloud Computing and Data Science, vol. 5, no. 1, pp. 157–182, 2024, doi: 10.37256/ccds.5120243751.
[58] M. M. Mijwil and M. Aljanabi, “A Comparative Analysis of Machine Learning Algorithms for Classification of Diabetes Utilizing Confusion Matrix Analysis,” Baghdad Science Journal, vol. 21, no. 5, pp. 1712–1728, 2024, doi: 10.21123/BSJ.2023.9010.
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.