Supplementary Files
Keywords
Transfer Learning
Fine Tuning
Wayang
Artificial Intelligence
How to Cite
Abstract
Deep Learning is an essential technique in the classification problem in machine learning based on artificial neural networks. The general issue in deep learning is data-hungry, which require a plethora of data to train some model. Wayang is a shadow puppet art theater from Indonesia, especially in the Javanese culture. It has several indistinguishable characters. In this paper, We tried proposing some steps and techniques on how to classify the characters and handle the issue on a small wayang dataset by using model selection, transfer learning, and fine-tuning to obtain efficient and precise accuracy on our classification problem. The research used 50 images for each class and a total of 24 wayang characters classes. We collected and implemented various architectures from the initial version of deep learning to the latest proposed model and their state-of-art. The transfer learning and fine-tuning method showed a significant increase in accuracy, validation accuracy. By using Transfer Learning, it was possible to design the deep learning model with good classifiers within a short number of times on a small dataset. It performed 100% on their training on both EfficientNetB0 and MobileNetV3-small. On validation accuracy, gave 98.33% and 98.75%, respectively.References
A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet Classification with Deep Convolutional Neural Networks," 2012.
K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition," in 3rd International Conference on Learning Representations, ICLR 2015 - Conference Track Proceedings, 2015.
C. Szegedy et al., "Going deeper with convolutions," in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2015, vol. 07-12-June, pp. 1–9.
K. He, X. Zhang, S. Ren, and J. Sun, "Deep residual learning for image recognition," in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2016, vol. 2016-Decem, pp. 770–778.
C. Szegedy, S. Ioffe, V. Vanhoucke, and A. A. Alemi, "Inception-v4, inception-ResNet and the impact of residual connections on learning," in 31st AAAI Conference on Artificial Intelligence, AAAI 2017, 2017, pp. 4278–4284.
F. Chollet, "Xception: Deep learning with depthwise separable convolutions," in Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, 2017, vol. 2017-Janua, pp. 1800–1807.
G. Huang, Z. Liu, L. Van Der Maaten, and K. Q. Weinberger, "Densely connected convolutional networks," in Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, 2017, vol. 2017-Janua, pp. 2261–2269.
B. Zoph, V. Vasudevan, J. Shlens, and Q. V. Le, "Learning Transferable Architectures for Scalable Image Recognition," in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2018, pp. 8697–8710.
A. G. Howard et al., "MobileNets: Efficient convolutional neural networks for mobile vision applications," arXiv. 2017.
M. Sandler, A. Howard, M. Zhu, A. Zhmoginov, and L. C. Chen, "MobileNetV2: Inverted Residuals and Linear Bottlenecks," in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2018, pp. 4510–4520.
A. Howard et al., "Searching for mobileNetV3," in Proceedings of the IEEE International Conference on Computer Vision, 2019, vol. 2019-Octob, pp. 1314–1324.
M. Tan and Q. V Le, "EfficientNet: Rethinking model scaling for convolutional neural networks," in 36th International Conference on Machine Learning, ICML 2019, 2019, vol. 2019-June, pp. 10691–10700.
X. W. Chen and X. Lin, "Big data deep learning: Challenges and perspectives," IEEE Access, vol. 2. Institute of Electrical and Electronics Engineers Inc., pp. 514–525, 2014.
M. M. Najafabadi, F. Villanustre, T. M. Khoshgoftaar, N. Seliya, R. Wald, and E. Muharemagic, "Deep learning applications and challenges in big data analytics," J. Big Data, vol. 2, no. 1, p. 1, Dec. 2015.
S. Dargan, M. Kumar, M. R. Ayyagari, and G. Kumar, "A Survey of Deep Learning and Its Applications: A New Paradigm to Machine Learning," Arch. Comput. Methods Eng., vol. 27, no. 4, pp. 1071–1092, Sep. 2020.
D. Sulaksono and K. Saddhono, "Ecological Concept of Wayang Stories and the Relation with Natural Conservation in Javanese Society," KnE Soc. Sci., vol. 3, no. 9, p. 58, Jul. 2018.
R. Long, "The movement system in Javanese wayang kulit in relation to puppet character type: a study of Ngayogyakarta shadow theatre," University of Hawai’i, Ann Arbor, 1979.
T. P. Tomo, A. Schmitz, G. Enriquez, S. Hashimoto, and S. Sugano, "Wayang Robot with Gamelan Music Pattern Recognition," J. Robot. Mechatronics, vol. 29, no. 1, pp. 137–145, Feb. 2017.
T. P. Tomo, G. Enriquez, and S. Hashimoto, "Indonesian puppet theater robot with gamelan music emotion recognition," in 2015 IEEE International Conference on Robotics and Biomimetics, IEEE-ROBIO 2015, 2015, pp. 1177–1182.
K. Wisnudhanti and F. Candra, "Image Classification of Pandawa Figures Using Convolutional Neural Network on Raspberry Pi 4," in Journal of Physics: Conference Series, 2020, vol. 1655, no. 1, p. 12103.
M. Hamdani Santoso and D. Ayu Larasati, "Wayang Image Classification using MLP Method and GLCM Feature Extraction Corresponding Author," J. Comput. Sci. Inf. Technol. Telecommun. Eng., vol. 1, no. 2, pp. 111–119, Sep. 2020.
C. Tan, F. Sun, T. Kong, W. Zhang, C. Yang, and C. Liu, "A survey on deep transfer learning," in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2018, vol. 11141 LNCS, pp. 270–279.
W. Ge and Y. Yu, "Borrowing Treasures from the Wealthy: Deep Transfer Learning through Selective Joint Fine-Tuning," 2017.
E. C. Too, L. Yujian, S. Njuki, and L. Yingchun, "A comparative study of fine-tuning deep learning models for plant disease identification," Comput. Electron. Agric., vol. 161, pp. 272–279, Jun. 2019.
H. W. Ng, V. D. Nguyen, V. Vonikakis, and S. Winkler, "Deep learning for emotion recognition on small datasets using transfer learning," in ICMI 2015 - Proceedings of the 2015 ACM International Conference on Multimodal Interaction, 2015, pp. 443–449.
M. Peng, Z. Wu, Z. Zhang, and T. Chen, "From macro to micro expression recognition: Deep learning on small datasets using transfer learning," in Proceedings - 13th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2018, 2018, pp. 657–661.
P. Cao, S. Zhang, and J. Tang, "Preprocessing-Free Gear Fault Diagnosis Using Small Datasets with Deep Convolutional Neural Network-Based Transfer Learning," IEEE Access, vol. 6, pp. 26241–26253, May 2018.
M. Shu, "Deep learning for image classification on very small datasets using transfer learning," Creat. Components, Jan. 2019.
T. H. Haryadi and Khamadi, "Perancangan Model Wujud Visual Tokoh Pewayangan dalam Pembentukan Identitas dan Watak Tokoh sebagai Acuan Desain Karakter dalam Karya DKV," DeKaVe, vol. 7, no. 2, pp. 58–79, Jul. 2015.
S. Tukul and A. I. Darodjat, Koleksi wayang kulit Museum Basoeki Abdullah. Departemen Kebudayaan dan Pariwisata, Direktorat Jenderal Sejarah dan Purbakala, Museum Basoeki Abdullah, 2008.
Y. Bengio, D.-H. Lee, J. Bornschein, T. Mesnard, and Z. Lin, "Towards Biologically Plausible Deep Learning," Feb. 2015.
Y. Lecun, Y. Bengio, and G. Hinton, "Deep learning," Nature, vol. 521, no. 7553, pp. 436–444, 2015.
O. Russakovsky et al., "ImageNet Large Scale Visual Recognition Challenge," Int. J. Comput. Vis., vol. 115, no. 3, pp. 211–252, 2015.
D. P. Kingma and J. L. Ba, "Adam: A method for stochastic optimization," in 3rd International Conference on Learning Representations, ICLR 2015 - Conference Track Proceedings, 2015.
R. R. Selvaraju, M. Cogswell, A. Das, R. Vedantam, D. Parikh, and D. Batra, "Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization," Int. J. Comput. Vis., vol. 128, no. 2, pp. 336–359, Feb. 2020.
IJID (International Journal on Informatics for Development) is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License