Adaptive deep learning based on FaceNet convolutional neural network for facial expression recognition
Article Sidebar
Main Article Content
Abstract
Facial recognition technology has become increasingly crucial in various applications, from personal identification, security, and human-care. Facial recognition has numerous practical applications, ranging from assessing mental health and well-being through facial expressions to evaluating customer satisfaction in service quality ratings. This study aims to develop a facial recognition model using a Convolutional Neural Network (CNN) with FaceNet architecture. The proposed method utilizes an advanced deep learning approach to generate high-quality facial embeddings, enhancing the model's ability to accurately identify and verify individuals. Our methodology includes training the CNN with FaceNet architecture, achieving an impressive average accuracy of 99.93%, with precision, recall, and F1-score all reaching 100%. The model demonstrated both high accuracy and efficiency, with an average training time of 13 minutes and 51 seconds. Future research should explore incorporating data augmentation, K-fold cross-validation, and additional transfer learning techniques to further enhance model performance and generalization. These advancements could lead to more resilient and flexible facial recognition systems capable of functioning effectively in diverse and challenging real-world conditions.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
References
K. Sarvakar, R. Senkamalavalli, S. Raghavendra, J. Santosh Kumar, R. Manjunath, and S. Jaiswal, “Facial emotion recognition using convolutional neural networks,” Mater Today Proc, vol. 80, pp. 3560–3564, Jan. 2023, doi: 10.1016/j.matpr.2021.07.297.
P. Adi Nugroho, I. Fenriana, and R. Arijanto, “Implementasi Deep Learning Menggunakan Convolutional Neural Network ( CNN ) Pada Ekspresi Manusia,” JURNAL ALGOR, vol. 2, no. 1, 2020, [Online]. Available: https://jurnal.buddhidharma.ac.id/index.php/algor/index
Y. Wang, Y. Li, Y. Song, and X. Rong, “The influence of the activation function in a convolution neural network model of facial expression recognition,” Applied Sciences (Switzerland), vol. 10, no. 5, Mar. 2020, doi: 10.3390/app10051897.
R. Steven Immanuel Sihombing et al., “Pengenalan Ekspresi Wajah Menggunakan Convolutional Neural Network (CNN),” Journal of Creative Student Research (JCSR), vol. 1, no. 6, pp. 89–97, 2023, doi: 10.55606/jcsrpolitama.v1i6.3046.
S. Cheng and G. Zhou, “Facial Expression Recognition Method Based on Improved VGG Convolutional Neural Network,” Intern J Pattern Recognit Artif Intell, vol. 34, no. 7, Jun. 2020, doi: 10.1142/S0218001420560030.
A. Susanto, C. A. Sari, E. H. Rachmawanto, I. U. W. Mulyono, and N. Mohd Yaacob, “A Comparative Study of Javanese Script Classification with GoogleNet, DenseNet, ResNet, VGG16 and VGG19,” Scientific Journal of Informatics, vol. 11, no. 1, pp. 31–40, Jan. 2024, doi: 10.15294/sji.v11i1.47305.
K. Li, Y. Jin, M. W. Akram, R. Han, and J. Chen, “Facial expression recognition with convolutional neural networks via a new face cropping and rotation strategy,” Vis Comput, vol. 36, no. 2, pp. 391–404, Feb. 2020, doi: 10.1007/s00371-019-01627-4.
N. P. Sutramiani, N. Suciati, and D. Siahaan, “MAT-AGCA: Multi Augmentation Technique on small dataset for Balinese character recognition using Convolutional Neural Network,” ICT Express, vol. 7, no. 4, pp. 521–529, Dec. 2021, doi: 10.1016/j.icte.2021.04.005.
Q. A. Putra, C. A. Sari, E. H. Rachmawanto, N. R. D. Cahyo, E. Mulyanto, and M. A. Alkhafaji, “White Bread Mold Detection using K-Means Clustering Based on Grey Level Co-Occurrence Matrix and Region of Interest,” in 2023 International Seminar on Application for Technology of Information and Communication (iSemantic), 2023, pp. 376–381. doi: 10.1109/iSemantic59612.2023.10295369.
F. J. Moreno-Barea, J. M. Jerez, and L. Franco, “Improving classification accuracy using data augmentation on small data sets,” Expert Syst Appl, vol. 161, p. 113696, 2020.
X. Jiang and Z. Ge, “Data augmentation classifier for imbalanced fault classification,” IEEE Transactions on Automation Science and Engineering, vol. 18, no. 3, pp. 1206–1217, 2020.
E. H. Rachmawanto and P. N. Andono, “Deteksi Karakter Hiragana Menggunakan Metode Convolutional Neural Network,” Jurnal Nasional Pendidikan Teknik Informatika (JANAPATI), vol. 11, no. 3, pp. 183–191, Dec. 2022, doi: 10.23887/janapati.v11i3.50144.
N. R. D. Cahyo, C. A. Sari, E. H. Rachmawanto, C. Jatmoko, R. R. A. Al-Jawry, and M. A. Alkhafaji, “A Comparison of Multi Class Support Vector Machine vs Deep Convolutional Neural Network for Brain Tumor Classification,” in 2023 International Seminar on Application for Technology of Information and Communication (iSemantic), IEEE, Sep. 2023, pp. 358–363. doi: 10.1109/iSemantic59612.2023.10295336.
M. M. I. Al-Ghiffary, C. A. Sari, E. H. Rachmawanto, N. M. Yacoob, N. R. D. Cahyo, and R. R. Ali, “Milkfish Freshness Classification Using Convolutional Neural Networks Based on Resnet50 Architecture,” Advance Sustainable Science Engineering and Technology, vol. 5, no. 3, p. 0230304, Oct. 2023, doi: 10.26877/asset.v5i3.17017.
I. P. Kamila, C. A. Sari, E. H. Rachmawanto, and N. R. D. Cahyo, “A Good Evaluation Based on Confusion Matrix for Lung Diseases Classification using Convolutional Neural Networks,” Advance Sustainable Science, Engineering and Technology, vol. 6, no. 1, p. 0240102, Dec. 2023, doi: 10.26877/asset.v6i1.17330.
A. Ziaee and E. Çano, “Batch Layer Normalization A new normalization layer for CNNs and RNNs,” in ACM International Conference Proceeding Series, Association for Computing Machinery, Oct. 2022, pp. 40–49. doi: 10.1145/3571560.3571566.
Z. A. Sejuti and M. S. Islam, “An Efficient Method to Classify Brain Tumor using CNN and SVM,” in International Conference on Robotics, Electrical and Signal Processing Techniques, 2021, pp. 644–648. doi: 10.1109/ICREST51555.2021.9331060.
E. Z. Astuti, C. A. Sari, M. Syabilla, H. Sutrisno, E. H. Rachmawanto, and M. Doheir, “Capital Optical Character Recognition Using Neural Network Based on Gaussian Filter,” Scientific Journal of Informatics, vol. 10, no. 3, pp. 261–270, Jul. 2023, doi: 10.15294/sji.v10i3.43438.
Y. A. Nisa, C. A. Sari, E. H. Rachmawanto, and N. Mohd Yaacob, “Ambon Banana Maturity Classification Based On Convolutional Neural Network (CNN),” sinkron, vol. 8, no. 4, pp. 2568–2578, Oct. 2023, doi: 10.33395/sinkron.v8i4.12961.
C. Wu and Y. Zhang, “MTCNN and FACENET based access control system for face detection and recognition,” Automatic Control and Computer Sciences, vol. 55, pp. 102–112, 2021.
F. Cahyono, W. Wirawan, and R. F. Rachmadi, “Face recognition system using facenet algorithm for employee presence,” in 2020 4th international conference on vocational education and training (ICOVET), IEEE, 2020, pp. 57–62.
S. Srinivas and M. P. Selvan, “E-CNN-FFE: An Enhanced Convolutional Neural Network for Facial Feature Extraction and Its Comparative Analysis with FaceNet, DeepID, and LBPH Methods,” in International Conference on Data Management, Analytics & Innovation, Springer, 2024, pp. 339–354.
X. Xu, M. Du, H. Guo, J. Chang, and X. Zhao, “Lightweight FaceNet Based on MobileNet,” Int J Intell Sci, vol. 11, no. 01, pp. 1–16, 2021, doi: 10.4236/ijis.2021.111001.
A. Theissler, M. Thomas, M. Burch, and F. Gerschner, “ConfusionVis: Comparative evaluation and selection of multi-class classifiers based on confusion matrices,” Knowl Based Syst, vol. 247, Jul. 2022, doi: 10.1016/j.knosys.2022.108651.
E. Oktayessofa, C. A. Sari, E. H. Rachmawanto, and N. M. Yaacob, “CLASSIFICATION OF ORGANIC AND NON-ORGANIC WASTE WITH CNN-MOBILENET-V2,” Jurnal Teknik Informatika (JUTIF), vol. 5, no. 4, pp. 1173–1180, 2024, doi: 10.52436/1.jutif.2024.5.4.2165.
M. Dolla Meitantya, C. Atika Sari, E. Hari Rachmawanto, and R. Raad Ali, “VGG-16 Architecture on CNN For American Sign Language Classification,” vol. 5, no. 4, pp. 1165–1171, 2160, doi: 10.52436/1.jutif.2024.5.4.2160.
M. Zulhusni, C. A. Sari, and E. H. Rachmawanto, “Implementation of DenseNet121 Architecture for Waste Type Classification,” Advance Sustainable Science Engineering and Technology, vol. 6, no. 3, p. 02403015, Jul. 2024, doi: 10.26877/asset.v6i3.673.
D. Asif, M. Bibi, M. S. Arif, and A. Mukheimer, “Enhancing Heart Disease Prediction through Ensemble Learning Techniques with Hyperparameter Optimization,” Algorithms, vol. 16, no. 6, Jun. 2023, doi: 10.3390/a16060308.
H. K. Ravikiran, J. Jayanth, M. S. Sathisha, and K. Bindu, “Optimizing Sheep Breed Classification with Bat Algorithm-Tuned CNN Hyperparameters,” SN Comput Sci, vol. 5, no. 2, Feb. 2024, doi: 10.1007/s42979-023-02544-z.
N. R. D. Cahyo and M. M. I. Al-Ghiffary, “An Image Processing Study: Image Enhancement, Image Segmentation, and Image Classification using Milkfish Freshness Images,” IJECAR) International Journal of Engineering Computing Advanced Research, vol. 1, no. 1, pp. 11–22, 2024.