Improving the Accuracy of Human Emotion Recognition through CNN Layering Architecture

Authors

DOI:

https://doi.org/10.23918/eajse.v9i3p18

Keywords:

Supervised Data, Deep Learning, CK+48, Fer2013, JAFFE, Recognition of Facial Expression

Abstract

In accordance with the proverb "a picture is worth a thousand words," facial expressions have the ability to convey a wide range of emotions depending on the circumstances. Observing facial expressions during face-to-face interactions allows us to infer the thoughts and feelings of others. Therefore, the development of facial expression recognition systems holds great significance in the field of artificial intelligence. Recognizing facial expressions involves several fundamental stages. Firstly, the images used in the system undergo pre-processing. Following this, important features are collected and extracted from the dataset images. Finally, the resulting expressions from the images are classified using prediction techniques. This study employed convolutional neural networks (CNNs), a well-established image processing method with a layered architecture, to develop an efficient model for accurately recognizing facial expressions with optimal accuracy. To thoroughly analyze the proposed model, the following datasets were utilized: Facial Expression Recognition 2013 (FER2013), Extended Cohn-Kanade (CK+), and Japanese Female Facial Expressions (JAFFE). These datasets consist of supervised data and cover seven different emotions: neutral, happy, angry, sad, fear, disgust, and surprise. The findings demonstrate that the suggested technique consistently outperforms contemporary methods across all of the aforementioned datasets, achieving notable improvements in accuracy.

References

[1] S. Begaj, A. O. Topal, and M. Ali, "Emotion Recognition Based on Facial Expressions Using

Convolutional Neural Network (CNN)," in 2020 International Conference on Computing,

Networking, Telecommunications & Engineering Sciences Applications (CoNTESA), 2020, pp.

58-63. https://ieeexplore.ieee.org/document/9302866 .

[2] W. Mellouk and W. Handouzi, "Facial emotion recognition using deep learning: review and

insights," Procedia Computer Science, vol. 175, pp. 689-694, 2020.

https://doi.org/10.1016/j.procs.2020.07.101.

[3] L. Liu, "Human face expression recognition based on deep learning-deep convolutional neural

network," in 2019 International Conference on Smart Grid and Electrical Automation

(ICSGEA), 2019, pp. 221-224. https://ieeexplore.ieee.org/document/8901324 .

[4] L. Sun, C. Ge, and Y. Zhong, "Design and implementation of face emotion recognition system

based on CNN Mini_Xception frameworks," in Journal of Physics: Conference Series, 2021,

p. 012123. https://iopscience.iop.org/article/10.1088/1742-6596/2010/1/012123.

[5] A. Fathallah, L. Abdi, and A. Douik, "Facial expression recognition via deep learning," in 2017

IEEE/ACS 14th International Conference on Computer Systems and Applications (AICCSA),

2017, pp. 745-750. https://ieeexplore.ieee.org/document/8308363.

[6] S. Liu, D. Li, Q. Gao, and Y. Song, "Facial emotion recognition based on cnn," in 2020

Chinese Automation Congress (CAC), 2020, pp. 398-403.

https://ieeexplore.ieee.org/document/9327432 .

[7] A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep

convolutional neural networks," Communications of the ACM, vol. 60, pp. 84-90, 2017.

https://doi.org/10.1145/3065386.

[8] N. Y. Abdullah and A. M. F. Alkababji, "Masked face with facial expression recognition based

on deep learning," Indonesian Journal of Electrical Engineering and Computer Science, vol.

27, pp. 149-155, 2022. DOI: http://doi.org/10.11591/ijeecs.v27.i1.pp149-155.

[9] T. K. Arora, P. K. Chaubey, M. S. Raman, B. Kumar, Y. Nagesh, P. Anjani, et al., "Optimal

facial feature based emotional recognition using deep learning algorithm," Computational

Intelligence and Neuroscience: CIN, vol. 2022, 2022. https://doi.org/10.1155/2022/8379202.

[10] A. T. Lopes, E. De Aguiar, A. F. De Souza, and T. Oliveira-Santos, "Facial expression

recognition with convolutional neural networks: coping with few data and the training sample

order," Pattern recognition, vol. 61, pp. 610-628, 2017.

https://doi.org/10.1016/j.patcog.2016.07.026.

[11] J.-H. Kim, B.-G. Kim, P. P. Roy, and D.-M. Jeong, "Efficient facial expression recognition

algorithm based on hierarchical deep neural network structure," IEEE access, vol. 7, pp.

41273-41285, 2019. https://ieeexplore.ieee.org/document/8673885 .

[12] Z. Z. M. Li, "Research on Facial Expression Recognition Based on Neural Network,"

presented at the International Conference on Computer Network, Electronic and Automation

(ICCNEA), Xi'an, China, 2020. https://ieeexplore.ieee.org/document/9239777 .

[13] B. Adil, K. M. Nadjib, and L. Yacine, "A novel approach for facial expression recognition," in

2019 International Conference on Networking and Advanced Systems (ICNAS), 2019, pp. 1-5.

https://ieeexplore.ieee.org/document/8807883 .

[14] S. F. Cotter, "MobiExpressNet: A deep learning network for face expression recognition on

smart phones," in 2020 IEEE International Conference on Consumer Electronics (ICCE),

2020, pp. 1-4. https://ieeexplore.ieee.org/document/9042973.

[15] R. Ravi and S. Yadhukrishna, "A face expression recognition using CNN & LBP," in 2020

fourth international conference on computing methodologies and communication (ICCMC),

2020, pp. 684-689. https://ieeexplore.ieee.org/document/9076422.

[16] H. Huo, Y. Yu, and Z. Liu, "Facial expression recognition based on improved depthwise

separable convolutional network," Multimedia Tools and Applications, pp. 1-18, 2022. DOI:

https://doi.org/10.1007/s11042-022-14066-6.

[17] F. Y. Zhou Yue, Zeng Shangyou, Pan Bing, "Facial Expression Recognition Based on

Convolutional Neural Network," presented at the 10th International Conference on Software

Engineering and Service Science (ICSESS), Beijing, China, 2019.

https://ieeexplore.ieee.org/document/9040730 .

Downloads

Published

2024-03-26

Issue

Section

Articles

How to Cite

Kak , S. F. (2024). Improving the Accuracy of Human Emotion Recognition through CNN Layering Architecture. EURASIAN JOURNAL OF SCIENCE AND ENGINEERING, 9(3), 209-219. https://doi.org/10.23918/eajse.v9i3p18

Similar Articles

1-10 of 134

You may also start an advanced similarity search for this article.