Abstract

Recognition of facial expressions is one of the most powerful and challenging tasks in Non-verbal communication. Normally major part of communication involves verbal Channels. But Non-verbal gestures are majorly expressed through facial expressions. Our project is based on classification of various human expressions using various types of Face Expression Recognition (FER) techniques which include the three major stages such as preprocessing, feature extraction and classification. We have carried out all these techniques using Convolutional Neural Networks (CNN). Our project is inspired by VGG and Xception model. Datasets used are FER 2013 (for emotion classification), IMDB (for gender classification), FEC (Google facial expression comparison). Using CNN, we classify 7 different expressions like Happy, Sad, Anger, Disgust, Fear, Surprise and Neutral.

References

• Z. Xie, Y. Li, X. Wang, W. Cai, J. Rao and Z. Liu, "Convolutional Neural Networks for Facial Expression Recognition with Few Training Samples," 2018 37th Chinese Control Conference (CCC), Wuhan, 2018, pp. 9540-9544, doi: 10.23919/ChiCC.2018.8483159.
• K. Liu, C. Hsu, W. Wang and H. Chiang, "Real-Time Facial Expression Recognition Based on CNN," 2019 International Conference on System Science and Engineering (ICSSE), Dong Hoi, Vietnam, 2019, pp. 120-123, doi: 10.1109/ICSSE.2019.8823409.
• Shengtao, Gu & Chao, Xu & Bo, Feng. (2019). Facial expression recognition based on global and local feature fusion with CNNs. 1-5. 10.1109/ICSPCC46631.2019.8960765.
• Zhang, Hongli & Jolfaei, Alireza & Alazab, Mamoun. (2019). A Face Emotion Recognition Method Using Convolutional Neural Network and Image Edge Computing. IEEE Access. PP. 1-1. 10.1109/ACCESS.2019.2949741.
• Bashyal, S., Venayagamoorthy, G.K.V., 2008. Recognition of facial expressions using Gabor wavelets and learning vector quantization. Eng. Appl. Artifi Intelli 21, 1056—1064.
• Proc. 17th ACM Int. Conl Multimed. pp. 569-572. Chang, H.T.Y., 2017. Facial expression recognition using a combination of multiple facial features and support vector machine. Soft Comput. 22, 4389-4405. https://doi.org/l().100%00500-017-2634-3.
• S. Singh and F. Nasoz, "Facial Expression Recognition with Convolutional Neural Networks," 2020 10th Annual Computing and Communication Workshop and Conference (CCWC), Las Vegas, NV, USA, 2020, pp. 0324-0328, doi: 10.1109/CCWC47524.2020.9031283.
• Yamashita, R., Nishio, M., Do, R.K.G. et al. Convolutional neural networks: an overview and application in radiology. Insights Imaging 9, 611–629 (2018). https://doi.org/10.1007/s13244-018-0639-9.
• Nwankpa, Chigozie & Ijomah, Winifred & Gachagan, Anthony & Marshall, Stephen. (2020). Activation Functions: Comparison of trends in Practice and Research for Deep Learning.
• P. Viola and M. Jones, “Rapid object detection using a boosted cascade of simple features,” in null. IEEE, 2001, pp. 511.
• R. C. Gonzalez, “Digital image processing/richarde,” Woods. Interscience, NY, 2001.
• M. Grundland and N. A. Dodgson, “Decolorize: Fast, contrast enhancing, color to grayscale conversion,” Pattern Recognition, vol. 40, no. 11, pp. 2891–2896, 2007.
• Srikanth Tammina (2019); Transfer learning using VGG-16 with Deep Convolutional Neural Network for Classifying Images; International Journal of Scientific and Research Publications (IJSRP) 9(10) (ISSN: 2250-3153), DOI: http://dx.doi.org/10.29322/IJSRP.9.10.2019.p942.
• Chollet, Francois. (2017). Xception: Deep Learning with Depthwise Separable Convolutions. 1800-1807. 10.1109/CVPR.2017.195.