Abstract

Facial expression analysis is an attractive, challenging and important field of study in facial analysis. It's important applications include many areas such as human–computer interaction, human emotion analysis, biometric authentication, exhaustion detection and data-driven animation. For successful facial expression recognition, the first step is to arrive at an appropriate facial representation from original face image which is a crucial step. This paper, empirically evaluate facial representation using statistical features from the Local Binary Patterns, Simplified local binary mean and Mean based weight matrix for person-independent facial expression recognition. Multiclass SVM is applied systematically for classification. The Japanese female database JAFFE is used for the experiment. Extensive experiments shows that statistical features derived from LBP are effective and efficient for facial expression recognition. Further improved and best results are obtained with SLBM and MBWM features extracted using Multiclass Support Vector Machine classifiers.

References

• Y. Tian, T. Kanade, J. Cohn, Handbook of Face Recognition, Springer, 2005 (Chapter 11. Facial Expression Analysis).
• M. Valstar, I. Patras, M. Pantic, Facial action unit detection using probabilistic actively learned support vector machines on tracked facial point data, in: IEEE Conference on Computer Vision and Pattern Recognition Workshop, vol. 3, 2005, pp. 76–84.
• M. Valstar, M. Pantic, Fully automatic facial action unit detection and temporal analysis, in: IEEE Conference on Computer Vision and Pattern Recognition Workshop, 2006, p. 149.
• M. J. Lyons, J. Budynek, S. Akamatsu, Automatic classification of single facial images, IEEE Transactions on Pattern Analysis and Machine Intelligence 21(12) (1999) 1357–1362.
• G. Donato, M. Bartlett, J. Hager, P. Ekman, T. Sejnowski, Classifying facial actions, IEEE Transactions on Pattern Analysis and Machine Intelligence 21(10) (1999) 974–989.
• T. Ojala, M. Pietikäinen, D. Harwood, A comparative study of texture measures with classification based on featured distribution, Pattern Recognition 29 (1) (1996) 51–59.
• T. Ojala, M. Pietikäinen, T. Mäenpää, Multiresolution gray-scale and rotation invariant texture classification with local binary patterns, IEEE Transactions on Pattern Analysis and Machine Intelligence 24 (7) (2002) 971–987.
• Priya, G. N. and R. S. D. W. Banu, 2012. A Simplified Local Binary Mean (SLBM) based human gender classification. Eur. J. Sci. Res. , 71: 435-442.
• Priya, G. N. and R. S. D. W. Banu, 2012. Detection of Occluded Face Image using Mean Based Weight Matrix and Support Vector Machine, J. Computer Sci. , 8 (7): 1184-1190
• T. Ahonen, A. Hadid, M. Pietikäinen, Face recognition with local binary patterns, in: European Conference on Computer Vision (ECCV), 2004.
• A. Hadid, M. Pietikäinen, T. Ahonen, A discriminative feature space for detecting and recognizing faces, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2004.
• X. Feng, A. Hadid, M. Pietikäinen, A coarse-to-fine classification scheme for facial expression recognition, International Conference on Image Analysis and Recognition (ICIAR), Lecture Notes in Computer Science, vol. 3212, Springer, 2004, pp. 668–675.
• Y. Tian, Evaluation of face resolution for expression analysis, in: CVPR Workshop on Face Processing in Video, 2004.
• M. Pantic, L. Rothkrantz, Automatic analysis of facial expressions: the state of art, IEEE Transactions on Pattern Analysis and Machine Intelligence 22 (12)(2000) 1424–1445.
• B. Fasel, J. Luettin, Automatic facial expression analysis: a survey, Pattern Recognition 36 (2003) 259–275.
• M. Suwa, N. Sugie, K. Fujimora, A preliminary note on pattern recognition of human emotional expression, in: International Joint Conference on Pattern Recognition, 1978, pp. 408–410.
• Z. Zhang, M. J. Lyons, M. Schuster, S. Akamatsu, Comparison between geometry-based and Gabor-wavelets-based facial expression recognition using multi-layer perceptron, in: IEEE International Conference on Automatic Face & Gesture Recognition (FG), 1998.
• M. Pantic, I. Patras, Dynamics of facial expression: recognition of facial actions and their temporal segments from face profile image sequences, IEEE Transactions on Systems, Man, and Cybernetics 36 (2) (2006) 433–449.
• Y. Zhang, Q. Ji, Active and dynamic information fusion for facial expression understanding from image sequences, IEEE Transactions on Pattern Analysis and Machine Intelligence 27 (5) (2005) 1–16.
• M. S. Bartlett, G. Littlewort, M. Frank, C. Lainscsek, I. Fasel, J. Movellan, Recognizing facial expression: machine learning and application to spontaneous behavior, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2005.
• C. Shan, S. Gong, P. W. McOwan, Robust facial expression recognition using local binary patterns, in: IEEE International Conference on Image Processing(ICIP), Genoa, vol. 2, 2005, pp. 370–373.
• S. Liao, W. Fan, C. S. Chung, D. -Y. Yeung, Facial expression recognition using advanced local binary patterns, tsallis entropies and global appearance features, in: IEEE International Conference on Image Processing (ICIP), 2006,pp. 665–668.