Abstract

Hand gestures can play a notable role in computer vision, and hand gesture-based methods can stand out in providing a native way of interaction. Deafness is a degree of loss such that a person is unable to understand speech, spoken language. Sign language declined the gap in spoken language. The hand gesture is analyzed identically to sign language presenting the naturalness of intercommunication for deaf people. Real-time hand gesture recognition has been proposed in our research. Our proposed CNN model architecture will remediate the communication barrier of deaf people. The proposed model has achieved an accuracy of 94.61% to recognize 11 several different gestures using depth images.

References

• W. H. Organization et al. 2020 Deafness and hearing loss fact sheet n 300. updated March,2020” 2020.
• Pavlovic, V.I., Sharma, R. and Huang, T.S., 1997. Visual interpretation of hand gestures for human-computer interaction: A review. IEEE Transactions on pattern analysis and machine intelligence, 19(7), pp.677-695.
• Abhishek, K.S., Qubeley, L.C.F. and Ho, D., 2016, August. Glove-based hand gesture recognition sign language translator using capacitive touch sensor. In 2016 IEEE International Conference on Electron Devices and Solid-State Circuits (EDSSC) (pp. 334-337). IEEE.
• Rautaray, S.S. and Agrawal, A., 2015. Vision based hand gesture recognition for human computer interaction: a survey. Artificial intelligence review, 43(1), pp.1-54.
• Shukla, J. and Dwivedi, A., 2014, April. A method for hand gesture recognition. In 2014 Fourth International Conference on Communication Systems and Network Technologies (pp. 919-923). IEEE.
• Erden, F. and Cetin, A.E., 2014. Hand gesture based remote control system using infrared sensors and a camera. IEEE Transactions on Consumer Electronics, 60(4), pp.675-680.
• Bao, P., Maqueda, A.I., del-Blanco, C.R. and García, N., 2017. Tiny hand gesture recognition without localization via a deep convolutional network. IEEE Transactions on Consumer Electronics, 63(3), pp.251-257.
• Akoum, A. and Al Mawla, N., 2015. Hand gesture recognition approach for asl language using hand extraction algorithm. Journal of Software Engineering and Applications, 8(08), p.419.
• Akoum, A. and Al Mawla, N., 2015. Hand gesture recognition approach for asl language using hand extraction algorithm. Journal of Software Engineering and Applications, 8(08), p.419.
• Rahaman, M.A., Jasim, M., Ali, M.H. and Hasanuzzaman, M., 2014, December. Real-time computer vision-based Bengali sign language recognition. In 2014 17th International Conference on Computer and Information Technology (ICCIT) (pp. 192-197). IEEE.
• Garcia, B. and Viesca, S.A., 2016. Real-time American sign language recognition with convolutional neural networks. Convolutional Neural Networks for Visual Recognition, 2, pp.225-232.
• Lai, K. and Yanushkevich, S.N., 2018, August. CNN+ RNN depth and skeleton based dynamic hand gesture recognition. In 2018 24th International Conference on Pattern Recognition (ICPR) (pp. 3451-3456). IEEE.
• G. Marin, F. Dominio, P. Zanuttigh, "Hand gesture recognition with Leap Motion and Kinect devices", IEEE International Conference on Image Processing (ICIP), Paris, France, 2014
• G. Marin, F. Dominio, P. Zanuttigh, "Hand Gesture Recognition with Jointly Calibrated Leap Motion and Depth Sensor", Multimedia Tools and Applications, 2015.
• Minto, L. and Zanuttigh, P., 2015. Exploiting silhouette descriptors and synthetic data for hand gesture recognition.
• Santosh, K.C. and Hegadi, R.S. eds., 2019. Recent Trends in Image Processing and Pattern Recognition: Second International Conference, RTIP2R 2018, Solapur, India, December 21–22, 2018, Revised Selected Papers, Part I (Vol. 1035). Springer.
• Hossain, S., Sarma, D., Mittra, T., Alam, M.N., Saha, I. and Johora, F.T., 2020, July. Bengali Hand Sign Gestures Recognition using Convolutional Neural Network. In 2020 Second International Conference on Inventive Research in Computing Applications (ICIRCA) (pp. 636-641). IEEE.
• Islalm, M.S., Rahman, M.M., Rahman, M.H., Arifuzzaman, M., Sassi, R. and Aktaruzzaman, M., 2019, September. Recognition bangla sign language using convolutional neural network. In 2019 International Conference on Innovation and Intelligence for Informatics, Computing, and Technologies (3ICT) (pp. 1-6). IEEE.
• Brownlee,J.,2019. Deep Learning for Computer Vision: Image Classification, Object Detection, and Face Recognition in Python. Machine Learning Mastery
• Saha, S., 2018. A comprehensive guide to convolutional neural networks—the ELI5 way. Towards Data Science, 15.
• Brownlee, J., 2019. A gentle introduction to the rectified linear unit (relu).  Machine Learning Mastery. https://machinelearningmastery.com/rectified-linear-activation-function-fordeep-learning-neural-networks.