A review on the perception and recognition systems for interpreting sign languages used by deaf and mute


EOI: 10.11242/viva-tech.01.05.095

Download Full Text here



Citation

Suyash Koltharkar, Amit Gupta, Hemil Patel, Sunita Naik, "A review on the perception and recognition systems for interpreting sign languages used by deaf and mute", VIVA-IJRI Volume 1, Issue 5, Article 95, pp. 1-6, 2022. Published by Computer Engineering Department, VIVA Institute of Technology, Virar, India.

Abstract

Extensive research conducted across several fields revealed that hearing impairment and inability to verbally communicate lead to inequality of opportunity, as well as problems even in everyday life. Despite being a very useful medium of communication for deaf and mute people, sign language has no meaning for someone who does not understand it. The identification of these hand gestures is done by one of the two methods. Static images are one method of identifying while dynamic gestures are another. After skimming through the previous research, many limitations were exposed. The existing systems offered high accuracy rates upon feeding static images but the accuracy dropped significantly when dynamic inputs were fed. Some systems achieved good accuracy rates when fed with dynamic input but their scope was inadequate. After analyzing these techniques and identifying their limitations, we conclude with several promising directions for future research.

Keywords

Impairment, Deaf and Mute, Gestures, Static, Dynamic, Accuracy

References

  1. Daphne Tan, Kevin Meehan, “Implementing Gesture Recognition in a Sign Language Learning Application” IEEE, August 2020, 31st Irish Signals and Systems Conference (ISSC), 11-12 June 2020, Letterkenny, Ireland, DOI: 10.1109/ISSC49989.2020.9180197
  2. Mehreen Murroo, Mohammad Elham Walizad, “Sign Language Recognition System using Convolutional Neural Network and Computer Vision”, IJERT, Vol. 9 Issue 12, 11 Dec. 2020, Paper ID : IJERTV9IS120029
  3. Anup Nandy, Pavan Chakraborty, Jay Shankar Prasad, G. C. Nandi and Soumik Mondal, “Classification of Indian Sign Language in real time”, February 2010, Researchgate
  4. Carlos Pesqueira Fiel, Cesar Cota Castro, Victor Velarde Arvizu, Nun Pitalúa-Díaz, Diego Seuret Jiménez, Ricardo Rodríguez Carvajal, “Design of Translator Glove for Deaf-Mute Alphabet”, 3rd International Conference on Electric and Electronics (EEIC 2013), December 2013, DOI: 10.2991/eeic-13.2013.114
  5. Abdul Kawsar Tushar, Akm Ashiquzzaman, Md. Rashedul Islam, “Faster Convergence and Reduction of Overfitting in Numerical Hand Sign Recognition using DCNN”, 2017 IEEE Region 10 Humanitarian Technology Conference (R10-HTC), 21-23 Dec. 2017, Dhaka, Bangladesh, DOI: 10.1109/R10-HTC.2017.8289040
  6. Jayan Mistry, Benjamin Inden, “An Approach to Sign Language Translation using the Intel RealSense Camera”, 2018 10th Computer Science and Electronic Engineering (CEEC), 19-21 Sept. 2018, Colchester, UK, DOI: 10.1109/CEEC.2018.8674227
  7. Sakshi Lahoti, Shaily Kayal, Sakshi Kumbhare, Ishani Suradkar, Vikul Pawar, “Android based American Sign Language Recognition System with Skin Segmentation and SVM”, 2018 9th International Conference on Computing, Communication and Networking Technologies (ICCCNT), 10-12 July 2018, Bengaluru, India, DOI: 10.1109/ICCCNT.2018.8493838
  8. Shadman Shahriar, Ashraf Siddiquee, Tanveerul Islam, Abesh Ghosh, Asir Intisar Khan, Celia Shahnaz, “Real-Time American Sign Language Recognition Using Skin Segmentation and Image Category Classification with Convolutional Neural Network and Deep Learning”, TENCON 2018 - 2018 IEEE Region 10 Conference, 28-31 Oct. 2018, Jeju, Korea (South), DOI: 10.1109/TENCON.2018.8650524
  9. Ching-Hua Chuan, Eric Regina, Caroline Guardino , “American Sign Language Recognition Using Leap Motion Sensor”, 2014 13th International Conference on Machine Learning and Applications, 3-6 Dec. 2014, Detroit, MI, USA, DOI: 10.1109/ICMLA.2014.110
  10. Sevgi Z. Gurbuz, Ali Cafer Gurbuz, Evie A. Malaia, Darrin J. Griffin, Chris S. Crawford, Mohammad Mahbubur Rahman and Emre Kurtoglu, “American Sign Language Recognition Using RF Sensing”, IEEE Sensors Journal, Volume: 21, Issue: 3, Feb.1, 1 2021, pp. 3763 - 3775.
  11. P.V.V. Kishore, Panakala Rajesh Kumar, “A Video Based Indian Sign Language Recognition System (INSLR) Using Wavelet Transform and Fuzzy Logic”, International Journal of Engineering and Technology, January 2012, DOI: 10.7763/IJET.2012.V4.427
  12. Sanjana R, Sai Gagana V, Vedhavathi K R, Kiran K N, “Video Summarization using NLP”, International Research Journal of Engineering and Technology (IRJET), Volume: 08 Issue: 08, Aug 2021, pp. 3672-3675.
  13. Huy B.D Nguyen and Hung Ngoc Do, “Deep Learning for American Sign Language Fingerspelling Recognition System”, 26th International Conference on Telecommunications (ICT), 15 August 2019,pp. 314-318
  14. Rajesh George Rajan and M. Judith Leo, “American Sign Language Alphabets Recognition using Hand Crafted and Deep Learning Features”, 2020 International Conference on Inventive Computation Technologies (ICICT), 09 June 2020, pp. 430-434