Open Access Open Access  Restricted Access Subscription or Fee Access

Recognition of Bilingual Translator in American Sign Language

Manswi Rajbhoj, Harsh Tembhurkar, Nikhil Patil, Bhushan Patil, Gajanan ., Sujay Pawar

Abstract


In this study, we are reviewing the designing of desktop application that captures and instantly translates a person’s signing motions in American Sign Language using a computer’s webcam. The implementation of a real-time sign language translator is a critical step in improving communication between the deaf community and the broader public. Based on a convolutional neural network, we provide an American Sign Language (ASL) fingerspelling translator. The creation of a real-time sign language interpreter is a critical step toward enhancing communication between the deaf and the general public. We show how to create and use a convolutional neural network-based fingerspelling translator for American Sign Language (ASL). Semantically relevant word pairs were graded more quickly when the ASL translation form was similar, whereas semantically irrelevant word pairs were judged more slowly. Creating educational tools, information technology, and communication in order to increase learning and facilitate communication between teachers and students. Unaffected persons have a tough time connecting with deaf people due to a lack of sign language development, learning measures, and interpreters.


Full Text:

PDF

References


Chuan CH, Regina E, Guardino C. American sign language recognition using leap motion sensor. In 2014 13th IEEE International Conference on Machine Learning and Applications. 2014 Dec 3; 541–544.

Upadhyay MS, Chavda MV. Intelligent system based on speech recognition with capability of self-learning. Int J Technol Res Eng. 2014 May; 1(9).

Neela Harish, Poonguzhali DS. Design and development of hand gesture recognition system for speech impaired people. In International Conference on Industrial Instrumentation and Control (ICIC) College of Engineering. 2015; 28–30.

Aryanie D, Heryadi Y. American sign language-based finger-spelling recognition using k-Nearest Neighbors classifier. In 2015 3rd International Conference on Information and Communication Technology (ICoICT). 2015 May 27; 533–536.

Truong VN, Yang CK, Tran QV. A translator for American sign language to text and speech. In 2016 IEEE 5th Global Conference on Consumer Electronics. 2016 Oct 11; 1–2.

Prabhakar OP, Sahu N. A survey on: Voice command recognition technique. International Journal of Advanced Research in Computer Science and Software Engineering. 2013 May; 3(5): 576–85.

Joshi A, Sierra H, Arzuaga E. American sign language translation using edge detection and cross correlation. In 2017 IEEE Colombian Conference on Communications and Computing (COLCOM). 2017 Aug 16; 1–6.

Jose DV, Mustafa A, Sharan R. A novel model for speech to text conversion. International Refereed Journal of Engineering and Science (IRJES). 2014 Jan; 3(1): 39–41.

Kamble RK, Kagalkar R. Translation of text to speech conversion for Hindi language. Int J Softw Res (IJSR). 2014 Nov; 3(11): 1027–1031.

Pansare JR, Ingle M. Vision-based approach for American sign language recognition using edge orientation histogram. In 2016 IEEE International Conference on Image, Vision and Computing (ICIVC). 2016 Aug 3; 86–90.

Morford JP, Wilkinson E, Villwock A, Piñar P, Kroll JF. When deaf signers read English: Do written words activate their sign translations? Cognition. 2011 Feb 1; 118(2): 286–92.

Beena MV, Namboodiri MA, Dean PG. Automatic sign language finger spelling using convolution neural network: analysis. Int J Pure Appl Math. 2017; 117(20): 9–15.

Asmita Das, Pradeep Shastry KS, Vedanth B, Gaurav R, Niroshan P, Nidhya MS. Real Time Sign Language Recognition. J Emerg Technol Innov Res. 2022; 9(6): 275–280.

Garcia B, Viesca SA. Real-time American sign language recognition with convolutional neural networks. Convolutional Neural Networks for Visual Recognition. 2016; 2: 225–32.

Way back Machine. Specifics of Arabic language translation and localization [Online]. Available from http://web.archive.org/web/20210118013432/https://evs-translations.com/blog/category/

articles




DOI: https://doi.org/10.37628/ijocspl.v8i1.781

Refbacks

  • There are currently no refbacks.