IJCATR Volume 13 Issue 8

Two-Way Tamil to Indian Sign Language Translator Using Mediapipe and Natural Language Processing

Kalaimathi S, Mangaiyarkarasi M, Moginder E, Rihana M, Thachayani M
10.7753/IJCATR1308.1004
keywords : Indian sign language; Assistive technology; Sign-language; Natural language processing; Gesture recognition

PDF
Sign-language is the primary mode of communication for the hearing- or speech-impaired people. With the technological advancements in machine-learning and computational technologies the models are developed for the translating sign-language to other natural language. In this paper, a two-way translation model based on CNN-LSTM is presented for the translation of Indian sign language to one of the India's regional language, Tamil. The proposed model is trained and tested for a subset of commonly used words and resulted in an accuracy of 92.9% and a precision of 93.7%. This two-way ISL communication system aims to revolutionize the way ISL is taught and learned.
@artical{k1382024ijcatr13081004,
Title = "Two-Way Tamil to Indian Sign Language Translator Using Mediapipe and Natural Language Processing",
Journal ="International Journal of Computer Applications Technology and Research(IJCATR)",
Volume = "13",
Issue ="8",
Pages ="34 - 38",
Year = "2024",
Authors ="Kalaimathi S, Mangaiyarkarasi M, Moginder E, Rihana M, Thachayani M"}
  • Translator model to convert regional Tamil language text to ISL developed.
  • The system facilitates both text-to-sign language and sign language-to-text translations.
  • Utilize CNN and LSTM to achieve contextually relevant translations.
  • The model can be extended to support other languages.