Gesturely: A Conversation AI based Indian Sign Language Model

Abstract

The project, Gesturely, aims to improve communication in educational settings for people with hearing impairments. Sign language, notably Indian Sign Language (ISL) in India, serves as a primary mode of expression for the deaf community. The form of expression among the deaf relies on a rich vocabulary of gestures involving fingers, hands, arms, eyes, head, and face. The research endeavors to develop an algorithm capable of translating ISL into English, initially focusing on words within the education domain. Through the integration of advanced computer vision and deep learning methodologies, the objective is to create a system capable of interpreting ISL gestures and converting them into written text. The project involves the creation of a comprehensive dataset, with 50 words and more than 2500 videos. The vision is to empower the deaf community with real-time translation capabilities, promoting inclusivity and accessibility in communication