Problem Statement

A major part of the society consists of people who are of impaired of hearing and speech and the major problem they face is the communication gap. The reasons are clear and simple lack of education regarding sign language and the fact that people around them can't understand them. Thus, the problem statement we have chosen is "To bridge the gap of communication for those who are impaired of hearing and speech".

Solution

We are developing an inclusive communication application that bridges the gap between sign language and spoken or written language. The app enables real-time, two-way translation—converting sign language into text or speech through a live camera, and converting speech or text into sign language thro

In Detail

Unlike conventional sign language translation applications, our solution focuses on real-time, two-way communication rather than simple translation. Through the app's live camera feature, a user can perform sign language in front of the camera. The system recognizes the signs and converts them into text or speech, allowing a person who does not understand sign language to communicate with them. In the opposite direction, when a user enters text or speaks into the application, the system converts the input into sign language, which is demonstrated by an interactive 3D avatar. This provides a visual form of communication for users who rely on sign language. Key Features 1. Real-Time Sign Language Translation The live camera recognizes sign language and converts it into text or speech in real time. 2. Text and Speech to Sign Language Spoken or written input is converted into sign language and displayed through a 3D avatar. 3. Accessible Video Calling The application includes a video calling feature with an integrated sign language translator. When a person who does not use sign language speaks, their speech is continuously translated into sign language through the 3D avatar for the hearing-impaired user. When the hearing-impaired user communicates through sign language, it is converted into real-time text or subtitles for the other participant. 4. Sign Language Learning The app provides a structured learning system inspired by language-learning platforms such as Duolingo. Users can learn sign language from beginner-level signs and gradually progress to more advanced communication. 5. Community Platform Users can interact with others within a dedicated community, connect with people they are comfortable communicating with, and block users when necessary. Community guidelines and moderation will help maintain a safe and respectful environment. 6. Donations and Support The platform will also allow users to make donations to support accessibility initiatives and contribute towards building a more inclusive community. Together, these features make the application more than a translation tool. It is designed as a complete communication and accessibility platform, helping users communicate, learn, connect, and participate more independently in everyday life.