EFFICIENT SIGN LANGUAGE TRANSLATOR BY GESTURE RECOGNITION

Abstract

The communication medium among the community of deaf and dumb people are by using hand gestures. Normal people find it difficult to communicate with them. This creates an isolation of physically impaired people from the society. The proposed system finds a perfect solution for this problem. In this paper, a hand gesture recognition glove is designed for real-time translation of Indian Sign Language. The gesture recognition is done using flex sensor and accelerometer. Flex sensors and accelerometer are attached to the glove. Five flex sensors are used here. The output from the glove is fed to the microcontroller and then data is transmitted to MAT-Lab for the text and speech conversion. The system aims to convert words of Indian Sign Language into text and speech. The accuracy of the system is quite satisfactory.

WATCH VIDEO…..!

 

 

 

 

The proposed system consists of a glove to which the flex sensors and accelerometers are attached. The system is based on the Gesture recognition. According to dumb people, for every gesture, they have a meaning. That message is kept in a database In the real-time the template database is fed into a microcontroller and the motion sensor & Flex sensor glove is fixed in their hand. For every action, the motion sensors get accelerated and also flex sensors give a specific voltage level signal to the microcontroller. The microcontroller matches the gesture with the database and produces the speech signal. The output of the system is using the speaker. By properly updating the database the dumb will speak like a normal person using the artificial mouth. The system also includes a MAT lab block that interprets the matched gestures.

 

 

 

 APPLICATION AND FUTURE SCOPE

 

The product generated as a result can be used at public places like airports, railway stations and counters of banks, hotels etc. where there is communication between different people. In addition to this a mute person can deliver a lecture using it. Assuming the fact that we are able to convert into spoken English, we can manufacture a handy and portable hardware device having this translating system built in as a chip. With the help of this hardware device, which has built in speakers as well, and group of body sensors along with the pair of data gloves a mute person can communicate to any normal person anywhere. A special dress can also be designed having the required number of sensors at appropriate places for this purpose. This will almost bridge the communication gap present between the deaf community and the normal world. In future we planned to develop an application to bridge the gap between the normal people and deaf-mute people.

 

 

hardware

 

we have proposed a design to translate Indian S0ign Language (ISL) into text and speech. To achieve this, we have used modern technologies and equipment such as, Glove, Flex sensor, Accelerometer, MAT lab. New features are included in the system in order to smoothen the overall working of the new concept. The system designed proves to be effective

 

.The glove which can be worn on the right-hand uses Machine Algorithm to translate sign language into the spoken language. Thus the objective of this project has been established.From observations, we find that the project is capable of providing precise output in the form of voice as well as text. The ultimate aim in this field is to use technology to break down barriers to communication which may hold back deaf and hard-of-hearing people in their daily lives.

 

NEXT : http://www.investinproject.com/2018/04/12/multi-tasking-emg-controlled-robotic-arm/

 

 

 

You may also like...

2 Responses

  1. My brother recommended I might like this web site. He was totally right. This post actually made my day. You can not imagine simply how much time I had spent for this info! Thanks!|

Leave a Reply

Your email address will not be published. Required fields are marked *