Speaking System For Mute People Using Hand Gestures

Download Project Document/Synopsis

Its very difficult for mute people to convey their message to regular people. Since regular people are not trained on hand sign language, the communication becomes very difficult. In emergency or other times when a mute person travelling or among new people communication with nearby people or conveying a message becomes very difficult. Here we propose a smart speaking system that help mute people in conveying their message to regular people using hand motions and gestures. The system makes use of a hand motion reading system equipped with motion and flex sensors along with a speaker unit. This system is powered by a battery powered circuitry to run it. A raspberry pi is used for processing the data and operating the system. The system consists of around 10 stored messages like “need help”, “where is the toilet/washroom” and so on that help mute people convey basic messages. The system reads persons hand motions for different variations of hand movement. It also consists of a trigger sensor in order to indate that the person wishes to activate the system and speak something. This ensures the system does not speak when the person is just involuntarily making hand motions. The raspberry pi processor constantly receives input sensor values and then processes it. Now it searches for matching messages for the set of sensor values. Once it is found in memory this messages is retrieved and is spoken out using text to speech processing through the interfaced speaker. Thus we have a fully functional smart speaking system to help mute people communicate with regular people using a simple wearable system.