Assistive device for mute and deaf person using raspberry pi 2B

Date : Jun 2015 - Jun 2016

This project have two parts one is sign language recognition using hand glove and Speech recognition using raspberry pi. On hand glove we attaches four flex sensors to measures the amount of deflection or bending The resistance of flex sensor is directly proportional to the amount of bending the sensors.the Flex sensor is connected with Arduino Nano which convert analog signal into digital signal(ADC). Arduino Nano send data to Raspberry pi using serial communication. Raspberry pi detect gesture by performing logic given in the program then raspberry pi open a message file the meaning of gesture perform by person is display on LCD or output message on speaker. For speech recognition we use pocket sphinx software in raspberry pi.In pocket sphinx software we use Espeak command which can speak text from file. when a person speak in mic the program start matching the speak signal to vocabulary file if the sentence is present in vocabulary file then output message will display on LCD and on speaker. Handglove is for Mute person the mic is for Common person and for Deaf person communication our device have LCD display .