International Journal of Modern Trends in Engineering and Research e-issn No.: , Date: 2-4 July, 2015

Similar documents
AVR Based Gesture Vocalizer Using Speech Synthesizer IC

Gesture Recognition by using Flex Sensor for Patient Monitoring

A Review on Hand Gesture Recognition for Deaf and Dumb People Using GSM Module

International Journal of Advance Engineering and Research Development. Gesture Glove for American Sign Language Representation

Hand-Gesture Recognition System For Dumb And Paraplegics

Sign Language Interpretation Using Pseudo Glove

Embedded Based Hand Talk Assisting System for Dumb Peoples on Android Platform

ISSN: [Jain * et al., 7(4): April, 2018] Impact Factor: 5.164

Development of an Electronic Glove with Voice Output for Finger Posture Recognition

Smart Speaking Gloves for Speechless

Recognition of Voice and Text Using Hand Gesture

Figure 1: Block Diagram of Proposed System

A Review on Gesture Vocalizer

Glove for Gesture Recognition using Flex Sensor

International Journal of Advances in Engineering & Technology, Sept., IJAET ISSN: Tambaram, Chennai

Real-time Communication System for the Deaf and Dumb

A Design of Prototypic Hand Talk Assistive Technology for the Physically Challenged

GLOVES BASED HAND GESTURE RECOGNITION USING INDIAN SIGN LANGUAGE

Smart Gloves for Hand Gesture Recognition and Translation into Text and Audio

Hand Gesture Recognition System for Deaf and Dumb Persons

Microcontroller and Sensors Based Gesture Vocalizer

Communication Interface for Mute and Hearing Impaired People

Gesture Recognition using Marathi/Hindi Alphabet

Haptic Based Sign Language Interpreter

[Ashwini*, 5(4): April, 2016] ISSN: (I2OR), Publication Impact Factor: 3.785

International Journal of Engineering Research in Computer Science and Engineering (IJERCSE) Vol 5, Issue 3, March 2018 Gesture Glove

[Chafle, 2(5): May, 2015] ISSN:

Speech to Text Wireless Converter

Smart Glove Based Gesture Vocalizer for Deaf and Dumb

Translation of Unintelligible Speech of User into Synthetic Speech Using Augmentative and Alternative Communication

Sign Language Coach. Pupul Mayank Department of Telecommunication Engineering BMS College of Engg, Bangalore, Karnataka, India

ISSN: [ ] [Vol-3, Issue-3 March- 2017]

ANDROID BASED AID FOR THE DEAF

DESIGN OF SMART HEARING AID

Detection of Finger Motion using Flex Sensor for Assisting Speech Impaired

Meri Awaaz Smart Glove Learning Assistant for Mute Students and teachers

Date: April 19, 2017 Name of Product: Cisco Spark Board Contact for more information:

OIML R 122 Annex C RECOMMENDATION. Edition 1999 (E) ORGANISATION INTERNATIONALE INTERNATIONAL ORGANIZATION

Microphone Input LED Display T-shirt

Android based Monitoring Human Knee Joint Movement Using Wearable Computing

Hand Gesture Recognition and Speech Conversion for Deaf and Dumb using Feature Extraction

SiS9255. Projected Capacitive. Touch-Screen Micro Processor. Data sheet. Rev. 1.2 August 18, 2015

Flex Sensor Based Hand Glove for Deaf and Mute People

Computer Applications: An International Journal (CAIJ), Vol.3, No.1, February Mohammad Taye, Mohammad Abu Shanab, Moyad Rayyan and Husam Younis

Detection and Recognition of Sign Language Protocol using Motion Sensing Device

Hand Gesture Recognition In Real Time Using IR Sensor

Communications Accessibility with Avaya IP Office

TALKING GLOVES. Mitali Madhusmita Atul Agrawal. Department of Electronics and Communication Engineering

Digital Noise-Cancellation Headphones Senior Project Proposal. Korey Adams EE Class of 2016

VPAT Summary. VPAT Details. Section Telecommunications Products - Detail. Date: October 8, 2014 Name of Product: BladeCenter HS23

The Use of Voice Recognition and Speech Command Technology as an Assistive Interface for ICT in Public Spaces.

PC BASED AUDIOMETER GENERATING AUDIOGRAM TO ASSESS ACOUSTIC THRESHOLD

A Novel Approach for Communication among Blind, Deaf and Dumb People

Transitioning from the CS4362 to the CS4362A or CS4365

April 23, Roger Dynamic SoundField & Roger Focus. Can You Decipher This? The challenges of understanding

SPEECH TO TEXT CONVERTER USING GAUSSIAN MIXTURE MODEL(GMM)

Sound Interfaces Engineering Interaction Technologies. Prof. Stefanie Mueller HCI Engineering Group

Voluntary Product Accessibility Template (VPAT)

A Novel Based Adaptive Communication Technique For Specially Abled People

Assistant Professor, PG and Research Department of Computer Applications, Sacred Heart College (Autonomous), Tirupattur, Vellore, Tamil Nadu, India

MCMP:Multichannel Multi Point Voice Communication in NFMI Hearing Aid

Fall Detection and Monitoring System For Elderly Person

II. PROCEDURE DESCRIPTION A. Normal Waveform from an Electrocardiogram Figure 1 shows two cycles of a normal ECG waveform.

Hand Gestures Recognition System for Deaf, Dumb and Blind People

Real-time ECG monitoring system for the assessment of rural cardiac patients

(12) Patent Application Publication (10) Pub. No.: US 2010/ A1 DISPLAY VOCODER 122 TEXT CONVERSION ENGINE 126 PERSONALEZED CONTROLLER 144

Embedded Stethoscope for Heart Sounds

Finger Braille teaching system-teaching of prosody of finger Braille

A Wearable Hand Gloves Gesture Detection based on Flex Sensors for disabled People

Open Portable Platform for Hearing Aid Research

Advanced Audio Interface for Phonetic Speech. Recognition in a High Noise Environment

Voluntary Product Accessibility Template (VPAT)

Thrive Hearing Control Application

Frequently asked questions to Oticon ConnectClip

CROS System Initial Fit Protocol

Personal Listening Solutions. Featuring... Digisystem.

Gesture Vocalizer using IoT

Sign Language to English (Slate8)

Apple emac. Standards Subpart Software applications and operating systems. Subpart B -- Technical Standards

Update. KT4TT Names Its First PUSH Award Winner! Product Utilization Support and Help (PUSH) AWARD

Embedded Systems (1000)

Thrive Hearing Control Application

Study about Software used in Sign Language Recognition

Roger TM. for Education Bridging the understanding gap

Radio Aid Systems. 14 School &

Implementation of Spectral Maxima Sound processing for cochlear. implants by using Bark scale Frequency band partition

Sonic Spotlight. Binaural Coordination: Making the Connection

Heart Attack Detection and Heart Rate Monitoring Using IoT

Avaya B159 Conference Telephone Voluntary Product Accessibility Template (VPAT)

Accessible Computing Research for Users who are Deaf and Hard of Hearing (DHH)

Summary Table Voluntary Product Accessibility Template. Supports. Please refer to. Supports. Please refer to

Konftel 300Mx. Voluntary Product Accessibility Template (VPAT)

Evolve 3 & 5 Service Manual

GLUCOMETER: High Level Design

An Ingenious accelerator card System for the Visually Lessen

Summary Table Voluntary Product Accessibility Template. Supporting Features. Supports. Supports. Supports. Supports

International Journal of Modern Trends in Engineering and Research e-issn No.: , Date: 2-4 July, 2015

DEVELOPMENT AND EVALUATION OF A PORTABLE AUDIOMETER WITH REMOTE HEALTH CARE FACILITY

The power to connect us ALL.

Transcription:

International Journal of Modern Trends in Engineering and Research www.ijmter.com e-issn No.:2349-9745, Date: 2-4 July, 2015 Data Glove For Speech Impaired Using XBEE AND GSM Randhawane Prajakta Dilip 1, Prof.R.G.Dabhade 2 1 E & TC Department, SND College of Engg, prajakta06happy@gmail.com 2 E & TC Department, SND College of Engg, rgdabhade@gmail.com Abstract-Communication is key element connecting people. Communication helps human being to exchange feeling, thoughts, ideas, emotions etc. Speech impaired people find it difficult to interact with normal people. Speech impaired uses sign language to communicate with normal people, but not all people know sign language and find it difficult to interact. There is the need of developing an electronic device that can translate sign language into speech and text, in order to make the communication take place between the mute with the general public. The paper describes a way to reduce this communication barrier by developing Data Glove Based System For Speech impaired using XBee & GSM. The Data Glove is a complete portable communication aid. It converts sign language into speech & text, it sends the text message through GSM module & controlling the home appliances through hand gesture. The glove is equipped with flex sensor. For each hand gesture the flex sensor bends its resistance varies, this resistance is analog in nature, it is converted into digital value using ADC of LPC2148. The value of flex sensor & MEMS are transmitted by means of XBee to another LPC2148 at receiver side. The output of system will be presented with the help of speaker. As we go on updating the database the dumb will speak like a normal person. We can train the glove as per our need. Keywords: Speech impaired; Communication aid; Flex Sensor; LPC2148; GSM; MEMS; XBee. I. INTRODUCTION Communication is the most important in the wildlife. Better communicate we must required a voice and some should for better understanding. If we consider the peoples those are deaf cannot speak and hence they may get misunderstand by other person due to improper communication. So, sign language is commonly developed for deaf communities. Sign language is communication skill that uses gestures instead of sound to convey meaning. This project Data Glove Based System For Speech impaired using XBee & GSM aims to resolve the above mentioned issue. In this project, we make a glove that contains flex sensor which detects the bending movements of the fingers. The signal is given to microcontroller. Microcontroller will send this data wirelessly to a sound generating IC. In which, already contains some sound or words that will be played through speakers according to the data. He/she whatever the deaf user wants to speak he/she just needs to give sign input through his finger s and arm then the word he want to speak is played through the speaker. And hence the person in front to him will get what exactly deaf person wants to speak. @IJMTER-2015, All rights Reserved 1402

Figure 1. Glove With Flex Sensor II. SYSTEM DESCRIPTION Figure 2. Block Diagram Flex sensor: The flex sensor patented technology is based on resistive carbon elements. When the substrate is bent, the sensor produces a resistance output correlated to the bend radius- the smaller the radius, the higher the resistance value. Bi-directional flex bend sensor is a unique component that changes resistance when bend. An Un-flexed sensor has a nominal resistance of 10 (K ohm). Sensor is also pressure sensitive, and may be used as a force or pressure sensor. The flex Sensor operating temperature range is -45F to 125F. Images new experimental bi-directional Bi-Flex Sensor (Patent Pending) is a unique component that changes resistance when bent or flexed in either direction. Anun - flexed sensor has a nominal resistance of 20-50K. When the sensor is bent in the other direction its resistance will gradually decrease. Range of nominal resistances of the FLX-02 sensor may vary between 20-50 K. The flexible bend sensor operating temperature is -45F to 125F. Spectra symbol has used this technology in supplying the flex sensors for Nintendo power Glove, the p5 gaming glove. It can vary the actual nominal resistance of the flex sensors to meet the customer s needs. We can produce the flex sensors on a variety s of substrates. @IJMTER-2015, All rights Reserved 1403

Figure3. Flex sensor Zigbee Module (TARANG): Taranga modules are designed with low to medium transmit power and for high reliability wireless networks. The modules require minimal power and provide reliable delivery of data between devices. The interfaces provided with the module help to directly fit into many industrial applications. The modules operate within the ISM 2.4-2.4835 GHz frequency band with IEEE 802.15.4 baseband FEATURES: Range - Outdoor line of sight: up to 50kms with directional antenna. Power supply :3.3to 3.6V Operating Frequency s band 2.4 GHZ RF Data Rate :250 kbps Transmit Power: up to 1 watt / 30 dbm nominal. Receiver Sensitivity: up to -107 dbm. AT Command Modes for configuring Module Parameters Direct sequence spread spectrum technology. Analog to digital conversion and digital I/O line support. Point to point, point to multi point and peer-to-peer topologies are possible. Mesh networking. Figure4. XBee APR9600 -VOICE RECORDING&PLAYBACKDEVICE (60-SecondDuration) @IJMTER-2015, All rights Reserved 1404

Figure5. ARP9600 APR9600 is a low-cost high performance sound record /replay IC in cooperating flash analogue storage technique. Recorded sound is retained even after power supply is removed from the module. There played sound exhibits high quality with a low noise level. Sampling rate for a 60 second recording period is 4.2kHz that gives a sound record/replay bandwidth of 20Hz to 2.1kHz. However, by changing an oscillation resistor, a sampling rate as high as 8.0kHz can be achieved. This shortens the total length of sound recording to 32 seconds. Total sound recording time can be varied from 32seconds to 60 seconds by changing the value of a single resistor. The IC can operate in one of two modes: serial mode and parallel mode. In serial access mode, sound can be recorded in 256 sections. In parallel access mode, sound can be recorded in 2, 4 or 8 sections. The IC can be controlled simply using push button keys. It is also possible to control the IC using external digital circuitry such as micro-controllers and computers. The APR9600 has a 28 pin DIP package. Supply voltage is between 4.5V to 6.5V. During recording and replaying, current consumption is 25mA.In idle mode,the current drops to1 A. The APR9600 experimental board is an assembled PCB board consisting of an APR9600 IC, microphone, support components and necessary switches to allow users to explore all functions of the APR9600chip. The oscillation resistor is chosen so that the total recording period is 60 seconds with a sampling rate of 4.2kHz.The board measures 80mm by 55 mm. Flow chart: START GET VALUE FORM FLEX SENSOR CONVERT THE ANALOG VALUE RECIVED TO DIGITAL VALUE BY MEANS OF ADC IF DIGITAL VALU= STORED PRESENT OUTPUT RESULT ON LCD & SPEKAR & SEND A TEXT MESSAGE ON MOBILE END @IJMTER-2015, All rights Reserved 1405

Algorithm: 1. Initialize the ARM processor (M1 & M2),ADC,LCD, & other modules. 2. Get value from flex sensor. 3. Convert the analog value received from flex sensor to digital by means of ADC. 4. Match the output from ADC with database contents. 5. If data matches present output on LCD display & speaker. CONCLUSION Sign Language is a useful tool to ease the communication between the deaf, mute community and even the normal people who understand the language. Yet there is a communication barrier between these communities with the normal people. Therefore there is a need to develop an electronic device that can translate the sign language into speech (sound) in order to make the communication take place. With this project, the deaf or mute people can use the glove stopper form sign language and it will be converted into speech so that normal people can understand their expression. REFERENCES [1] A.M. Riad, Hamdy K.Elmonier, Samaa.M.Shohieb, and A.S. Asem Signsworld; Deeping Into The Silence World And Hearing Its Signs (State Of The Art), (IJCSIT) Volume 4, Number1, Feb 2012. [2] Aparna P, Mohana priya P, Usha Rani T, Jeba Jaculin B, Pradeep Raja B, Development of an Assistive Aid for Speech Impaired, International Journal of Scientific and Research Publications, Volume 2, Issue 3, March 2012. [3] Ata-Ur-Rehman, Salman Afghani, Muhammad Akmal, Raheel Yousaf, Microcontroller and Sensors Based Gesture Vocalizer, ISPRA '08, 2008. [4] Bhavina Patel, Vandana Shah, Ravindra Kshirsagar, Microcontroller Based Gesture Recognition System for the Handicap People JERS/Vol. II/ Issue IV, December 2011. [5] APR6016, Datasheet, Voice Recording and Playback Device, Aplus Integrated Circuits Inc. [6] EEPROM-Atmel Corporation 0180Z1 SEEPR 5/07, May 2002. [7] Flex sensor-spectrasymbol.com (888)795-2283 Rev A2 - Page 1-2. [8] John Foster, XBee Cookbook Issue 1.4 for Series 1 (Freescale) with 802.15.4 Firmware, April 2011. [10] Shoaib Ahmed.V, Magic Gloves (Hand Gesture Recognition and Voice Conversion System for Differentially Able Dumb People), Submitted to: Tech Expo- The Global Summit, London 2012, December 2012. [11] SIM-AT, command Manual-V1.03, December 2010. [12] Dr. Krishna Mohanta and Dr.V.Khanaa, Assistive Devices For Service Members With Disabilitie, International Journal Of Advanced Research (2013), Volume 1, Issue 9, pg no. 548-553. [13] Manisha patil, manasi m. Patil, traffic control using hand gesture recognition, proceedings of iraj international conference, 21st July 2013, pg no. 75-80. @IJMTER-2015, All rights Reserved 1406