TOUCH IOT WITH SAP LEONARDO PROTOTYPE CHALLENGE BLIND S CANE Submitted for the Prototype Challenge as part of the opensap course Touch IoT with SAP Leonardo.
Johnny is blind but a curious person who learns new things all the time simply by conversing and interacting with others present around him. He longs to have a gadget that will help him navigate his path without help from others so he can become as much mobile as he desires. One day he learns about the new fascinating IoT solutions and conceptualizes a device fully embedded in his Blind s Cane that will help him to achieve his dream. He seeks help from Chris, his close buddy, who sets upon developing a solution using SAP Leonardo. The idea is to plant a set of IoT devices at the tip of the Blind s Cane and power them using a pair of AA batteries inserted inside the handle. The IoT devices can see potholes and other obstructions, measure road traffic, and alert Johnny via his cell phone. The device can even activate a siren if the cane ever slips out of hands, or if it becomes necessary to ward off unfriendly animals, or to simply draw attention from fellow pedestrians. Technology Backbone: A voice activated cell phone app not only plays music and reads out news for Johnny s entertainment, but also interacts with the Blind s Cane via BlueTooth on the one hand and SAP Cloud Platform running SAP Leonardo via traditional mobile networks on the other. The cane itself serves as an Edge Computing device exchanging filtered local terrain data to obtain safe navigational assistance from the SAP system. The SAP system will also provide tracing and other distress assistance to Johnny. 2
Persona [Johnny] [The blind person] [I wish I am blessed with a gadget that will make me as mobile as I desire without taking help from the others] About 23, turned blind after a freak road accident At the moment I heavily depend on my best buddy Chris for mobility Though I am blind I never stopped learning. The only difference is, now-d-days I learn by interacting with others around me Responsibilities Main Goals Make and sell handicraft items at a local blind people s school Perform regular daily chores with the help of the others around me Needs I am totally dependent on my cane for navigation I like to carry a simple to operate (voice activated) cell phone so I can listen to music or news. Teach at blind people s school Support myself with regular daily chores without needing help from the others. Pain Points Often I drop my cane and struggle to locate it Occasionally I am troubled by unfriendly animals I find it difficult to call someone s attention should I need one. 3
Point of View (PoV) 4
UX Journey Leave home to go to school Walk with a friend Hear stray dogs barking Dropped the Blind s Cane Hear too many honks Walk towards the school ACTIONS MINDSET I must be getting late to school. Where is my helper buddy Christy? Thank God! I have a good friend who can take me around.. What if they chase or pounce upon me..? Oops! What will I do without my friend around me in this situation..? The traffic is too bad, I must learn to battle with it soon.. It is deafening silence here.. FEELING Oh, I hear his voice! He must be here soon.. I wish my cane can navigate so I can walk down on my own without needing anyone s help.. I wish my cane had a magic wand so I can ward these dogs off.. I wish my cane had a siren so I can locate it all by myself.. I wish my cane can get the attention of passerby folks so I can get some help in times like this.. I wish there exists a voice activated cell phone that I can use to listen to music, hear the news and activate my cane too..! Looks like my life must revolve around my friend hereafter how sad..! I can never do this if I am alone and on my own.. School A close friend Stray dogs Blind scane Passerby person Blind friendly (voice activated) cell phone TOUCH POINTS Images Courtesy: http://r.search.yahoo.com 5
Prototype IoT Architecture of Blind s Cane Images Courtesy: http://r.search.yahoo.com 4-Button Control on the Handle of the Blind s Cane Button-1: Power Switch Button-2: Siren for Stray Animals Button-3: Siren to Locate Cane Button-4: Siren to Get Help Images Courtesy: http://r.search.yahoo.com 6
General Note: a) This prototype has no Screen or Keyboard Interfaces as this application is meant for use by blind persons. b) Navigation is automatic once the power is turned on c) Other activities are triggered by the blind person using: - voice activated cell phone or - by pressing the 4-button controls (see picture above) mounted on the handle of his cane. Each Siren has a distinct output and meets a specific purpose. Scenario 1: Navigation a) Once powered on the IoT sensors mounted at the tip of the Blind s Cane collect terrain data continuously b) Edge Computing Infrastructure mounted on the body of the Blind s Cane filters and extracts only critical data c) Extracted data is communicated to the cell phone via BlueTooth d) Cell phone mobile app transmits extracted data and GPS position to Mobile Network e) SAP Leonardo receives extracted data and analyzes it on SAP Cloud Platform f) SAP Cloud Platform determines the type and nature of extracted object / obstruction and returns updated navigational data g) Updated navigational data traverses its path and reaches the cell phone h) Voice Activated Cell Phone App describes the object and guides the blind person with further navigation Scenario 2: Dealing with Stray Animals a) The IoT device senses the nearby animal and transmits data about it to SAP Leonardo b) SAP Leonardo helps determine type of animal c) Voice Activated Cell Phone App describes the animal to the blind person d) The blind person presses a button on his cane to activate a siren that will chase the animal away (he can do this upon hearing the animal as well) 7
Scenario 3: Locating the Dropped Cane a) The blind person activates Voice Activated Cell Phone App (if struggling to locate his dropped cane) b) Voice Activated Cell Phone activates siren on the cane c) The blind person follows the audio signal and locates his cane Scenario 4: Getting Help in Heavy Traffic a) The blind person activates Voice Activated Cell Phone App (while stuck in heavy traffic at pedestrian crossings) b) Voice Activated Cell Phone requests help from nearby public via siren c) Passerby persons come forward to assist the blind person cross the road Scenario 5: Enjoying Music or Listening to News a) The blind person activates Voice Activated Cell Phone App (while walking in a familiar place or when resting or relaxing) b) Voice Activated Cell Phone plays music or tunes radio for news 8