MobileAccessibility Richard Ladner University of Washington 1
What We ll Do Tonight Disabilities Technology Trends MobileAccessibility Project Other Mobile Projects 2
Basic Data 650 million people world-wide are disabled 16% of US population to ages 15 to 64 is disabled. 10% of the workforce is disabled 5% of the STEM* workforce is disabled 1% of PhDs in STEM are disabled *STEM = Science, Technology, Engineering, Mathematics 3
Demographics US Population Number (in thousands) 30000 25000 20000 15000 10000 5000 Percent 18 16 14 12 10 8 6 4 2 Number Percent 0 With a disability Difficulty seeing Difficulty hearing Difficulty with speech Difficulty walking/using stairs Learning disability 0 Source: U.S. Census Bureau, Survey of Income and Program Participation, 2002 4
Disabilities Vision Blind Low-Vision Color Blind Hearing Deaf Hard of Hearing Speech Ability to speak Stuttering Mobility Ability to walk Ability to use hands/arms Cognition Dyslexia Short-term memory loss Dementia Multiple Deaf-blindness 5
Models of Disability Medical Model Disabled people are patients who need treatment and/or cure. Education Model Disabled youth need special education. Rehabilitation Model Disabled people need assistive technology and training for employment and everyday life. Legal Model Disabled people are citizens who have rights and responsibilities like other citizens. Access to public buildings, voting, television, telephone, and education are some of those rights. Social Model Disabled people are part of the diversity of life, not necessarily in need of treatment and cure. They do need access when possible. 6
7
What We ll Do Today Disabilities Technology Trends MobileAccessibility Project Other Mobile Projects 8
Personal Texting by Deaf People TTY used by deaf people in their homes circa 1970 Modern TTY with built-in acoustic modem SMS texting 9
Optical Character Recognition for Blind People Kurzweil Machine Circa 1976 KNFB Reader Mobile 10
Speech Recognition for Hands Free Access Mobile Speech Recognition 11
Built-in Accessibility Windows 7 Magnifier iphone VoiceOver 12
Trend Accessibility Solutions Mobile Mainstream Solutions 13
New Trend Standard Programmable Platforms Multi-function Accessibility Solutions on Standard Platforms Laptops, notebooks, phones, are programmable!! 14
What We ll Do Today Disabilities Technology Trends MobileAccessibility Project Other Mobile Projects 15
MobileAccessibility Bridge to the world for blind, low-vision and deaf-blind people http://mobileaccessibility.cs.washington.edu 16
Platform Sensors Video camera Microphone GPS Compass Accelerometer Human input Keyboard Touch screen Speech Output Speech Audio Visual Vibration 17
Alternative Platforms iphone Windows phone 18
Blind Portraits Chandrika Jayant Portrait Vibrate and Speak Find Faces 19
Talking Barcode Reader Chandrika Jayant 20
Tactile Graphics Josh Scotland, Chandrika Jayant Y = X 2 + 1 9/21/10 21
Appliance Reader Chandrika Jayant, Tom Guo It is 2:35 AM, at 29.8 Celsius, and 73% humidity. http:/www.mtixtl.com/productimages/oven/boxpanel-300.jpg 22
GoBraille Shiri Azenkot Google Maps Refreshable Braille Display, WiFi Enabled OneBusAway GoBraille Repository 23
Capstone Projects From 2010 http://www.komonews.com/news/local/87737592.html?tab=video 24
Capstone Projects From 2011 The Phone Wand - Navigating routes using orientation and vibration feedback. Pic2Speech - Custom augmented speech. Street Sign Reader - Reading street signs so you don't have to. WhosHere - Finding out which friends are around you. SwipeSounds - The sound of gestures. Sound Detector - Detecting recognizable sound patterns to alert the user. 25
What We ll Do Today Disabilities Technology Trends MobileAccessibility Project Other Mobile Projects 26
Ideal Group http://ideal-group.org/sj131264/ 27
Project Possibility http://projectpossibility.org/index.php 28
Braille Notetakers BrailleNote Braille Sense 29
Braillenote with GPS 30
DeafBlind Communicator 31
VizWiz Bigham, Jayant, (UIST 2010) Take a picture and send it to humans with a recorded question. Pembrook Pointe What does this street sign say? 9/21/10 32
MobileASL Eve Riskin, Jake Wobbrock, ASL communication using video cell phones over current U.S. cell phone data network Challenges: Limited network bandwidth Limited processing power on cell phones Limited battery life Video 33
Research User Centered Design Lab studies Control as much as possible Field studies Instrument to log data Experience sampling Diaries Surveys 34