Eldercare and Rehabilitation Technology for Better Health

Transcription

1 Eldercare and Rehabilitation Technology for Better Health Marjorie Skubic, PhD Professor, Electrical and Computer Engineering Director, Center for Eldercare and Rehabilitation Technology University of Missouri Research supported by NIH, NSF, AHRQ, AOA & Alzheimer s Association

2 Center for Eldercare and Rehabilitation Technology Kinect sensor Doppler radar Depth sensor Motion sensors Sports Doctors Physical Therapists Bed sensor Nurses Social Workers

3 Center for Eldercare and Rehabilitation Technology Kinect sensor Doppler radar Depth sensor Motion sensors Sports Doctors Physical Therapists Bed sensor Nurses Social Workers

4 Squaring the Life Curve Functional Decline Current trend With proactive care Time Rantz et al, Nursing Outlook, 2005

5 Sensor Network for Health Alerts clinical decision support system Sensor Data Sensors motion sensors bed sensor gait sensor Integration & Data Storage Alert Feedback Detection of Health Change or Functional Decline Alert Manager Web portal & Mobile devices Health change alert Clinical Care Coordinator Skubic, et al., IEEE J. of Trans. Eng. in Health & Medicine, 2015

6 TigerPlace 54 apartments Designed for Aging in Place 65 residents, aged from about 70 to % have a chronic illness e.g., arthritis, heart disease, diabetes, stroke risk 60% have multiple chronic illnesses Some early stage Alzheimers 35% use a walker; some wheelchairs Residents tend to be socially active

7 Squaring the Life Curve Functional Decline TigerPlace residents without in-home sensors stay 2 years longer than seniors in comparable housing TigerPlace residents with in-home sensors stay 1.7 years longer than Current trend With proactive care Time those without sensors at TigerPlace Rantz et al, Nursing Outlook, 2005, 2015

8 Case Study: Diagnosis & history of depression Aug. 18 Sept. 18, 2009 Mar. 26 April 25, 2010 Oct. 1 Oct. 31, am 7 am 11 pm Depression managed & followed by a geriatric psychiatrist After personal losses resident reported low energy, had trouble eating, and stopped going to the dining room After intervention, resident s activity pattern increased S. Wang et al., JBHI, 2012; Galambos et al., Gerontechnology, 2013

9 illnesses detected early urinary tract infections pneumonia & other upper respiratory infections increasing congestive heart failure pain post hospitalization delirium low blood sugar Uses a model of early illness recognition to generalize across different health problems Rantz et al., J of Gerontological Nursing, 2012.

10 MU Hydraulic Bed Sensor Captures the ballistocardiogram & respiration 10 seconds ECG BCG Heise et al., 2011, 2013

11 Heartbeats detected from bed sensor Finger sensor Beat to beat interval Rosales et al., 2012 Bed Sensor Finger Sensor 11

12 New Algorithm : Computing Energy and locating the Energy Detection Results Peak Locations peaks Finger pulse Lydon et al, EMBC 2015

13 Results : Older Adult from TigerPlace Jan, 2014 Nov, 2014

14 Capturing Gait in the Home Using Depth Images Stone & Skubic, JAISE, 2011, TBE, 2013 In-Home Gait:

15 Validation in the Lab Vicon Kinect #1 Kinect #2 Kinect #1 7.3 m Camera #1 webcam Camera #2 8.9 m Kinect #2 15

16 Capturing Gait in the Home Stone & Skubic, EMBC 2012; TBE 2013; EMBC 2014.

17 Case Study: Capturing Gait Changes Healthy Husband Wife with Parkinson s Decrease in walking speed Decrease in stride length 0 11/09/11 12/07/11 01/04/12 02/01/12 02/29/12 03/28/12 04/25/ /09/11 12/07/11 01/04/12 02/01/12 02/29/12 03/28/12 04/25/

18 Capturing Falls in the Home with Depth Sensors Stone & Skubic, 2014, 2015 In-Home Falls:

19 False Alarms in the Home

20 Center for Eldercare and Rehabilitation Technology Kinect sensor Doppler radar Depth sensor Motion sensors Sports Doctors Physical Therapists Bed sensor Nurses Social Workers

21 Remote Personalized Physical Therapy In-Home Interface PT Interface Kansas City Home Kinect Synchronous HD Video Conferencing with 3D Sensing Physical Therapy Clinic Kinect GENI-enabled Networking Senior at Home Physical Therapist Calyam et al., 2015.

22 Microsoft Kinect Color camera Depth camera Microphones Color Camera Depth Camera 512 x 424 Max Depth Distance Min Depth Distance Horizontal Field of View Vertical Field of View Skeleton Model Skeletons Tracked x 30 fps ~4.5 m 50 cm 70 degrees 60 degrees 26 joints

23 Remote Physical Therapy from clinic to home More than video conferencing; Includes 3D sensing In-home patient view PT Home Home PT Physical therapist view Controlled by voice commands Mishra et al., 2015

24 PT side Mishra 24 et al., 2015

25 Eldertech Collaborators Nursing Social Work CS/Engineering Family Medicine Physical Therapy Education Foresite Healthcare HMI

26 Center for Eldercare and Rehabilitation Technology Kinect sensor Doppler radar Depth sensor Motion sensors Sports Doctors Physical Therapists Bed sensor Nurses Social Workers

27 Assessing for ACL Injury Risk Rachel Coward/MU Publications

28 Portable Screening Tool Stone, Butler, McRuer, Gray, Marks & Skubic, 2013

29 Screening in Area High Schools 168 high school athletes

30 Exergame Prototypes Huo et al., 2015

31 Recognizing Harmful Hand Postures Neutral Collapsed Knuckles Wrist Extension Savvidou, Li, Willis & Skubic, 2015 Wrist Flexion Ulnar Deviation Radial Deviation

32 Hands are tracked & assessed in depth videos using the Kinect Li, Savvidou, Willis & Skubic, 2014

33 Prehab/Rehab Collaborators CS/Engineering Medicine Music Social Work Physical Therapy Occupational Therapy

34 Our Goal: Healthy Living at Any Age