Tools for Autism Diagnosis

Transcription

1 Tools for Autism Diagnosis Aude Billard, Basilio Noris, Karim Benmachiche Learning Algorithms and Systems Laboratory EPFL Contact Address: Prof. Aude Billard EPFL STI - LASA Ecole Polytechnique Federale de Lausanne, EPFL Station 9, 1015 Lausanne, Switzerland aude.billard@epfl.ch Website: 1

2 Tools for Autism Diagnosis Robota robot doll WearCam 2

3 WearCam - Hardware 3

4 Audio-Visual Analysis of Scenes Object Detection 4

5 Multi-View Face Detection on Low-Quality Videos Realistic set-ups, Severe lighting changes, Extreme in-plane rotations, Cluttered background 5

6 Multi-View Face Detection on Low-Quality Videos Enhanced algorithms for video-based detection of faces that are robust against important degradation of the image s quality, and that are invariant to in-plane rotation. Analysis of Head Mounted Wireless Camera Videos for Early Diagnosis of Autism Noris, B., Benmachiche, K., Meynet, J., Thiran, J-P. and Billard, A. (2007). International Conference on Recognition Systems - CORES 07. Best Paper Distinction 6

7 WearCam - Collaboration 4 WearCams have been dispatched: Uppsalla: 1 Wireless (April 2007) Boston: 1 wireless WearCam (August 2007) Milan: 1 wired WearCam (October 2007) Paris: 1 Wireless (Jan 2008) Lausanne/Nyon (March 2008) collaboration with Mrs. Wil Clavien 7

8 WearCam - Gaze Tracking

9 WearCam - Gaze Tracking - Performances 10 control children aged 2-4 years old 9

10 WearCam - Gaze Tracking - Performances 10

11 Analyzing gaze direction toward or away from human faces during free play: an early indicator of autism 11

12 Analyzing gaze direction toward or away from human faces during free play: an early indicator of autism 12

13 Robota: Educational and Therapeutic Toy

14 Human-Robot Interaction Human-Computer Interaction Face and Motion Tracking CMOS FlyCam camera PDA - Pocket-PC 400MHz, 64Mb Windows CE Embedded C++ Speech Processing CONVERSAY synthesis + recognition Kinesthetic Haptic Potentiometers Touch Switches

15 Robota The Product Since 1999, Robota is a commercial product sold by DIDEL SA, Switzerland 15

16 ROBOTA at the Museum French National Science Museum, Paris, November 2001 January 2003 French National Science Museum, Toulouse, May 2004 December 2006 Fondation Verdan, Lausanne, November 2004-March

17 A tool to test and train the imitation capabilities of autistic children Collaboration with Prof. Jaqueline Nadel Hopital de la Salpetriere, Paris, France The educator demonstrates The imitation game The autistic child is let free to play with the robot 17

18 A tool to test and train the interactivity of autistic children Collaboration with Prof. Kerstin Dautenhahn, University of Hertfordshire, London, UK Robot as a mediator, an object of joint attention 18

19 A tool to test and train the interactivity of autistic children Would the human-appearance affect the child s interaction with the robot? Robins, B., Dautenhahn, K., te Boekhorst, R. Billard, A. (2004) Effects of repeated exposure of a humanoid robot on children with autism In S.Keats, J.Clarckson, P. Langdon and P.Robinson (eds), Designing a More Inclusive World. London: Springer Verlag,

20 A tool to test and train the interactivity of autistic children Four autistic children, age 5-10, from the Enhanced Provision unit. Each child participated in about 13 trials on average. Children with autism interact much more with the non-human looking robot Robins, B, Dautenhahn, K., te Boekhorst, R. and Billard, A. (2004) Robots as Assistive Technology - Does Appearance Matter?. Proc. IEEE Ro-man 2004, 13th IEEE International Workshop on Robot and Human Interactive Communication September 20-22, 2004 Kurashiki, Okayama Japan. Best paper award - RO-MAN

21 A tool to test and train the interactivity of autistic children Eye-Gaze levels of all children Extension Study Gaze - All Children 0.6 Duration Appearance: doll plain Andy Don Billy Week 1 Andy Don Billy Week 2 Robins, B, Dautenhahn, K., te Boekhorst, R. and Billard, A. (2003) Effect of Repeated Exposure of a Humanoid Robot on Children with 21 Autism - Can we Encourage Basic Social Interaction Skills. In Proceedings of CWUATT, Best Paper Award.

22 ROBOTA S EYES Three degrees of freedom: - 1 for horizontal binocular motion - 2 for vertical motion (separate blinking) Aesthetic: all components within the head 22

23 ROBOTA S EYES 23

24 ROBOTA S VISION 2 USB Cameras VGA (640X480) 15 frames per second 24

25 NEW PROTOTYPE Articulated arm, neck and eyes with embedded cameras 25