Grand Challenges in. EEG based Brain-Computer Interface. Shangkai Gao. Dept. of Biomedical Engineering Tsinghua University, Beijing, China

Transcription

1 Grand Challenges in EEG based Brain-Computer Interface Shangkai Gao Dept. of Biomedical Engineering Tsinghua University, Beijing, China

2 Brain-Computer Interface, BCI BCI feedback Turning THOUGHTS into ACTIONS Leigh R. Hochberg, 1999 A brain-computer interface is a communication and control system that uses signals generated in the Central Nervous System (CNS) and does not depend on peripheral nerves or muscles. Jonathan R.Wolpaw et al., 2000

3 Brain Signals for BCI Spikes high Spatial resolution NIRS fmri MEG EEG low low Temporal resolution high

4 BCI Applications high Spatial resolution EEG based BCI Leigh Hochberg et al., 2012 low low Bin He et al., 2010 Temporal resolution high

5 IEEE Engineering in Medicine and Biology Society IEEE Trans. on NSRE (2003,2006) IEEE Trans. on BME (2004) IEEE publications of special issues on BCI/BMI IEEE Signal Processing Magazine (2008) IEEE Signal Processing Society IEEE Computational Intelligence Magazine (2009) IEEE Computational Intelligence Society IEEE Journal of Emerging and Selected Topics in Circuits and Systems (2011) IEEE Circuits and Systems Society

6 Grand challenges in EEG based BCI

7 Brain-Computer Interface Brain signals Sensory inputs Electrodes & amplifiers Wireless commu. Signal processing Clinical population System Feedback Feature extraction Healthy population device control Pattern classification 1. Neuroscience 2. Engineering 3. Applications

8 Grand Challenge (1) ( Neuroscience )

9 Grand challenges (1) - Neuroscience Brain Signals Attention + Mental task Tempral spacial patterns Visual Auditory Tactile External stimulus Cognition Perception Sensation t /ms

10 Grand challenges (1) - Neuroscience Brain Adaptation Variability of brain status Brain signal generation intent control Skill learning feedback

11 Grand Challenge (2) ( Engineering )

12 Grand challenges (2) - Engineering Preprocessing BCI System Signal processing Feature extraction Software Classification Data acquisition Hardware Command output Feedback

13 Grand challenges (2) - Engineering 1 Signal Acquisition (Hardware) Portability & wearability ATCOMAART Neurosky 2 Wireless communication Electric Geodesics, Inc. IMEC-NL

14 Grand challenges (2) - Engineering Signal Acquisition (Hardware) 3 Dry electrode Conductive gel Matthews g.tec Randy Montoya, 2012 Liao Cristian 4 Multiple subjects Tsinghua University

15 Grand challenges (2) - Engineering Signal Processing (Software) EEG Signals EEG Obstacles: Low signal to noise ratio Low spatial resolution millions of neurons Strong artifacts (e.g. eye movements, line noise, cable movements )

16 Grand challenges (2) - Engineering Signal Processing (Software) System Co-adaptation intent Biological Human intelligence brain system Artificial BCI intelligence controller system external device COMPLEX intelligence system

17 Grand Challenge (3) ( Applications )

18 Grand challenges (3) - Application BCI Applications for Clinical Population Communication Control Rehabilitation

19 Grand challenges (3) - Application Amyotrophic Lateral Sclerosis (ALS) - locked -in 30,000 Americans have ALS. ~5,600 people are diagnosed each year. Scott Mackler ~15 new cases per day. Kathryn Levy Feldman, 2009

20 Grand challenges (3) - Application Stephen Hawking: communicating via brain waves!

21 Grand challenges (3) - Application BCI based Neural Rehabilitation Brain-Computer Interface + Functional Electric Stimulus Tsinghua University & Hong Kong Polytechnic University

22 Grand challenges (3) - Application BCI Applications for Healthy Population Mental state monitoring Consumer neuroscience User authentication Entertainment

23 Grand challenges (3) - Application Mental State Monitoring Mind reading for faster reactions in emergency situations Stefan Haufe et al., 2011

24 Grand challenges (3) - Application BCI Applications Consumer Neuroscience Measuring Emotion in Advertising Research Silberstein and Nield, 2012 Recording Brain Waves at the Supermarket Sands and Sands, 2012

25 Grand challenges (3) - Application User Authentication from Pass-word to Pass-thoughts Pass-thoughts: Authenticating with minds Julie Thorpe,P.C. van Oorschot,Anil Somayaji

26 Grand challenges (3) - Application Games Brent J. Lance, 2012 Uncle Milton Inc. Brent J. Lance, 2012 E. C. Lalor, 2005

27 Grand challenges (3) - Application Extensions of BCI Combine with physiological signals or other Devices Readout of cognitive state without requiring voluntary control Effectively fuse brain activities of a group of people Support the uses by individuals in everyday life Hybrid BCI Passive BCI Collaborative BCI Augmented BCI Original BCI

28 Summary BCIs impact many aspects of modern life. Applications Paralyzed patients Fundamental neuroscience research Mental status monitoring Neural rehabilitation Cognitive state assessment Mind control games Consumer neuroscience User authentication Human computer interaction BCI Neuroscience Engineering

29 Summary ( Future perspectives ) BCI feedback BCI technology is still in its infancy. The grand challenges are in front of us. Neuroscience Engineering Applications The breakthrough of BCI technologies needs the collaborative efforts of multidisciplinary scientists.

30 Acknowledgements Colleagues: Xiaorong Gao Bo Hong Former Graduate Students: Yijun Wang Guangyu Bin Dan Zhang Honglai Xu Wei Wu Grant support: National Nature Science Foundation of China Ministry of Science and Technology of China Graduate Students: Tianyi Qian Yun Li Xiaoshan Huang Peng Yuan