Of Monkeys and. Nick Annetta

Similar documents
Bioscience in the 21st century

Investigation of Optimal Stimulus Type for an Auditory Based Brain-Computer Interface. Stephan Kienzle Briarcliff High School

Simultaneous Real-Time Detection of Motor Imagery and Error-Related Potentials for Improved BCI Accuracy

Restoring Communication and Mobility

Direct Control of a Computer from the Human Central Nervous System

Brain-Computer Interfaces to Replace or Repair the Injured Central Nervous System

Brain-computer interface to transform cortical activity to control signals for prosthetic arm

Neural control of motor prostheses Hansjörg Scherberger 1,2

EEG BRAIN-COMPUTER INTERFACE AS AN ASSISTIVE TECHNOLOGY: ADAPTIVE CONTROL AND THERAPEUTIC INTERVENTION

48 IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, VOL. 12, NO. 1, MARCH 2003

CSE 599E Introduction to Brain-Computer Interfacing

By Pure Thought Alone:

A High Performance Neurally-Controlled Cursor Positioning System

Carnegie Mellon University Annual Progress Report: 2011 Formula Grant

Classification of Spontaneous Motor-Related Tasks

An Overview of BMIs. Luca Rossini. Workshop on Brain Machine Interfaces for Space Applications

Encoding and decoding of voluntary movement control in the motor cortex

Reach and grasp by people with tetraplegia using a neurally controlled robotic arm

BrainLock: A Generic Mu Rhythm based Locking System

CNS*10 WORKSHOP (July 29 th ) on. Computational models for movement control and adaptation during BMI operation

The Evolution of Neuroprosthetics

Brain-Actuated Interaction

Electrocorticography-Based Brain Computer Interface The Seattle Experience

Artificial Intelligence in Brain-Machine Interface

Implantable Microelectronic Devices

Fast Simulation of Arm Dynamics for Real-time, Userin-the-loop. Ed Chadwick Keele University Staffordshire, UK.

Motor Control in Biomechanics In Honor of Prof. T. Kiryu s retirement from rich academic career at Niigata University

Neural Decoding and Applications in Bioelectronic Medicine

Control principles in upper-limb prostheses

Brain-computer interface (BCI) operation: signal and noise during early training sessions

Neural Prosthesis Seminar Series

A Brain Computer Interface System For Auto Piloting Wheelchair

Neuromotor Rehabilitation by Neurofeedback

Sabrina Jedlicka 9/20/2010 NEUROENGINEERING

Lack of muscle control (Stroke, bladder control, neurological disorders) Mechanical movement therapist assisted

Signal acquisition and analysis for cortical control of neuroprosthetics Stephen I Helms Tillery 1 and Dawn M Taylor 2,3

NIH Public Access Author Manuscript Speech Commun. Author manuscript; available in PMC 2011 April 1.

Electroencephalograms and Neuro-Rehabilitation. Hsiao-Lung Chan Dept Electrical Engineering Chang Gung University

Efficient Feature Extraction and Classification Methods in Neural Interfaces

Detection and Plotting Real Time Brain Waves

RECENTLY, there has been a surge of interest in assisting

Introduction to Computational Neuroscience

An Auditory Paradigm for Brain Computer Interfaces

Advances in BCI: A Neural Bypass Technology to Reconnect the Brain to the Body

NEUROLOGICAL injury and disease often result in the

Proceedings of Meetings on Acoustics

Combining Decoder Design and Neural Adaptation in Brain-Machine Interfaces

Making Things Happen: Simple Motor Control

Selection and parameterization of cortical neurons for neuroprosthetic control

Research Article EEG-Based Brain-Computer Interface for Tetraplegics

Electroencephalogram (EEG) Hsiao-Lung Chan Dept Electrical Engineering Chang Gung University

LETTERS. Direct control of paralysed muscles by cortical neurons. Chet T. Moritz 1, Steve I. Perlmutter 1 & Eberhard E. Fetz 1

Brain-Computer Interfaces for Neuropsychological Rehabilitation

A high-performance neural prosthesis enabled by control algorithm design

PeRsPectives. Principles of neural ensemble physiology underlying the operation of brain machine interfaces

Neurorobotics, and brain-machine interfaces. Oct. 10 th, 2006.

Grand Challenges in. EEG based Brain-Computer Interface. Shangkai Gao. Dept. of Biomedical Engineering Tsinghua University, Beijing, China

International Neuromodulation Society 14th World Congress May 25-30, 2019, Preliminary Scientific Program*

REPORT DOCUMENTATION PAGE

Peri-event Cross-Correlation over Time for Analysis of Interactions in Neuronal Firing

RECENT studies show that people can communicate by. Conversion of EEG Activity Into Cursor Movement by a Brain Computer Interface (BCI)

Feedback-Controlled Parallel Point Process Filter for Estimation of Goal-Directed Movements From Neural Signals

Neurostyle. Medical Innovation for Better Life

REHAB. News from the UPMC Institute for Rehabilitation and Research Winter Monkey see Monkey do

Neuroscience Letters

BRAIN COMPUTER interfaces that use action potentials

Error Detection based on neural signals

A Review of Brain Computer Interface

International Neuromodulation Society 14th World Congress May 25-30, 2019, Preliminary Scientific Program*

On the suitability of near-infrared (NIR) systems for next-generation brain computer interfaces

B rain-computer interfaces (BCIs) are devices that translate

Research Perspectives in Clinical Neurophysiology

An auditory brain computer interface (BCI)

REHABILITATION SYSTEM FOR PARAPLEGIC PATIENTS USING MIND- MACHINE INTERFACE; A CONCEPTUAL FRAMEWORK

ANALYSIS OF EEG FOR MOTOR IMAGERY BASED CLASSIFICATION OF HAND ACTIVITIES

Neuronal Dynamics: Computational Neuroscience of Single Neurons

Exploring the possibilities of the Emotiv Insight: discriminating between left- and right-handed responses

Biceps Activity EMG Pattern Recognition Using Neural Networks

International Journal of Engineering Science Invention Research & Development; Vol. III, Issue X, April e-issn:

The prospects of brain computer interface applications in children

Discovery ENGINEERS ASK THE BRAIN TO SAY, "CHEESE!"

Introduction to Computational Neuroscience

Introduction to Neural Prosthesis

Cognitive Neuroscience History of Neural Networks in Artificial Intelligence The concept of neural network in artificial intelligence

AUDITORY FEEDBACK OF HUMAN EEG FOR DIRECT BRAIN-COMPUTER COMMUNICATION. Thilo Hinterberger, Gerold Baier*, Jürgen Mellinger, Niels Birbaumer

Human Machine Interface Using EOG Signal Analysis

EEG Event-Related Desynchronization of patients with stroke during motor imagery of hand movement

Martha G. Garcia-Garcia 1,2, Austin J. Bergquist 2, Hector Vargas-Perez Mary K. Nagai 1,2, Jose Zariffa

MANY brain machine interface (BMI) researchers have

BME 5030 ELECTRONIC BIOINSTRUMENTATION FINAL PAPER. ELECTROCORTICOGRAPHY (ECoG) BASED BRAIN COMPUTER INTERFACE FOR CEREBRAL PALSY PATIENTS

Development of a New Rehabilitation System Based on a Brain-Computer Interface Using Near-Infrared Spectroscopy

Brain Plasticity. Brain Plasticity. Recovery from Deprivation 1/2/11. Dogma. Modern neuroscience. Deprivation can lower IQ. Deprivation reversed

Modifying the Classic Peak Picking Technique Using a Fuzzy Multi Agent to Have an Accurate P300-based BCI

The Application of EEG related

Neural Interface Technology for Rehabilitation: Exploiting and Promoting Neuroplasticity

Brain-Computer Communication and Slow Cortical Potentials

Sixth International Conference on Emerging trends in Engineering and Technology (ICETET'16) ISSN: , pp.

Bridging the Brain to the World: A Perspective on Neural Interface Systems

Chapter 2 Brain Computer Interfaces

Transcription:

Of Monkeys and Men Nick Annetta

Outline Why neuroprosthetics? Biological background 2 groups University of Reading University of Pittsburgh Conclusions

Why Neuroprosthetics? Amputations Paralysis Spinal cord injuries Stroke Neurological diseases Amyotrophic lateral sclerosis (ALS) Multiple sclerosis Muscular dystrophy Locked-in syndrome

Biological Background Image Source: [7]

2 Groups University of Reading (UK) Direct bi-directional prosthetic hand Interface with median nerve of human left arm University of Pittsburgh Indirect bi-directional control of prosthetic arm Interface with motor cortex in monkey

Reading

Electrode Array 100 electrodes 4x4 mm, 1.5mm length Image Source: [2]

Implantation Median nerve Image Source: [2]

Hardware Image Source: [1,2]

Current Source Howland configuration Single bi-phasic pulse Image Source: [1]

Results Image Source: [1]

Pittsburgh Image Source: [3]

Population Vector Firing Rate = Pop vector = Data Source: [4] Image Source: [5]

Adaptive Algorithm Cosine tuning Changes in preferred directions over time Image Source: [3,4]

Virtual Simulation Video Source: [8]

Prosthetic Testing Video Source: [8]

Finger Licking Good Video Source: [8]

Conclusions Reading Pros: sensory feedback, natural Cons: electrodes degrade, invasive, relies on functional nerves Pittsburgh Pros: directly from motor cortex Cons: electrodes degrade, extremely invasive, only visual feedback

Next Steps Sensory feedback directly to sensory cortex

References [1] Gasson M, Hutt B, Goodhew I, Kyberd P, Warwick K. Invasive neural prosthesis for neural signal detection and nerve stimulation International Journal of Adaptive Control and Signal Processing v19 No. 5 p 365-375 2005 [2] Warwick K, Gasson M, Hutt B, Goodhew I, Kyberd P, Andrews B, Teddy P, Shad A. The application of implant technology for cybernetic systems. Archives of Neurology 2003; 60(10):1369 1373. [3] Meel Velliste, Sagi Perel, M. Chance Spalding, Andrew S. Whitford & Andrew B. Schwartz, Cortical control of a prosthetic arm for self-feeding, Nature, 453, 1098-1101 (19 June 2008) [4] Helms Tillery SI, Taylor DM, Schwartz AB. Training in cortical control of neuroprosthetic devices improves signal extraction from small neuronal ensembles, Rev Neurosci. 2003;14(1-2):107-19. [5] van Hemmen L, Schwartx A. Population vector code: a geometric universal as actuator, Biological Cybernetics, vol 98, n6 2008 [6] Brain pic http://aids.hallym.ac.kr/d/kns/tutor/pns49.jpg [7] http://motorlab.neurobio.pitt.edu/multimedia.php [8] Helms Tillery, S. I., Taylor, D. M. & Schwartz, A. B. The general utility of a neuroprosthetic device under direct cortical control. Proc. 25th Annu. Int. Conf. IEEE EMBS 3, 2043 2046 (2003). [9] Schwartz, A. B. Cortical neural prosthetics. Annu. Rev. Neurosci. 27, 487 507 (2004). [10] Kennedy P, Bakay R, Moore M, Adams K, Goldwaith J. Direct control of a computer from the human central nervous system. IEEE Transactions on Rehabilitation Engineering 2000; 8:198 202. [11] Kostov A, Polak M. Parallel Man-Machine Training in Development of EEG-Based Cursor Control IEEE TRANSACTIONS ON REHABILITATION ENGINEERING, VOL. 8, NO. 2, JUNE 2000 [12] Gasson, M. Hutt, B. Goodhew, I. Kyberd, P. Warwick, K. Bi-directional human machine interface via direct neural connection Robot and Human Interactive Communication, 2002. Proceedings. 11th IEEE International Workshop on, 2002 p 265-270 [13] Adriano A, Nasuto S, Kyberd P, Sweeney-Reed C. Generative topographic mapping applied to clustering and visualization of motor unit action potentials, Biosystems, 2005, vol. 82, no3, pp. 273-284 [14] F. Babiloni, F. Cincotti, L. Lazzarini, J. Millán, J. Mouriño, M. Varsta, J. Heikkonen, L. Bianchi, M. G. Marciani, Linear Classification of Low- Resolution EEG Patterns Produced by Imagined Hand Movements, IEEE TRANSACTIONS ON REHABILITATION ENGINEERING, VOL. 8, NO. 2, JUNE 2000 [15] Birbaumer, N., Kubler, A., Ghanayim, N., Hinterberger, T., Perelmouter, J., Kaiser, J., Iversen, I., Kotchoubey, B., Neumann, N., & Flor, H. (2000). The thought translation device (ttd) for completely paralyzed patients. Rehabilitation Engineering, IEEE Transactions on, 8 (2), 190-193. [16] Robert E. Isaacs, D. J. Weber, and Aandrew B. Schwartz. Work Toward Real-Time Control of a Cortical Neural Prothesis, IEEE TRANSACTIONS ON REHABILITATION ENGINEERING, VOL. 8, NO. 2, JUNE 2000