USING ELECTROENCEPHALOGRAPHY (EEG) AND VIRTUAL REALITY (VR) TO UNDERSTAND & IMPROVE COGNITIVE PERFORMANCE.

Transcription

1 February, 15 th 2018 EPFL / Inria Workshop USING ELECTROENCEPHALOGRAPHY (EEG) AND VIRTUAL REALITY (VR) TO UNDERSTAND & IMPROVE COGNITIVE PERFORMANCE. C. JEUNET in collaboration with A. Lécuyer, F. Argelaguet (Inria Rennes), J.d.R. Millan, R. Chavarriaga (EPFL) Contact camille.jeunet@inria.fr camillejeunet.wordpress.com

2 Rationale of the Approach Understand & Improve / Cognitive Performance

3 Rationale of the Approach Understand & Improve / Cognitive Performance NEED FOR

4 Rationale of the Approach Understand & Improve / Cognitive Performance Brain Imaging Technique NEED FOR

5 Rationale of the Approach Understand & Improve / Cognitive Performance Brain Imaging Technique NEED FOR Controlled Environment

6 Rationale of the Approach Understand & Improve / Cognitive Performance Brain Imaging Technique NEED FOR Controlled Environment / EEG ElectroEncephaloGraphy / VR Virtual Reality

7 Rationale of the Approach

8 Rationale of the Approach Project #1 Understanding Cognitive Performance Using EEG & VR SENSE OF AGENCY

9 Rationale of the Approach Project #1 Project #2 Understanding Cognitive Performance Using EEG & VR Improving Cognitive Performance Using EEG & VR SENSE OF AGENCY COVERT ATTENTION

10 Project #1 SENSE OF AGENCY

11 Project #1 Theoretical Background SENSE OF EMBODIEMENT Sense of Self-Location Sense of Body-Ownership Sense of Agency

12 Project #1 Theoretical Background SENSE OF EMBODIEMENT Sense of Self-Location Sense of Body-Ownership Sense of Agency

13 Project #1 Theoretical Background Our approach: Rely on theories from psychology & philosophy Sense of Agency

14 Project #1 Theoretical Background Our approach: Rely on theories from psychology & philosophy Sense of Agency Relies on 3 principles Priority Principle Exclusivity Principle Consistency Principle Includes 2 components Feeling of Agency Judgement of Agency

15 Project #1 Sense of Agency I - Objective Assess the relevance of our approach to manipulate and measure the Sense of Agency in Virtual Environments.

16 VIDEO see HERE

17 Project #1 Sense of Agency III - Discussion Our approach enabled us to manipulate and measure the SoA Questions currently investigated: Can we measure variations of the SoA in real-time? Do all the principles impact equally the SoA? Jeunet, C., Albert, L., Argelaguet, F., & Lécuyer, A. (2018). "Do you feel in control?": Towards Novel Approaches to Characterise, Manipulate and Measure the Sense of Agency in Virtual Environments. IEEE Transactions on Visualization and Computer Graphics, 1-10.

18 Project #2 - COVERT ATTENTION

19 Project #2 - Context

20 Project #2 - Context [Biomechanics]

21 Project #2 - Context [Biomechanics] [Physiology]

22 Project #2 - Context [Biomechanics] [Physiology] [Social] [Cognition] [Psychology] [Neurophysiology]

23 Project #2 - Context [Social] [Biomechanics] [Physiology] [Mental State] [Cognition] [Psychology] [Neurophysiology]

24 Project #2 - Context How to train athletes mental state? [Social] [Biomechanics] [Physiology] [Mental State] [Cognition] [Psychology] [Neurophysiology]

25 Project #2 - Context How to train athletes mental state? Using Neurofeedback [Social] [Biomechanics] [Physiology] [Mental State] [Cognition] [Psychology] [Neurophysiology]

26 Project #2 - Context Neurofeedback Feedback Modulation Learning to self-regulate their brain activity in order to improve motor or cognitive functions Central Florida biofeedback

27 Project #2 - Context How to train athletes mental state? Using Neurofeedback [Social] [Biomechanics] [Physiology] [Mental State] [Cognition] [Psychology] [Neurophysiology]

28 Project #2 - Context What ability should be trained? [Social] [Biomechanics] [Physiology] [Mental State] [Cognition] [Psychology] [Neurophysiology]

29 Project #2 - Context What ability should be trained? Covert Visuo-Spatial Attention (CVSA) [Social] [Biomechanics] [Physiology] [Mental State] [Cognition] [Psychology] [Neurophysiology]

30 Project #2 - Approach Neurofeedback Training of CVSA [Social] [Psychology]

31 Project #2 - Approach Neurofeedback Training of CVSA Using Virtual Reality [Social] [Psychology]

32 Project #2 - Approach Neurofeedback Training of CVSA Using Virtual Reality [Social] 1. Does CVSA have specific neurophysiological correlates? [Psychology]

33 Project #2 - Approach Neurofeedback Training of CVSA Using Virtual Reality [Social] 1. Does CVSA have specific neurophysiological correlates? 2. Are the characteristics of these correlates related to performance? [Psychology]

34 Project #2 - CVSA Soccer Goalkeepers I - Objective Investigating the neurophysiological correlates of CVSA & the relationship between these correlates and performance.

35 Project #2 - CVSA Soccer Goalkeepers II - Protocol VIDEO

36 VIDEO

37 Project #2 - CVSA Soccer Goalkeepers III - Results N = 12 Lateralisation Index = Power_right Power_left

38 Project #2 - CVSA Soccer Goalkeepers III - Results 2-way ANOVA for repeated measures Time * Class interaction p < N = 12 Lateralisation Index = Power_right Power_left

39 Project #2 - CVSA Soccer Goalkeepers III - Results N = 12 Alpha (8-14Hz) power task vs. rest

40 Project #2 - CVSA Soccer Goalkeepers IV - Discussion Replication of results from the literature [Schmidt et al., 2010; Tonin et al., 2013] Questions currently investigated: Is this marker (LI) suitable for a neurofeedback training procedure? Is it measurable on a single trial basis? Does it correlate with performance or expertise? C. Jeunet, B. Bideau, F. Argelaguet, R. Chavarriaga, J. del R. Millán, A. Lécuyer & R. Kulpa, Investigating neurophysiological correlates of covert attention in soccer goalkeepers, World Conference on Science and Soccer (WCSS) 2017

41 Thank You February, 15 th 2018 EPFL / Inria Workshop USING ELECTROENCEPHALOGRAPHY (EEG) AND VIRTUAL REALITY (VR) TO UNDERSTAND & IMPROVE COGNITIVE PERFORMANCE. C. JEUNET Contact camille.jeunet@inria.fr camillejeunet.wordpress.com