Pupil Dilation as an Index of Learning
|
|
- Claribel Jenkins
- 6 years ago
- Views:
Transcription
1 PROCEEDINGS of the HUMAN FACTORS and ERGONOMICS SOCIETY 55th ANNUAL MEETING Pupil Dilation as an Index of Learning Ciara Sibley 1, Joseph Coyne 1, Carryl Baldwin 2 1 Naval Research Laboratory, Washington, DC 2 George Mason University, Fairfax, VA Physiological assessment of cognitive processes has become a topic of increased interest. The value of understanding and measuring brain function at work has the potential to improve performance. The emphasis of this paper is to discuss how pupil diameter can be applied to learning. The link between pupil diameter and task difficulty, or cognitive load, has been repeatedly demonstrated for the past 40 years. However there has been little work to date on measuring cognitive load during training or looking at how real time metrics of cognitive load could be used to adapt training. According to Cognitive Load Theory, cognitive load should be reduced as an individual learns a task and he/she relies more on long term memory than working memory. Ten participants completed a simulated unmanned aerial vehicle task in which they had to identify targets and report their direction of movement. There were three levels of increased difficulty. As expected, pupil diameter significantly dropped within each block as participants learned the task, and then increased again at the start of the next level of difficulty. The results suggest that pupil diameter may be a useful metric for assessing when an individual has transferred information into long term memory. Implications for how pupil diameter can be used to drive an adaptive training system are discussed. Not subject to U.S. copyright restrictions DOI / INTRODUCTION Neurophysiological measurement affords a unique opportunity to understand the interaction between working memory utilization and skill development. The ability to track workload in real time during training could provide insight into when an individual has acquired a new skill and then be used to advance training. Although a number of sensors have been used for measuring workload e.g., EEG, fnir, EKG), this study focuses on pupillometry. The ability of modern eye trackers to monitor pupillometry and eye movements without requiring the operator or learner to be fitted with any surface contact equipment makes it one of the most unobtrusive neurophysiological recording systems available. Numerous researchers have found changes in pupil diameter, divergence, fixation duration, and blink frequency to be predictive of various levels of cognitive demand in a task de Greef, Lafeber, Oostendorp, Lindenberg, 2009; Tsai, Viirre, Strychacz, Chase, Jung, 2007; Van Orden, Limbert, Makeig, Jung, 2001; Veltman Gaillard, 1996). In particular, the link between pupil dilation and task difficulty, with increasing tasks demands being associated with larger pupillary dilations, has been well established Beatty Kahneman, 1966; Marshall, 2007; Moresi et al., 2008; Siegle, Steinhauer, Stenger, Konecky, Carter, 2003; Van Orden et al., 2001). Siegle et al. 2003) showed that pupil dilation increased parametrically with a working memory task digit sorting) both inside and outside an fmri machine. Additionally, concurrent activation of the middle frontal gyrus, which has been associated with central executive and high demand functions Spinks, Zhang, Fox, Gao, Hai Tan, 2004) was shown during the time course of pupil dilation. Pupil diameter has also been found to be linked to motivation. Heitz et al. 2008) hypothesized that individual differences in working memory span performance were largely influenced by motivation. Specifically, that individuals with a low working memory span would be less motivated to perform. Heitz provided a performance-based financial incentive during a working memory task of multiple levels of difficulty, and compared high and low span individuals under rewarded and un-rewarded conditions. Results confirmed that pupil diameter significantly increased as the task increased in difficulty, and that significant increases in pupil diameter occurred when a financial incentive was provided. The present study investigates the use of pupil diameter as a means of assessing cognitive load during a training task. Classifying working memory or cognitive load during training presents unique challenges. By virtue of the fact that people are learning a task or skill, working memory demand is expected to change with increased experience and familiarization with a certain difficulty level. That is, cognitive load would not be expected to be static across a given level of task difficulty. But rather, as the learner develops skills and
2 PROCEEDINGS of the HUMAN FACTORS and ERGONOMICS SOCIETY 55th ANNUAL MEETING associated improved performance strategies, cognitive load would be expected to decline within a given task difficulty level. Further, the presentation of the various difficulty levels can t be randomly assigned because learners can t be expected to perform a more difficult version of the task until they have mastered the easier levels. Although physiologically driven metrics of cognitive workload have been used on stable tasks i.e., learned tasks) they have not been heavily investigated during learning. The present experiment examined the potential for pupil diameter to provide a sensitive index of cognitive workload as an individual learned two UAV tasks of increasing difficulty. The ultimate goal of this research effort is to establish the groundwork for automating methods for monitoring cognitive resource utilization during learning. Previous work Sibley et al., 2010) has shown that pupil diameter is sensitive to increasing difficulty levels of a task, when the overall pupil size of the participant is averaged over an entire block of difficulty. This research also showed that pupil size was even greater during the periods of mental calculation, compared to the pupil size during the rest of the trial. For this most recent effort, it was hypothesized that pupil diameter would be sensitive to cognitive effort within a specific task difficulty level as the learner became more proficient with the task). Specifically, we hypothesized that pupil diameter would be highest during the periods of greatest mental effort, but that it would decrease with experience or practice at a specific difficulty level. METHOD a high-fidelity, three-dimensional virtual training system used for military training exercises. In addition, the Tobii X120 off the head unit was used to collect eye tracking data. The unit sat in front of the participant and just below the surface of the monitor running the simulation. The system recorded both eyes at 60 samples per second. Neuroscan was used to collect EEG data at 500 samples per second. EEG data however is not considered in this paper. UAV Desktop Simulation After receiving a brief PowerPoint training about the task, participants engaged in a UAV desktop simulation in which he or she was trained to report information on moving vehicles as seen from a UAV see Figure 1). Participants were asked to identify and report heading information about the target vehicles crossing the screen. At the beginning of each experimental block, participants were given ten seconds to study a picture of each vehicle at four different views bird s eye, left side, right side, and front-on). Participants were expected to learn to recognize each vehicle by name ID task). An example of one of the vehicles is shown in Figure 2. For each experimental trial, participants were given the heading of the UAV and were asked to estimate the heading of the vehicle on the ground heading task). A graphical depiction of a compass facing due north with 30 degree increments was provided to the participant for reference. After entering the target heading estimation and the identity of the target, participants were then asked to rate their perceived mental effort in calculating the target heading and identifying the target. Participants Fifteen participants 4 male) ranging from years of age M= 22, SD= 6.2) participated in the experiment. Participants were volunteers from the George Mason University who gave informed consent to engage in a UAV training simulation experiment in exchange for course credit. Five additional participants data were excluded due to inadvertent problems with missing data. Additionally, data for one of the participants was excluded specifically in the ID analysis, due very low performance on each of the blocks. Data from that specific participant was however able to be included in the heading task analysis. Figure 1. Interface for the experiment Materials Virtual Battlespace 2 VBS2) was used to construct simulated UAV video files that were played back in a separate application created for this experiment. VBS2 is
3 PROCEEDINGS of the HUMAN FACTORS and ERGONOMICS SOCIETY 55th ANNUAL MEETING hours, including EEG preparation, eye tracking calibration, training and experimental trials. After being prepped for EEG, participants reviewed a PowerPoint training on the task and then began the experiment. All participants completed blocks one, two and three in the same order from easiest to hardest. RESULTS Figure 2. Example picture of an M1A1 that participants were shown and then expected to recognize by name The difficulty of the task progressed over three blocks of trials. Only one vehicle was shown on the screen at a time and there were a maximum of 20 trials per block. Once the participant had reached an 80% ID accuracy after at least ten trials, he or she would be moved to the next level of difficulty. Participants also could transition to the next heading difficulty level if they reached a certain performance threshold. Participants could progress to the next level of the ID task without moving to the next level of the heading task, and vice versa, but after 20 trials, the participant would be forced to the next difficulty level. Difficulty of the heading task was manipulated by varying the UAV heading as well as the possible target heading. Additionally, the ID task difficulty was manipulated by increasing the number of vehicles the participant learned for each block from two to four to six. For example, the easiest level block one) showed the UAV heading at only 0 degrees and the target heading s were randomized in 30 degree increments. During the easiest level of the ID task participants were only expected to learn two vehicles. The most difficult level block three) showed the UAV heading at any 30 degree increment and changed after each target, and the target heading could also be any 30 degree increment. During the most difficult level of the ID task, participants were presented with six vehicles and were expected to recognize all six of them by name. The Experiment Written informed consent was obtained from all participants and the participants were then introduced to the experimental tasks. This experiment took place over one day with a duration of approximately two to three The researchers considered the most cognitively demanding parts of the simulation to be during the target heading calculation and the ID task. Therefore, this analysis primarily focused on the pupillometry data during these tasks. The data was broken up into sections/tasks in order to compare pupil dilation during the high demand parts of the task to other less demanding parts. Additionally, in order to investigate the affect of learning on pupil dilation, the first and last three trials of each difficulty block were analyzed and compared to each other. We hypothesized that as the participant began to learn the material, it would become less challenging throughout that difficulty block, and that his/her pupil size would get closer to baseline levels decrease) towards the end of the block, i.e. the last three trials of each block. We also hypothesized that the performance data would show the same pattern, with performance increasing towards the end of each block, as the participant learned and became more proficient at each level of difficulty. Maximum Pupil Size and Difference Scores To best capture the exact period of mental effort during the heading calculation task, we took the maximum pupil size an average of the top five pupil sizes, in order to reduce the effect of outliers) during each trial of the ID and heading tasks. Difference scores were then calculated for pupil dilation by averaging each individual s pupil size during a baseline period of each trial when no mental effort should have been expended. The average of this pupil size was then subtracted from the maximum pupil size during each individual trial. This was done in order to show change from the baseline pupil size and to reduce factors caused by individual variability i.e. an effect being driven by one individual with large pupils). Positive scores mean that the pupil size was greater than baseline, while negative scores would indicate pupil size was smaller than baseline. Figure 3 shows the average pupil size difference scores during the heading task for each block, during the average of the first and last three trials. One may observe not only that pupil size is far above baseline baseline being zero), but also that that pupil size attenuates towards the end of each block and then jumps back up at
4 T S Q P O N ^ P PROCEEDINGS of the HUMAN FACTORS and ERGONOMICS SOCIETY 55th ANNUAL MEETING the beginning of the next difficulty block. This pattern similarly corresponds with performance data figure 4) where the participants performance becomes significantly better towards the end of each block. + ) * * % $ "!, -. / / 4 5 / / : 7 ; < 7 5 < = : 7 >? A / ; B 7 - C / ; D E - > F E : / - 4 > Figure 3. Maximum pupil difference size is highest at the beginning of the new block of difficulty and then attenuates with learning R B 7 - C / ; D U : : = : V A / ; - ; C W < : = > > X 4 = < F > K L I Y Z K J K L I Y Z K J Figure 4. Heading performance data follows the same trend as pupil data, showing participants error reducing by the end of each block A two-way trial placement x block) repeated measures ANOVA was conducted to compare the pupil size during the heading task for the first three trials to the last three trials across each block. There was a significant difference in pupil size between the first three trials of each block M=0.44, SD= 0.16) compared to the last three trials of each block M=0.36, SD= 0.14), F1, 9) = 23.37, p= The same difference was found in the heading performance data between the first three trials of each block M=39.44, SD=42.60) and the last three trials of each block M=8.22, SD=12.09), F1,9)= 19.26, p= A two-way trial placement x block) repeated measures ANOVA was also conducted for the ID task and showed a significant difference in pupil size between the first three trials of each block M= 0.35, SD= 0.17) and the last three trials of each block M=0.28, SD= 0.20), F1, 8)= 9.66, p=0.01. A significant difference was also found between the ID accuracy of the first three trials of each block M=0.54, SD=0.31) and the last three trials of each block M=0.70, SD=0.40), F1,8)= 10.56, p= ) * * % $ "!, -. / / 4 5 / / : 7 ; < 7 5 < = : 7 >? A / ; [ 8 E - > F E : / - 4 > Figure 5. Maximum pupil difference size is highest at the beginning of the new block of difficulty, and then attenuates with learning ] \ [ 8 W < < 1 : - < : _ V A / ; - ; C W < : = > > X 4 = < F > ` a L b ` Z Figure 6. ID accuracy performance data follows the same trend as pupil data, showing participants accuracy increasing by the end of each block
5 PROCEEDINGS of the HUMAN FACTORS and ERGONOMICS SOCIETY 55th ANNUAL MEETING DISCUSSION Analysis of pupil dilation data shows systematic changes in pupil size with practice on a task. Findings confirmed our hypothesis that pupil size would peak at the beginning of each difficulty block and then decrease as the individual learned the task. This is also supported with performance data showing participants improving towards the end of each difficulty block. These findings are consistent with Cognitive Load Theory suggesting that when an individual has learned a task the amount of effort that he/she needs to expend reduces as information is transferred from working memory into long-term memory. We speculate that the attenuation in pupil size is related with the transfer of information into long term memory. This systematic change in pupillometry could potentially provide the ability to assess whether an individual has learned a task and does not need to expend as much effort in order to complete that task effectively. The applications for this finding are numerous. For example, one could identify individuals who are able to successfully complete a task with little effort and assign them to certain tasks in which he/she will excel. This could also be used to ascertain whether an individual is struggling to complete a task or could be given an additional task to perform. Furthermore, pupillometry metrics could be used in situations where performance measures are not available. This could also be very beneficial information to have for setting the pace to train an individual on a novel task. More research needs to be conducted to investigate the feasibility of using pupillometry to assess learning and cognitive load. This sample size was rather small N= 10) and thus more research needs to be done to replicate these findings and to help tune algorithms for use in the real world and closed-loop systems. We believe that by analyzing a combination of tonic and phasic changes in pupillometry data, as well as performance data, we should be able to improve conventional training systems that either do not account for learning, or base learning on performance measures alone. Augmented Cognition. Neuroergonomics and Operational Neuroscience: Held as Part of HCI International Marshall, S. P. 2007). Identifying cognitive state from eye metrics. Aviation Space and Environmental Medicine, 785), B165-B175. Moresi, S., Adam, J. J., Rijcken, J., Van Gerven, P. W. M., Kuipers, H., Jolles, J. 2008). Pupil dilation in response preparation. International Journal of Psychophysiology, 672), Siegle, G. J., Steinhauer, S. R., Stenger, V. A., Konecky, R., Carter, C. S. 2003). Use of concurrent pupil dilation assessment to inform interpretation and analysis of fmri data. Neuroimage, 201), Sibley, C., Coyne, J. T., Cole, A., Gibson, G., Baldwin, C. L., Roberts, D., Barrow, J. 2010). Adaptive training in an Unmanned Aerial Vehicle: Examination of several candidate real-time metrics. In W, Karwowski and G. Salvendy, Eds.), Applied Human Factors and Ergonomics, Boca Raton, FL: Taylor Francis. Spinks, J. A., Zhang, J. X., Fox, P. T., Gao, J.-H., Hai Tan, L. 2004). More workload on the central executive of working memory, less attention capture by novel visual distractors: evidence from an fmri study. NeuroImage, 232), Tsai, Y. F., Viirre, E., Strychacz, C., Chase, B., Jung, T. P. 2007). Task performance and eye activity: Predicting behavior relating to cognitive workload. Aviation Space and Environmental Medicine, 785 II). Van Orden, K. F., Limbert, W., Makeig, S., Jung, T.- P. 2001). Eye Activity Correlates of Workload during a Visuospatial Memory Task. Human Factors, 431), 111. Veltman, J. A., Gaillard, A. W. K. 1996). Physiological indices of workload in a simulated flight task. Biological Psychology, 423), REFERENCES Beatty, J., Kahneman, D. 1966). Pupillary changes in two memory tasks. Psychonomic Science, 510), de Greef, T., Lafeber, H., Oostendorp, H., Lindenberg, J. 2009). Eye Movement as Indicators of Mental Workload to Trigger Adaptive Automation. Paper presented at the Proceedings of the 5th International Conference on Foundations of
Prestimulus Alpha as a Precursor to Errors in a UAV Target Orientation Detection Task
Prestimulus Alpha as a Precursor to Errors in a UAV Target Orientation Detection Task Carryl Baldwin 1, Joseph T. Coyne 2, Daniel M. Roberts 1, Jane H. Barrow 1, Anna Cole 3, Ciara Sibley 3, Brian Taylor
More informationPupillary Response Based Cognitive Workload Measurement under Luminance Changes
Pupillary Response Based Cognitive Workload Measurement under Luminance Changes Jie Xu, Yang Wang, Fang Chen, Eric Choi National ICT Australia 1 University of New South Wales jie.jackxu@gmail.com, {yang.wang,
More informationTake another look: Pupillometry and cognitive processing demands
Take another look: Pupillometry and cognitive processing demands Christine A. Dollaghan Raúl Rojas Jana A. Mueller University of Texas at Dallas Callier Center for Communication Disorders November 19,
More informationMENTAL WORKLOAD AS A FUNCTION OF TRAFFIC DENSITY: COMPARISON OF PHYSIOLOGICAL, BEHAVIORAL, AND SUBJECTIVE INDICES
MENTAL WORKLOAD AS A FUNCTION OF TRAFFIC DENSITY: COMPARISON OF PHYSIOLOGICAL, BEHAVIORAL, AND SUBJECTIVE INDICES Carryl L. Baldwin and Joseph T. Coyne Department of Psychology Old Dominion University
More informationUsing the method of adjustment to enhance collision warning perception
Using the method of adjustment to enhance collision warning perception Jesse L. Eisert, Bridget A. Lewis, & Carryl L. Baldwin Psychology, George Mason Univeristy, Fairfax, Virginia, USA The psychophysical
More informationA FIELD STUDY ASSESSING DRIVING PERFORMANCE, VISUAL ATTENTION, HEART RATE AND SUBJECTIVE RATINGS IN RESPONSE TO TWO TYPES OF COGNITIVE WORKLOAD
A FIELD STUDY ASSESSING DRIVING PERFORMANCE, VISUAL ATTENTION, HEART RATE AND SUBJECTIVE RATINGS IN RESPONSE TO TWO TYPES OF COGNITIVE WORKLOAD Yan Yang, Bryan Reimer, Bruce Mehler & Jonathan Dobres The
More informationIntegrating Psychophysiological Measures of Cognitive Workload and Eye Movements to Detect Strategy Shifts 1
Integrating Psychophysiological Measures of Cognitive Workload and Eye Movements to Detect Strategy Shifts 1 Sandra P. Marshall C. W. Pleydell-Pearce B.T. Dickson San Diego State University University
More informationUsing Task-induced Pupil Diameter and Blink Rate to Infer Cognitive Load
Using Task-induced Pupil Diameter and Blink Rate to Infer Cognitive Load Running Head: Using Task-induced Pupil Diameter and Blink Rate to Infer Cognitive Load ABSTRACT Minimizing user cognitive load is
More informationEYE MOVEMENTS DURING VISUAL AND AUDITORY TASK PERFORMANCE
NAVAL HEALTH RESEARCH CENTER EYE MOVEMENTS DURING VISUAL AND AUDITORY TASK PERFORMANCE E. Viirre K. Van Orden S. Wing B. Chase C. Pribe V. Taliwal J. Kwak Report No. 04-04 Approved for public release;
More informationSupporting Information: Cognitive capacities for cooking in chimpanzees Felix Warneken & Alexandra G. Rosati
Supporting Information: Cognitive capacities for cooking in chimpanzees Felix Warneken & Alexandra G. Rosati Subject Information Name Sex Age Testing Year 1 Testing Year 2 1 2 3 4 5a 5b 5c 6a 6b 7 8 9
More informationEye Movements, Perceptions, and Performance
Eye Movements, Perceptions, and Performance Soussan Djamasbi UXDM Research Laboratory Worcester Polytechnic Institute djamasbi@wpi.edu Dhiren Mehta UXDM Research Laboratory Worcester Polytechnic Institute
More informationModeling and Implementing an Adaptive Human-Computer Interface Using Passive Biosensors
ing and Implementing an Adaptive Human-Computer Interface Using Passive Biosensors Curtis S. Ikehara, David N. Chin and Martha E. Crosby University of Hawaii at Manoa Department of Information and Computer
More informationImproving Individual and Team Decisions Using Iconic Abstractions of Subjective Knowledge
2004 Command and Control Research and Technology Symposium Improving Individual and Team Decisions Using Iconic Abstractions of Subjective Knowledge Robert A. Fleming SPAWAR Systems Center Code 24402 53560
More informationPupil Dilation as an Indicator of Cognitive Workload in Human-Computer Interaction
Pupil Dilation as an Indicator of Cognitive Workload in Human-Computer Interaction Marc Pomplun and Sindhura Sunkara Department of Computer Science, University of Massachusetts at Boston 100 Morrissey
More informationResearch Review: Multiple Resource Theory. out in multi-task environments. Specifically, multiple display layout and control design
Research Review: Multiple Resource Theory Relevance to HCI Multiple resource theory is a framework for predicting effects on performance when multiple tasks are concurrently executed. These predictions
More informationDetecting Cognitive States Using Machine Learning
Detecting Cognitive States Using Machine Learning Xuerui Wang & Tom Mitchell Center for Automated Learning and Discovery School of Computer Science Carnegie Mellon University xuerui,tom.mitchell @cs.cmu.edu
More informationEffects of Valence and Arousal on Working Memory Performance in Virtual Reality Gaming
2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII) Effects of Valence and Arousal on Working Memory Performance in Virtual Reality Gaming Daniel Gabana, Laurissa
More informationAugmented Cognition to enhance human sensory awareness, cognitive functioning and psychic functioning: a research proposal in two phases
Augmented Cognition to enhance human sensory awareness, cognitive functioning and psychic functioning: a research proposal in two phases James Lake MD (egret4@sbcglobal.net) Overview and objectives Augmented
More informationREACTION TIME MEASUREMENT APPLIED TO MULTIMODAL HUMAN CONTROL MODELING
XIX IMEKO World Congress Fundamental and Applied Metrology September 6 11, 2009, Lisbon, Portugal REACTION TIME MEASUREMENT APPLIED TO MULTIMODAL HUMAN CONTROL MODELING Edwardo Arata Y. Murakami 1 1 Digital
More informationVerbal-Spatial Cue Conflict: Implications for the Design of Collision-Avoidance Warning Systems
University of Iowa Iowa Research Online Driving Assessment Conference 2009 Driving Assessment Conference Jun 24th, 12:00 AM Verbal-Spatial Cue Conflict: Implications for the Design of Collision-Avoidance
More informationPupil Responses during Discrete Goal-directed Movements
Pupil Responses during Discrete Goal-directed Movements Xianta Jiang 1,2 M. Stella Atkins 2 Geoffrey Tien 2 Roman Bednarik 3 Bin Zheng 4 1 Zhejiang University, Hangzhou, China, jxt@zju.edu.cn 2 Simon Fraser
More informationControlled Experiments
CHARM Choosing Human-Computer Interaction (HCI) Appropriate Research Methods Controlled Experiments Liz Atwater Department of Psychology Human Factors/Applied Cognition George Mason University lizatwater@hotmail.com
More informationAC : USABILITY EVALUATION OF A PROBLEM SOLVING ENVIRONMENT FOR AUTOMATED SYSTEM INTEGRATION EDUCA- TION USING EYE-TRACKING
AC 2012-4422: USABILITY EVALUATION OF A PROBLEM SOLVING ENVIRONMENT FOR AUTOMATED SYSTEM INTEGRATION EDUCA- TION USING EYE-TRACKING Punit Deotale, Texas A&M University Dr. Sheng-Jen Tony Hsieh, Texas A&M
More informationToward Meaningful Human Control of Autonomous Weapons Systems Through Function Allocation
1 Toward Meaningful Human Control of Autonomous Weapons Systems Through Function Allocation Marc Canellas* (Presenter) and Rachel Haga Cognitive Engineering Center, School of Aerospace Engineering, Georgia
More informationTESTING THE EFFICIENCY AND EFFECTIVENESS OF SOLDIER PERFORMANCE UNDER INCREASING TASK DEMAND
PROCEEDINGS of the HUMAN FACTORS AND ERGONOMICS SOCIETY 49th ANNUAL MEETING 2005 2119 TESTING THE EFFICIENCY AND EFFECTIVENESS OF SOLDIER PERFORMANCE UNDER INCREASING TASK DEMAND K.A. Burke, J. Szalma,
More informationThe Effect of Stress on Cognitive Load Measurement
The Effect of Stress on Cognitive Load Measurement Dan Conway *1,2, Ian Dick *1,3, Zhidong Li 1,4, Yang Wang 1, Fang Chen 1,4 1 NICTA, NSW 2015, Australia 2 University of Newcastle, NSW 2308, Australia
More informationSupplementary Figure 1. Example of an amygdala neuron whose activity reflects value during the visual stimulus interval. This cell responded more
1 Supplementary Figure 1. Example of an amygdala neuron whose activity reflects value during the visual stimulus interval. This cell responded more strongly when an image was negative than when the same
More informationMeasuring Focused Attention Using Fixation Inner-Density
Measuring Focused Attention Using Fixation Inner-Density Wen Liu, Mina Shojaeizadeh, Soussan Djamasbi, Andrew C. Trapp User Experience & Decision Making Research Laboratory, Worcester Polytechnic Institute
More informationWorkload Assessment for Mental Arithmetic Tasks using the Task-Evoked Pupillary Response
Delft University of Technology Workload Assessment for Mental Arithmetic Tasks using the Task-Evoked Pupillary Response G. Marquart 2 Workload Assessment for Mental Arithmetic Tasks using the Task-Evoked
More informationAmy Kruse, Ph.D. Strategic Analysis, Inc. LCDR Dylan Schmorrow USN Defense Advanced Research Projects Agency
What can modern neuroscience technologies offer the forward-looking applied military psychologist? Exploring the current and future use of EEG and NIR in personnel selection and training. Amy Kruse, Ph.D.
More informationWeb Usability Testing With Concurrent fnirs and Eye Tracking
Chapter 30 Web Usability Testing With Concurrent fnirs and Eye Tracking Siddharth Bhatt 1, Atahan Agrali 1, Kevin McCarthy 1, Rajneesh Suri 1, Hasan Ayaz 1,2,3 1 Drexel University, Philadelphia, PA, United
More informationA Comparison of Baseline Hearing Thresholds Between Pilots and Non-Pilots and the Effects of Engine Noise
DOT/FAA/AM-05/12 Office of Aerospace Medicine Washington, DC 20591 A Comparison of Baseline Hearing Thresholds Between Pilots and Non-Pilots and the Effects of Engine Noise Dennis B. Beringer Howard C.
More informationEVALUATION OF DRUG LABEL DESIGNS USING EYE TRACKING. Agnieszka Bojko, Catherine Gaddy, Gavin Lew, Amy Quinn User Centric, Inc. Oakbrook Terrace, IL
PROCEEDINGS of the HUMAN FACTORS AND ERGONOMICS SOCIETY 9th ANNUAL MEETING 00 0 EVALUATION OF DRUG LABEL DESIGNS USING EYE TRACKING Agnieszka Bojko, Catherine Gaddy, Gavin Lew, Amy Quinn User Centric,
More informationA peer-reviewed version of this preprint was published in PeerJ on 12 August 2015.
A peer-reviewed version of this preprint was published in PeerJ on 12 August 2015. View the peer-reviewed version (peerj.com/articles/cs-16), which is the preferred citable publication unless you specifically
More informationPupil dilations during target-pointing respect Fitts Law
Pupil dilations during target-pointing respect Fitts Law Xianta Jiang M. Stella Atkins Geoffrey Tien Simon Fraser University Bin Zheng University of Alberta Roman Bednarik University of Eastern Finland
More informationAutomatic Multimodal Cognitive Load Measurement (AMCLM)
Final Project Report Grant AOARD-10-4029 Automatic Multimodal Cognitive Load Measurement (AMCLM) June 2011 NICTA DSIM Team Executive Summary This report summarizes the research activities, results of the
More informationInfluence of Agent Type and Task Ambiguity on Conformity in Social Decision Making
Proceedings of the Human Factors and Ergonomics Society 2016 Annual Meeting 313 Influence of Agent Type and Task Ambiguity on Conformity in Social Decision Making Nicholas Hertz & Eva Wiese George Mason
More informationPupil dilation accuracy in the prediction of random events. The name, affiliation, and address for the lead experimenter(s) for the study:
KPU Registry ID Number: 1001 Date Initially Submitted: 26NOV2012 11/25/2012 The title or name of the experiment: Pupil dilation accuracy in the prediction of random events The name, affiliation, and email
More informationMental State Sensing and the Goal of Circuit-Synapse Synergy
Mental State Sensing and the Goal of Circuit-Synapse Synergy Patrick L. Craven, Ph.D. Senior Member, Engineering Staff Advanced Technology Laboratories Cherry Hill, NJ Goals of Artificial Intelligence
More informationQuantitative Performance Assessment Studies in Air Transportation
Quantitative Performance Assessment Studies in Air Transportation Portable Brain Activity Monitoring Technology Kurtulus Izzetoglu, PhD Drexel University Optical Brain Imaging Group Drexel University,
More informationDevelopment of methods for the analysis of movement and orientation behaviour in wayfinding tasks based on the case study mirror maze
Development of methods for the analysis of movement and orientation behaviour in wayfinding tasks based on the case study mirror maze Sven Heinsen University of Hamburg sven.heinsen@uni-hamburg.de Abstract:
More informationPersistent Visual Tracking and Accurate Geo-Location of Moving Ground Targets by Small Air Vehicles
Persistent Visual Tracking and Accurate Geo-Location of Moving Ground Targets by Small Air Vehicles Michael Dille, Ben Grocholsky, Stephen Thomas Nuske EXTENDED ABSTRACT 1 Motivation, Problem Statement,
More informationAnalysis of Glance Movements in Critical Intersection Scenarios
Analysis of Glance Movements in Critical Intersection Scenarios Marina Plavši, Klaus Bengler, Heiner Bubb Lehrstuhl für Ergonomie Technische Universität München 85747 Garching b. München, Germany ABSTRACT
More informationEffects of Cognitive Load on Processing and Performance. Amy B. Adcock. The University of Memphis
Effects of Cognitive Load 1 Running Head: Effects of Cognitive Load Effects of Cognitive Load on Processing and Performance Amy B. Adcock The University of Memphis Effects of Cognitive Load 2 Effects of
More informationMCAS Equating Research Report: An Investigation of FCIP-1, FCIP-2, and Stocking and. Lord Equating Methods 1,2
MCAS Equating Research Report: An Investigation of FCIP-1, FCIP-2, and Stocking and Lord Equating Methods 1,2 Lisa A. Keller, Ronald K. Hambleton, Pauline Parker, Jenna Copella University of Massachusetts
More informationCLOSED-LOOP ATTENTION MANAGEMENT: USING AUGMENTED COGNITION TO SUSTAIN VIGILANCE
CLOSED-LOOP ATTENTION MANAGEMENT: USING AUGMENTED COGNITION TO SUSTAIN VIGILANCE Mark St. John* & Matthew R. Risser Pacific Science & Engineering Group, Inc. San Diego, CA 92121 USA ABSTRACT Vigilance
More informationSpontaneous and reflexive eye activity measures of mental workload
Spontaneous and reflexive eye activity measures of mental workload Author L. Neumann, David, V. Lipp, Ottmar Published 2002 Journal Title Australian Journal of Psychology DOI https://doi.org/10.1080/00049530412331312764
More informationSee highlights on pages 1-4
See highlights on pages 1-4 Foyle, D.C., McCann, R.S., Sanford, B.D. and Schwirzke, M.F.J. (1993). Proceedings of the Human Factors and Ergonomics Society 37th Meeting, 1340-1344. ATTENTIONAL EFFECTS WITH
More informationEye-tracking technology in low vision: implications for functional diagnosis and rehabilitation
Eye-tracking technology in low vision: implications for functional diagnosis and rehabilitation Chairs: Johan Pel Bård Dalhoi Dr.ir. Johan Pel is assistant professor at the department of Neuroscience,
More informationUnderstanding Consumers Processing of Online Review Information
Understanding Consumers Processing of Online Review Information Matthew McNeill mmcneil@clemson.edu Nomula Siddarth-Reddy snomula@clemson.edu Dr. Tom T. Baker Clemson University School of Marketing 234
More informationI just didn t see it It s all about hazard perception. Dr. Robert B. Isler Associate Professor School of Psychology University of Waikato Hamilton
I just didn t see it It s all about hazard perception Dr. Robert B. Isler Associate Professor School of Psychology University of Waikato Hamilton Brake Professional Webinar, Tuesday 14 March 2017 New Zealand
More informationVERDIN MANUSCRIPT REVIEW HISTORY REVISION NOTES FROM AUTHORS (ROUND 2)
1 VERDIN MANUSCRIPT REVIEW HISTORY REVISION NOTES FROM AUTHORS (ROUND 2) Thank you for providing us with the opportunity to revise our paper. We have revised the manuscript according to the editors and
More informationOrienting of attention, pupil size, and the norepinephrine system
Atten Percept Psychophys (2011) 73:123 129 DOI 10.3758/s13414-010-0015-4 Orienting of attention, pupil size, and the norepinephrine system Shai Gabay & Yoni Pertzov & Avishai Henik Published online: 24
More informationPHYSIOLOGICAL RESEARCH
DOMAIN STUDIES PHYSIOLOGICAL RESEARCH In order to understand the current landscape of psychophysiological evaluation methods, we conducted a survey of academic literature. We explored several different
More informationAugmenting Test and Evaluation Assessments Using Eye-Tracking and Electroencephalography
ITEA Journal 2010; 31: 275 279 Copyright 2010 by the International Test and Evaluation Association Augmenting Test and Evaluation Assessments Using Eye-Tracking and Electroencephalography Anthony Ries,
More informationObject Substitution Masking: When does Mask Preview work?
Object Substitution Masking: When does Mask Preview work? Stephen W. H. Lim (psylwhs@nus.edu.sg) Department of Psychology, National University of Singapore, Block AS6, 11 Law Link, Singapore 117570 Chua
More informationKey Features. Product Overview
Second Generation IEEE 802.3at PSE Multi-Port Test Suite for the PowerSync Analyzer & Programmable Load Product Overview Key Features In-Depth System Testing of IEEE 802.3at PSE s Concurrently Analyze
More informationOPTIC FLOW IN DRIVING SIMULATORS
OPTIC FLOW IN DRIVING SIMULATORS Ronald R. Mourant, Beverly K. Jaeger, and Yingzi Lin Virtual Environments Laboratory 334 Snell Engineering Center Northeastern University Boston, MA 02115-5000 In the case
More informationEffects of visual and verbal presentation on cognitive load in vigilance, memory, and arithmetic tasks
Psychophysiology, 48 (2011), 323 332. Wiley Periodicals, Inc. Printed in the USA. Copyright r 2010 Society for Psychophysiological Research DOI: 10.1111/j.1469-8986.2011069.x Effects of visual and verbal
More informationPage 0 TRAINING WITH DATA A SEASON REVIEW By Timothy Cusick Contents Introduction... 2 Race/Event Performance Review... 3 Peak Power and Power Clusters... 3 Fatigue Resistance... 4 Specific Performance...
More informationTasks of Executive Control TEC. Interpretive Report. Developed by Peter K. Isquith, PhD, Robert M. Roth, PhD, Gerard A. Gioia, PhD, and PAR Staff
Tasks of Executive Control TEC Interpretive Report Developed by Peter K. Isquith, PhD, Robert M. Roth, PhD, Gerard A. Gioia, PhD, and PAR Staff Client Information Client Name: Sample Client Client ID:
More informationSound Preference Development and Correlation to Service Incidence Rate
Sound Preference Development and Correlation to Service Incidence Rate Terry Hardesty a) Sub-Zero, 4717 Hammersley Rd., Madison, WI, 53711, United States Eric Frank b) Todd Freeman c) Gabriella Cerrato
More informationA model of dual control mechanisms through anterior cingulate and prefrontal cortex interactions
Neurocomputing 69 (2006) 1322 1326 www.elsevier.com/locate/neucom A model of dual control mechanisms through anterior cingulate and prefrontal cortex interactions Nicola De Pisapia, Todd S. Braver Cognitive
More informationInterview with Jochen Kaiser February 2006
Interview with Jochen Kaiser February 2006 Jochen, you have just recently been appointed a professorship in medical psychology at the University of Frankfurt, Germany. How did you become a psychophysiologist
More informationMotivation modulates visual attention: evidence from pupillometry
ORIGINAL RESEARCH ARTICLE published: 12 February 2013 doi: 10.3389/fpsyg.2013.00059 Motivation modulates visual attention: evidence from pupillometry Agnieszka Wykowska 1, Christine Anderl 1,2,3, Anna
More informationSystem of Systems Operational Availability Modeling
System of Systems Operational Availability Modeling NDIA SE Conference San Diego, CA October 22 25, 2012 Dennis J. Anderson* Tamara J. Brown Charles M. Carter Sandia National Laboratories Albuquerque,
More informationElevvo Medical. Neurotechnology for rehabilitation in mental pathology with cognitive deterioration and oriented for health professionals.
Elevvo Medical Neurotechnology for rehabilitation in mental pathology with cognitive deterioration and oriented for health professionals. The technology is designed to generate individualized neuroplastic
More informationSPATIAL AUDIO VS. VERBAL DIRECTIONAL CUES: AN EXAMINATION OF SALIENCE AND DISRUPTIVENESS WITHIN A SIMULATED DRIVING CONTEXT
SPATIAL AUDIO VS. VERBAL DIRECTIONAL CUES: AN EXAMINATION OF SALIENCE AND DISRUPTIVENESS WITHIN A SIMULATED DRIVING CONTEXT Jane H. Barrow and Carryl L. Baldwin George Mason University Psychology Dept.,
More informationABSTRACT 1. INTRODUCTION 2. ARTIFACT REJECTION ON RAW DATA
AUTOMATIC ARTIFACT REJECTION FOR EEG DATA USING HIGH-ORDER STATISTICS AND INDEPENDENT COMPONENT ANALYSIS A. Delorme, S. Makeig, T. Sejnowski CNL, Salk Institute 11 N. Torrey Pines Road La Jolla, CA 917,
More information{djamasbi, ahphillips,
Djamasbi, S., Hall-Phillips, A., Yang, R., Search Results Pages and Competition for Attention Theory: An Exploratory Eye-Tracking Study, HCI International (HCII) conference, July 2013, forthcoming. Search
More informationANALYSIS AND DETECTION OF BRAIN TUMOUR USING IMAGE PROCESSING TECHNIQUES
ANALYSIS AND DETECTION OF BRAIN TUMOUR USING IMAGE PROCESSING TECHNIQUES P.V.Rohini 1, Dr.M.Pushparani 2 1 M.Phil Scholar, Department of Computer Science, Mother Teresa women s university, (India) 2 Professor
More informationTHE ATTENTIONAL COSTS OF INTERRUPTING TASK PERFORMANCE AT VARIOUS STAGES
THE ATTENTIONAL COSTS OF INTERRUPTING TASK PERFORMANCE AT VARIOUS STAGES Christopher A. Monk & Deborah A. Boehm-Davis George Mason University Fairfax, VA J. Gregory Trafton Naval Research Laboratory Washington,
More informationEcological Interface to Enhance User Performance in Adjusting Computer-Controlled Multihead Weigher
Ecological Interface to Enhance User Performance in Adjusting Computer-Controlled Multihead Weigher Yukio Horiguchi 1, Ryoji Asakura 1,*, Tetsuo Sawaragi 1, Yutaka Tamai 2, Kazufumi Naito 2, Nobuki Hashiguchi
More informationWorkload assessment of surgeons: correlation between NASA TLX and blinks
Surg Endosc (2012) 26:2746 2750 DOI 10.1007/s00464-012-2268-6 and Other Interventional Techniques Workload assessment of surgeons: correlation between NASA TLX and blinks Bin Zheng Xianta Jiang Geoffrey
More informationTask Difficulty and Conflict Adaptation
Chapter Hier het plaatje Task Difficulty and Conflict Adaptation "Face a mirror, look at your eyes and invent a mathematical problem, such as 1 times 17. Try to solve the problem and watch your pupil at
More informationONE MONITORING SOLUTION TO MEASURE MORE. Zephyr Performance Systems for academics and researchers
ONE MONITORING SOLUTION TO MEASURE MORE Zephyr Performance Systems for academics and researchers GettyImages-530750346.jpg Vital signs and accelerometry. Tracking both is integral to your research. But
More informationCOGNITIVE LOAD IN MILD TRAUMATIC BRAIN INJURY: A PUPILLOMETRIC ASSESSMENT OF MULTIPLE ATTENTIONAL PROCESSES. Jamie N. Hershaw
COGNITIVE LOAD IN MILD TRAUMATIC BRAIN INJURY: A PUPILLOMETRIC ASSESSMENT OF MULTIPLE ATTENTIONAL PROCESSES by Jamie N. Hershaw Thesis submitted to the Faculty of the Medical Psychology Graduate Program
More informationFUSE TECHNICAL REPORT
FUSE TECHNICAL REPORT 1 / 16 Contents Page 3 Page 4 Page 8 Page 10 Page 13 Page 16 Introduction FUSE Accuracy Validation Testing LBD Risk Score Model Details FUSE Risk Score Implementation Details FUSE
More informationUsing Peripheral Processing and Spatial Memory to Facilitate Task Resumption
Using Peripheral Processing and Spatial Memory to Facilitate Task Resumption Raj M. Ratwani 1,2, Alyssa E. Andrews 2, Malcolm McCurry 1, J. Gregory Trafton 1,2, Matthew S. Peterson 2 Naval Research Laboratory
More informationMemory, emotion, and pupil diameter: Repetition of natural scenes
Psychophysiology, 52 (2015), 1186 1193. Wiley Periodicals, Inc. Printed in the USA. Copyright VC 2015 Society for Psychophysiological Research DOI: 10.1111/psyp.12442 Memory, emotion, and pupil diameter:
More informationRemembering the Past to Imagine the Future: A Cognitive Neuroscience Perspective
MILITARY PSYCHOLOGY, 21:(Suppl. 1)S108 S112, 2009 Copyright Taylor & Francis Group, LLC ISSN: 0899-5605 print / 1532-7876 online DOI: 10.1080/08995600802554748 Remembering the Past to Imagine the Future:
More informationWhy do we look at people's eyes?
Journal of Eye Movement Research 1(1):1, 1-6 Why do we look at people's eyes? Elina Birmingham University of British Columbia Walter Bischof University of Alberta Alan Kingstone University of British Columbia
More informationEwart de Visser, Ph.D. Curriculum Vitae
Ewart de Visser, Ph.D. Curriculum Vitae Birth date/place: September 23 rd, 1983, Alphen aan de Rijn, The Netherlands Address: 2931 Deer Hollow Way Apt 107 Fairfax, VA 22031 Email: edevisse@gmu.edu Phone:
More informationSiegle et al, Pupil dilation and fmri 1
Siegle et al, Pupil dilation and fmri 1 Use of concurrent pupil dilation assessment to inform interpretation and analysis of fmri data Greg J. Siegle 1, Stuart R. Steinhauer 1,2, V. Andrew Stenger 1, Roma
More informationDetecting and Reading Text on HUDs: Effects of Driving Workload and Message Location
Detecting and Reading Text on HUDs: Effects of Driving Workload and Message Location Omer Tsimhoni*, Paul Green*, and Hiroshi Watanabe** *University of Michigan Transportation Research Institute Human
More informationSpatial Transformations in Graph Comprehension
Spatial Transformations in Graph Comprehension Susan Bell Trickett and J. Gregory Trafton George Mason University Department of Psychology Fairfax, VA 22030 stricket@gmu.edu trafton@itd.nrl.navy.mil Introduction
More informationEffort Invested in Cognitive Tasks by Adults with Aphasia: A Pilot Study
Effort Invested in Cognitive Tasks by Adults with Aphasia: A Pilot Study Introduction Impaired performance by individuals with aphasia (IWA) on language tasks may be partially due to an impaired ability
More informationCharacterizing Visual Attention during Driving and Non-driving Hazard Perception Tasks in a Simulated Environment
Title: Authors: Characterizing Visual Attention during Driving and Non-driving Hazard Perception Tasks in a Simulated Environment Mackenzie, A.K. Harris, J.M. Journal: ACM Digital Library, (ETRA '14 Proceedings
More informationModified Cooper Harper Evaluation Tool for Unmanned Vehicle Displays
1 Modified Cooper Harper Evaluation Tool for Unmanned Vehicle Displays M. L. Cummings, Kevin Myers, Stacey D. Scott Abstract Operator interfaces are typically the sole information conduits between unmanned
More information12 TH ICCRTS Adapting C2 to the 21 st Century
12 TH ICCRTS Adapting C2 to the 21 st Century Title Using Physiological Sensors to Understand, Measure and Adapt to Stressors in the C2 Environment Topics C2 Metrics and Assessment, Cognitive and Social
More informationIncreasing Motor Learning During Hand Rehabilitation Exercises Through the Use of Adaptive Games: A Pilot Study
Increasing Motor Learning During Hand Rehabilitation Exercises Through the Use of Adaptive Games: A Pilot Study Brittney A English Georgia Institute of Technology 85 5 th St. NW, Atlanta, GA 30308 brittney.english@gatech.edu
More informationElevvo High Performance
Elevvo High Performance Elevvo High Performance is a neurotechnology for cognitive enhancement oriented to professionals that work with population that need the maximum cognitive competence such as athletes,
More informationNotes on Medical Robotics and Computer-Integrated Surgery, Russell H. Taylor, Arianna Menciassi, Gabor Fichtinger Paolo Fiorini and Paolo Dario
Notes on Medical Robotics and Computer-Integrated Surgery, Russell H. Taylor, Arianna Menciassi, Gabor Fichtinger Paolo Fiorini and Paolo Dario Springer Handbook of Robotics Medical Robotics Medical robots
More informationPROCEEDINGS of the HUMAN FACTORS AND ERGONOMICS SOCIETY 48th ANNUAL MEETING
PROCEEDINGS of the HUMAN FACTORS AND ERGONOMICS SOCIETY 48th ANNUAL MEETING 2004 1464 EFFECT OF HANDLE DESIGN AND TARGET LOCATION ON WRIST POSTURE DURING AIMING WITH A LAPAROSCOPIC TOOL Judkins, T.N. 1,
More informationEyes wide open: enhanced pupil dilation when selectively studying important information
Exp Brain Res (014) 3:337 344 DOI 10.1007/s001-013-3744-5 RESEARCH ARTICLE Eyes wide open: enhanced pupil dilation when selectively studying important information Robert Ariel Alan D. Castel Received:
More informationRevealing The Brain s Hidden Potential: Cognitive Training & Neurocognitive Plasticity. Introduction
Revealing The Brain s Hidden Potential: Cognitive Training & Neurocognitive Plasticity. Introduction Global aging poses significant burdens as age-related impairments in cognitive function affect quality
More informationIdentity Verification Using Iris Images: Performance of Human Examiners
Identity Verification Using Iris Images: Performance of Human Examiners Kevin McGinn, Samuel Tarin and Kevin W. Bowyer Department of Computer Science and Engineering University of Notre Dame kmcginn3,
More information4. gaze direction and decisions How does gaze direction affect decision-making?
4. gaze direction and decisions How does gaze direction affect decision-making? Sun, D. et al (2018) Frontiers in Human Neuroscience, Volume 12: Article 52 Sun, D. et al (2018) Frontiers in Human Neuroscience,
More informationTest review. Comprehensive Trail Making Test (CTMT) By Cecil R. Reynolds. Austin, Texas: PRO-ED, Inc., Test description
Archives of Clinical Neuropsychology 19 (2004) 703 708 Test review Comprehensive Trail Making Test (CTMT) By Cecil R. Reynolds. Austin, Texas: PRO-ED, Inc., 2002 1. Test description The Trail Making Test
More informationThe Horizontal Jumps: Approach Run
Nick Newman, MS The Horizontal Jumps: Approach Run To an untrained eye it appears that horizontal jumpers simply run and jump into the sand. For the youngest or most inexperienced competitors this may
More information