Validity of Haptic Cues and Its Effect on Priming Visual Spatial Attention
|
|
- Sheryl Price
- 5 years ago
- Views:
Transcription
1 Validity of Haptic Cues and Its Effect on Priming Visual Spatial Attention J. Jay Young & Hong Z. Tan Haptic Interface Research Laboratory Purdue University 1285 EE Building West Lafayette, IN {youngj, Rob Gray Department of Applied Psychology Arizona State University East 7001 E Williams Field Road, Bldg. 20 Mesa, AZ robgray@asu.edu Abstract This study investigated cross-modal links in attention between haptics and vision. A visual change-detection task was used as a measure of visual attention. Haptic taps on the back was used to prompt the user the visual quadrant within which changes occurred. The location of the haptic cues was consistent with the quadrant of the visual changes on either 80% or 20% of the trials. Ten subjects were randomly assigned to the two test conditions. The subjects were informed of the validity of the haptic cues before the experiments. We measured the effectiveness of haptic cues in terms of the changes in detection times in the visual task. Our results indicated that for the subjects in the 80% validity group, detection times decreased significantly with valid haptic cues, and increased significantly with invalid haptic cues. For the subjects in the 20% validity group, however, the results were less consistent. Some of the subjects benefited from haptic cues, while others managed to ignore the (mostly invalid) haptic cues. These results are interpreted as evidence that the use of haptic cues to reorient a person s visual spatial attention is natural and intuitive when the validity of the haptic cues is high. It is also concluded that the observed cross-modal attentional links between haptics and vision may involve a voluntary shift in attention as supposed to a purely involuntary mechanism. 1. Introduction The advent of increasingly complex visual displays has imposed rigorous attentional requirements on interface operators. System designers are seeking to alleviate the associated cognitive load through the design of intuitive and ergonomic interfaces. The importance of this objective is well evidenced by the recent growth in multimodal interface research. In everyday life, humans naturally employ multimodal information channels (e.g., speech, gaze and gesture during a conversation). It is well established that multimodal communication can result in increased information transmission, whether multiple modalities convey different information or encode the same information redundantly [1]. However, whether and to what extent this benefit occurs depends on many factors such as spatial proximity of stimuli coming from different modalities (see, for example, [2]). Our work has focused on the crossmodal attentional links between touch and vision. In an earlier study [3, 4], we found that tactile pulses simulating motion along the forearm facilitated the speed and accuracy with which subjects discriminated visual targets on the same forearm. We also reported that an approaching visual target s time to contact with the forearm influenced the subject s ability to perform tactile discrimination on the forearm. These results demonstrate dynamic links in the spatial mapping between vision and touch. In another study [5, 6], haptic cues presented at one of four quadrants on a user s back were used to redirect spatial attention in a visual changedetection task. On 50% of the trials, the location of the haptic cue coincided with the quadrant of the visual scene where change occurred. We found that detection time decreased significantly with valid haptic cues, and increased with invalid haptic cues. The results demonstrate that haptic attentional cues need not be presented at the same spatial location as visual events in order to be effective. More recently, we used the visual change-detection task to compare the effectiveness of haptic and auditory cues [7]. We found that haptic cues had a much larger effect on detection time than auditory cues. In the majority of our previous work, we have used a cue validity rate of 50% (i.e., the location of the haptic cue coincided with the visual change on 50% of the trials). Thus, the haptic cues were at least partially informative for the task. In a critique of some of the pioneering research on crossmodal orienting, Spence and Driver [8] argue that the results from crossmodal studies using informative cues are difficult to interpret because it is not
2 clear whether cueing effects are due to a strategic shift in attention within a single modality or crossmodal links in attentional orienting. For example, when an informative haptic cue proceeds a visual change, subjects could simply learn to reorient their visual attention to the specified location in a manner similar to what would occur for an visual arrow in the center of the screen pointing to a particular quadrant, or an auditory message look to the upper left. In this case the subject is treating the cue as a symbolic instruction to reorient their visual attention and the modality of the cue is irrelevant. In order to be certain that cueing effects are due to hard-wired links between visual attention and haptic attention, it is necessary to use uninformative cues. The present study investigates to what extent the crossmodal attentional link between proximal (haptic) and distal (visual) locations observed in our previous studies is due to a learned strategic shift in attention as opposed to a low-level sensory process. The validity of haptic cues was varied between low and high, and its effect on detection time was examined (i.e., we used both informative and uninformative haptic cues). If attentional reorientation is as robust at low validity rates as at high validity rates, one can conclude that the cueing effect is the result of a natural sensory integration process. Otherwise, high-level processes such as learning might also be involved. Our findings have implications for the design of multimodal user interfaces in, for example, automobiles where a haptic cueing system can be used to redirect a driver s visual attention. 2. General Methods 2.1. Stimulus The visual stimuli used in these experiments were based on the flicker paradigm used for the study of change blindness [9]. The visual scenes consisted of 12 rectangular elements of equal sizes (3 per quadrant) oriented horizontally or vertically (Fig. 1). The x-y positions of each element were randomly chosen within each quadrant with the constraint that the elements never overlapped. Two scenes, differing only in the orientation of one of the rectangular elements, were presented in alternating order with a blank scene inserted in between. The sequence repeated until the user responded by pressing a mouse button. The duration of the two patterned scenes was termed the on time. The duration of the blank scene was termed the off time and was kept at 120 ms. The role of the blank scene was to eliminate motional cues from scene 1 to scene 2. The experimental apparatus for haptic cueing consisted of a 3-by-3 vibrotactile display developed at the Purdue Haptic Interface Research Laboratory. The tactor Scene #1 Blank Scene #2 Blank Figure 1. Illustration of the sequence of visual stimuli for the change-detection task displayed on a computer monitor. Figure 2. The tactor array used for haptic cueing. array was draped over the back of an office chair (Fig. 2). For the experiments in the current study, only the four corner tactors (i.e., tactors No. 1, 3, 7, and 9) were used. Each tactor was independently driven by a 60-ms long sinusoidal pulse. The frequency of the pulse corresponded to the resonant frequency of each of the four tactors, and was between 290 and 306 Hz. The intensity of the stimulus was between 26.1 and 27.9 db SL under unloaded condition (i.e., without the subject pressing their back against the tactors) Subjects Ten college students, 5 females and 5 males, participated in the experiments as paid subjects. The average age of the subjects was 22 years. All subjects had normal or corrected vision. They reported no known abnormalities with tactile perception on their back Procedures Before the experiments began, the subjects were informed of the nature of the task. Specifically, they were told to locate a rectangular element on the computer
3 screen that was changing its orientation in an orthogonal manner between the alternating scenes. Their task was to locate and identify this element as quickly as possible. To ensure that the subjects could clearly feel the stimuli presented by the vibrotactile array and correctly correlate these stimuli with a particular quadrant on the computer screen, a tactor-location identification experiment was performed once for each subject at the beginning of the first session. The subjects task was to click a large box located in each of the four corners of the monitor. For example, if the vibrotactile stimulus occurred in the vicinity of the right shoulder, the correct response would be to click the box in the upper right corner of the monitor. Each subject had to complete one perfect run of 60 trials before proceeding to the main experiments. All subjects were able to achieve 100% correct tactor-location identification within the first run. The independent variables employed were the state of the tactors ( on or off ), on time (80 and 480 ms), and the validity rate of the haptic cues (20% and 80%). Five subjects were randomly assigned to the 20% validity condition, and the other five to the 80% validity condition. The subjects were told the validity rate at which their experiments were being conducted. They were told to use or ignore the haptic cues as they wished. Each subject completed 22 runs in random order (Table 1). Every time a subject sat down in the haptic chair, one 60-trial run with an on-time of 80 ms and 50% validity rate was conducted as a warm-up. On each trial, the subject was tapped once on the back (when the tactor state was on ) 50 ms before the visual sequence began. The subject clicked the left mouse button as soon as the changing element was found, without first moving the cursor over the changing element. The screen then froze and all rectangular elements changed from white to pink in color. The subject was required to move the cursor over the perceived changing element and click the left mouse button. The location of the second mouse click was used to verify that the subject found the correct changing element. Throughout the experiments, subjects were instructed to sit upright with their back pressed against the tactor array. They were instructed not to move their body relative to the chair, or to move the chair relative to the monitor. Headphones were used to block any audible noise from the tactor array and the environment. Each subject typically completed all the runs within 3 sessions Data analysis The dependent variables were the mean and standard error of detection times. Data from the tactor off condition served as a baseline measure for detection time. Data from the tactor on condition were separated into Table 1. Experimental condition for each subject. Tactor state On-time (ms) No. of 60-trial runs On 80 8 On Off 80 3 Off Figure 3. Change in detection time for data pooled over subjects in the 80% validity group. Error bars indicate ±1 standard errors. two subgroups: those with valid haptic cues and those with invalid haptic cues. We report only the change in detection time (i.e., detection time with valid or invalid cues detection time with tactor off ). All error trials, where subjects selected the wrong element, were discarded. 3. Results Results for subjects receiving valid haptic cues 80% of the time show that detection time decreased significantly with valid haptic cues, and increased significantly with invalid haptic cues. Data pooled over all five subjects are shown in Fig. 3. Overall, at 80-ms on-time, detection time for the visual change-detection task decreased by 1191 ms (47.0%) with valid haptic cues, and increased by 190 ms (7.5%) with invalid haptic cues. At 480-ms on-time, detection time decreased by 1737 ms (45.9%) with valid haptic cues, and increased by 1448 ms (38.3%) with invalid haptic cues. A three-way ANOVA indicated that changes in detection time were significantly dependent on the three main factors of subject [F(4, 4760) = 16.08, p<.0001], on-time [F(1, 4760) = , p<.0001] and invalid/valid cue condition [F(1, 4760) =
4 519.57, p<.0001]. The two-way and three-way interactions were all found to be significant. The standard errors for detection times were significantly lower with valid haptic cues (16.0 and 17.5 ms for 80-ms and 480-ms on time, respectively) than with invalid haptic cues (92.4 and ms, respectively) or with no haptic cues (63.6 and 75.7 ms, respectively). These results indicate that the subjects in the 80% validity group were able to detect the changing element faster with valid haptic cues. They were slowed down by invalid haptic cues. What is more, the variability in their detection time was significantly reduced by valid haptic cues, despite inter-subject differences. Results for subjects receiving valid haptic cues 20% of the time fall into three distinct outcomes: positive, negative or no cueing effect. The mean changes in detection time for S1-S5 are listed in Table 2. The asterisks indicate a statistically significant decrease (for negative entries) or increase (for positive entries) in detection time. Subjects S2 and S3 exhibited positive cueing effect in the sense that their detection times decreased with valid haptic cueing and increased with invalid cueing. Subject S4, on the other hand, exhibited negative cueing effect in the sense that his detection times increased with valid haptic cueing. This subject revealed that he deliberately looked away from the quadrant of the haptic cues knowing that they were invalid most of the time. This explains why detection time increased with valid haptic cues. It is also consistent with the result that invalid haptic cueing had no significant effect on detection time. Subject S5 exhibited no cueing effect in the sense that none of the changes in detection time was significant. This subject felt the taps on his back but, unlike S4 who used the haptic cueing location to look elsewhere, chose (and was able) to completely ignore the haptic cues. Subject S1 s results were mixed: valid haptic cues at 80-ms on time had no effect on her detection time, but invalid cues did. At an on time of 480 ms, her detection time decreased with both valid and invalid haptic cues. A comparison of the 80% and 20% validity groups was made by comparing the changes in detection times (Fig. 4). For the 20% group, only the results from the two subjects showing positive cueing effects (S2 and S3) were included in the analysis. Results from Fig. 3 are plotted here again for ease of comparison. With valid haptic cues, the reduction in detection time was significantly greater for the 80% group than for the 20% group at an on time of 80 ms, but not at 480 ms. With invalid haptic cues, the increase in detection time was greater for the 20% group than for the 80% group at an on time of 80 ms, but the reverse was true at 480 ms. In fact, for the 80% group and at an on time of 480 ms, the increase in detection time with invalid haptic cues was Table 2. Average change in detection time with valid and invalid haptic cues for the 20% validity group. Unit for detection times is ms. Asterisks indicate statistically significant results (Student s t-test; p<0.025). Subject On-time=80 ms On-time=480 ms Valid Invalid Valid Invalid S * 575.3* 207.6* S * 376.8* * 132.9* S * 502.2* * 476.2* S * * 26.1 S Figure 4. Comparison of results from the 20% validity group (S2, S3) and the 80% validity group (S6-S10). Error bars indicate ±1 standard errors. almost of the same magnitude as the reduction in detection time with valid cues. In general, there is a trend that haptic cueing is more effective for the 80% group than for the 20% group. 4. Conclusions In this study, we set out to investigate whether the visuotactile spatial cueing effect observed in our previous studies was due to involuntary or voluntary reorienting of visual attention following haptic stimulation. We reasoned that if subjects shifted their visual attention involuntarily upon a tap on their back, then their ability to do so would presumably be robust against any prior knowledge about the validity of haptic cues. If, on the other hand, subjects voluntarily associated the location of a haptic tap with that of a visual scene, then their ability to utilize the haptic spatial cues might be affected by the
5 validity of such cues. Two groups of subjects were tested with a visual change-detection task with haptic cues that were valid on either 80% or 20% of the trials. We found that all subjects in the 80% group benefited (in terms of reduced detection times) from valid haptic cues, and suffered (in terms of increased detection times) from invalid haptic cues. Despite the intersubject differences in the baseline (i.e., no haptic cues) detection times, the standard error of detection times with valid haptic cues were quite small (about 1% of the mean). Subjects in the 20% group, however, exhibited positive, negative, or no haptic cueing effects. Their data were consistent with the strategies employed to utilize the (mostly inaccurate) haptic cues. Therefore, we conclude that the use of haptic cues to reorient a person s visual spatial attention is natural and intuitive, but not entirely involuntary. The present findings differ from previous work by [10] that demonstrated consistent tactile-visual cueing effects across subjects for spatially uninformative cues (analogous to our 20% validity condition). This discrepancy is most likely due to differences in methodology. Subjects in the [10] experiment were required to detect single flashes of light rather than perform a complex change detection task, and in their study the cue and target were in the same spatial location (near the hand) on all valid trials. In an earlier study [5], we used 50% valid haptic cues in the same visual change-detection task. We found that on average, reaction time decreased by 40.6% with valid haptic cues, and increased by 18.9% with invalid haptic cues. These results are similar to those obtained from the present study with the 80% validity group. Future studies will investigate whether subjects can be instructed to deliberately ignore haptic cues at high validity rate, and whether differential results can be obtained with the same validity rate by manipulating the a priori information provided to the subjects. Our results have implications for designers of large visual displays who need an effective mechanism to direct a user s visual attention to a particular region of the display. For example, a haptic chair with embedded tactor display can be used to prompt an air traffic controller to look at an air space that needs attention. In an automobile, a haptic display embedded in the driver s seat can alert the driver to look, say, to the right of the vehicle for a fast approaching vehicle. Although we currently do not yet have any data for the achievable resolution of a haptic cueing system, our results do suggest that a tactor array as coarse as 2-by-2 can cut down the time required to detect a visual change by almost a half if the user knows that the haptic cues are valid most of the time. Acknowledgment This work was funded partly by Nissan Technical Center North America Inc., a Honda Initiation Grant, and a National Science Foundation Faculty Early Career Development (CAREER) Award under Grant IIS. The authors thank Seungmoon Choi for his assistance with statistical analysis. References [1] G. A. Miller, "The magical number seven, plus or minus two: Some limits on our capacity for processing information," The Psychological Review, vol. 63, pp , [2] J. Driver and C. Spence, "Cross-modal links in spatial attention," Philosophical Transactions of the Royal Society of London Series B-Biological Sciences, vol. 353, pp , [3] R. Gray and H. Z. Tan, "Dynamic spatial mapping between vision and touch," Abstracts of the Psychonomic Society, vol. 5, pp. 38, [4] R. Gray and H. Z. Tan, "Dynamic and predictive links between touch and vision," Experimental Brain Research, vol. 145, pp , [5] H. Z. Tan, R. Gray, J. J. Young, and P. Irawan, "Haptic cueing of a visual change-detection task: Implications for multimodal interfaces," in Usability Evaluation and Interface Design: Cognitive Engineering, Intelligent Agents and Virtual Reality (Vol. 1 of the Proceedings of the 9th International Conference on Human-Computer Interaction), M. J. Smith, G. Salvendy, D. Harris, and R. J. Koubek (Eds.), Mahwah, NJ: Lawrence Erlbaum Associates, 2001, pp [6] H. Z. Tan, R. Gray, J. J. Young, and R. Traylor, "A haptic back display for attentional and directional cueing," IEEE Transactions on Systems, Man, and Cybernetics, under review. [7] R. Gray, H. Z. Tan, and J. J. Young, "Do multimodal signals need to come from the same place? Crossmodal attentional links between proximal and distal surfaces," in Proceedings of the IEEE Fourth International Conference on Multimodal Interfaces (ICMI'02), Pittsburgh, PA, Oct , 2002, to appear. [8] C. Spence and J. Driver, "Audiovisual links in exogenous covert spatial orienting," Perception & Psychophysics, vol. 59, pp. 1-22, [9] R. A. Rensink, "Visual search for change: A probe into the nature of attentional processing," Visual Cognition, vol. 7, pp , [10] C. Spence, M. E. R. Nicholls, N. Gillespie, and J. Driver, "Cross-modal links in exogenous covert spatial orienting between touch, audition, and vision," Perception & Psychophysics, vol. 60, pp , 1998.
Dynamic and predictive links between touch and vision
Exp Brain Res (2002) 145:50 55 DOI 10.1007/s00221-002-1085-x RESEARCH ARTICLE Rob Gray Hong Z. Tan Dynamic and predictive links between touch and vision Received: 21 August 2001 / Accepted: 25 February
More informationMultimodal Driver Displays: Potential and Limitations. Ioannis Politis
Multimodal Driver Displays: Potential and Limitations Ioannis Politis About me (http://yannispolitis.info/hci/) Background: B.Sc. Informatics & Telecommunications University of Athens M.Sc. Advanced Information
More informationStimulus-Response Compatibilitiy Effects for Warning Signals and Steering Responses
University of Iowa Iowa Research Online Driving Assessment Conference 2003 Driving Assessment Conference Jul 24th, 12:00 AM Stimulus-Response Compatibilitiy Effects for Warning Signals and Steering Responses
More informationChanging Driver Behavior Through Unconscious Stereotype Activation
University of Iowa Iowa Research Online Driving Assessment Conference 2009 Driving Assessment Conference Jun 23rd, 12:00 AM Changing Driver Behavior Through Unconscious Stereotype Activation Rob Gray Arizona
More informationVibrotactile Signals -using tactile stimuli to present information
Vibrotactile Signals -using tactile stimuli to present information William Hagman, Gustaf Hanson, Sanna Heurlén, Emma Nordlöf, Kristin Raukola, Linnea Wahlberg Linköping University 2010 Tactile stimulation
More informationAttentional Gradient for Crossmodal Proximal-Distal Tactile Cueing of Visual Spatial Attention
Attentional Gradient for Crossmodal Proximal-Distal Tactile Cueing of Visual Spatial Attention 23 ROSLIZAWATY MOHD ROSLI, HONG Z. TAN, and ROBERT W. PROCTOR, Purdue University ROB GRAY, Arizona State University
More informationHeartbeats: A Methodology to Convey Interpersonal Distance through Touch
Heartbeats: A Methodology to Convey Interpersonal Distance through Touch Troy McDaniel, Daniel Villanueva, Sreekar Krishna, Dirk Colbry and Sethuraman Panchanathan Center for Cognitive Ubiquitous Computing
More informationA FRÖHLICH EFFECT IN MEMORY FOR AUDITORY PITCH: EFFECTS OF CUEING AND OF REPRESENTATIONAL GRAVITY. Timothy L. Hubbard 1 & Susan E.
In D. Algom, D. Zakay, E. Chajut, S. Shaki, Y. Mama, & V. Shakuf (Eds.). (2011). Fechner Day 2011: Proceedings of the 27 th Annual Meeting of the International Society for Psychophysics (pp. 89-94). Raanana,
More informationInterference with spatial working memory: An eye movement is more than a shift of attention
Psychonomic Bulletin & Review 2004, 11 (3), 488-494 Interference with spatial working memory: An eye movement is more than a shift of attention BONNIE M. LAWRENCE Washington University School of Medicine,
More informationGrouped Locations and Object-Based Attention: Comment on Egly, Driver, and Rafal (1994)
Journal of Experimental Psychology: General 1994, Vol. 123, No. 3, 316-320 Copyright 1994 by the American Psychological Association. Inc. 0096-3445/94/S3.00 COMMENT Grouped Locations and Object-Based Attention:
More informationDoes scene context always facilitate retrieval of visual object representations?
Psychon Bull Rev (2011) 18:309 315 DOI 10.3758/s13423-010-0045-x Does scene context always facilitate retrieval of visual object representations? Ryoichi Nakashima & Kazuhiko Yokosawa Published online:
More informationCongruency Effects with Dynamic Auditory Stimuli: Design Implications
Congruency Effects with Dynamic Auditory Stimuli: Design Implications Bruce N. Walker and Addie Ehrenstein Psychology Department Rice University 6100 Main Street Houston, TX 77005-1892 USA +1 (713) 527-8101
More informationUsing the method of adjustment to enhance collision warning perception
Using the method of adjustment to enhance collision warning perception Jesse L. Eisert, Bridget A. Lewis, & Carryl L. Baldwin Psychology, George Mason Univeristy, Fairfax, Virginia, USA The psychophysical
More informationKey questions about attention
Key questions about attention How does attention affect behavioral performance? Can attention affect the appearance of things? How does spatial and feature-based attention affect neuronal responses in
More informationPupil Dilation as an Indicator of Cognitive Workload in Human-Computer Interaction
Pupil Dilation as an Indicator of Cognitive Workload in Human-Computer Interaction Marc Pomplun and Sindhura Sunkara Department of Computer Science, University of Massachusetts at Boston 100 Morrissey
More informationApplication of ecological interface design to driver support systems
Application of ecological interface design to driver support systems J.D. Lee, J.D. Hoffman, H.A. Stoner, B.D. Seppelt, and M.D. Brown Department of Mechanical and Industrial Engineering, University of
More informationOPTIC FLOW IN DRIVING SIMULATORS
OPTIC FLOW IN DRIVING SIMULATORS Ronald R. Mourant, Beverly K. Jaeger, and Yingzi Lin Virtual Environments Laboratory 334 Snell Engineering Center Northeastern University Boston, MA 02115-5000 In the case
More informationBinaural Hearing. Why two ears? Definitions
Binaural Hearing Why two ears? Locating sounds in space: acuity is poorer than in vision by up to two orders of magnitude, but extends in all directions. Role in alerting and orienting? Separating sound
More informationEvaluating Tactile Feedback in Graphical User Interfaces
Evaluating Tactile Feedback in Graphical User Interfaces Elina Tähkäpää and Roope Raisamo Tampere Unit for Computer-Human Interaction (TAUCHI) Department of Computer and Information Sciences FIN- University
More informationVisual Selection and Attention
Visual Selection and Attention Retrieve Information Select what to observe No time to focus on every object Overt Selections Performed by eye movements Covert Selections Performed by visual attention 2
More informationMultimodal urgency coding: auditory, visual, and tactile parameters and their impact on perceived urgency
3586 Work 41 (2012) 3586-3591 DOI: 10.3233/WOR-2012-0669-3586 IOS Press Multimodal urgency coding: auditory, visual, and tactile parameters and their impact on perceived urgency Carryl L. Baldwin *, Jesse
More informationSpatial Orientation Using Map Displays: A Model of the Influence of Target Location
Gunzelmann, G., & Anderson, J. R. (2004). Spatial orientation using map displays: A model of the influence of target location. In K. Forbus, D. Gentner, and T. Regier (Eds.), Proceedings of the Twenty-Sixth
More informationThe Simon Effect as a Function of Temporal Overlap between Relevant and Irrelevant
University of North Florida UNF Digital Commons All Volumes (2001-2008) The Osprey Journal of Ideas and Inquiry 2008 The Simon Effect as a Function of Temporal Overlap between Relevant and Irrelevant Leslie
More informationSPATIAL AUDIO VS. VERBAL DIRECTIONAL CUES: AN EXAMINATION OF SALIENCE AND DISRUPTIVENESS WITHIN A SIMULATED DRIVING CONTEXT
SPATIAL AUDIO VS. VERBAL DIRECTIONAL CUES: AN EXAMINATION OF SALIENCE AND DISRUPTIVENESS WITHIN A SIMULATED DRIVING CONTEXT Jane H. Barrow and Carryl L. Baldwin George Mason University Psychology Dept.,
More informationResearch Review: Multiple Resource Theory. out in multi-task environments. Specifically, multiple display layout and control design
Research Review: Multiple Resource Theory Relevance to HCI Multiple resource theory is a framework for predicting effects on performance when multiple tasks are concurrently executed. These predictions
More information(Visual) Attention. October 3, PSY Visual Attention 1
(Visual) Attention Perception and awareness of a visual object seems to involve attending to the object. Do we have to attend to an object to perceive it? Some tasks seem to proceed with little or no attention
More informationSupplementary Materials
Supplementary Materials Supplementary Figure S1: Data of all 106 subjects in Experiment 1, with each rectangle corresponding to one subject. Data from each of the two identical sub-sessions are shown separately.
More informationTHE SPATIAL EXTENT OF ATTENTION DURING DRIVING
THE SPATIAL EXTENT OF ATTENTION DURING DRIVING George J. Andersen, Rui Ni Department of Psychology University of California Riverside Riverside, California, USA E-mail: Andersen@ucr.edu E-mail: ruini@ucr.edu
More informationRandom visual noise impairs object-based attention
Exp Brain Res (2002) 142:349 353 DOI 10.1007/s00221-001-0899-2 RESEARCH ARTICLE Richard A. Abrams Mark B. Law Random visual noise impairs object-based attention Received: 10 May 2000 / Accepted: 4 September
More informationUnderstanding Users. - cognitive processes. Unit 3
Understanding Users - cognitive processes Unit 3 Why do we need to understand users? Interacting with technology involves a number of cognitive processes We need to take into account Characteristic & limitations
More informationTraining and generalization of complex auditory-visual conditional discriminations in individuals with autism: New procedures using dynamic stimuli.
Training and generalization of complex auditory-visual conditional discriminations in individuals with autism: New procedures using dynamic stimuli. Harry A. Mackay, Brooks Thompson, & William J. McIlvane
More informationThe Gaze Cueing Paradigm with Eye Tracking Background Set-up Lab
iworx Physiology Lab Experiment Experiment HP-17 The Gaze Cueing Paradigm with Eye Tracking Background Set-up Lab Note: The lab presented here is intended for evaluation purposes only. iworx users should
More informationPosner s Attention Test
iworx Physiology Lab Experiment Experiment HP-18 Posner s Attention Test Background Setup Lab Note: The lab presented here is intended for evaluation purposes only. iworx users should refer to the User
More informationMasking by Object Substitution: Dissociation of Masking and Cuing Effects
Journal of Experimental Psychology: Human Perception and Performance 2002, Vol. 28, No. 3, 682 694 Copyright 2002 by the American Psychological Association, Inc. 0096-1523/02/$5.00 DOI: 10.1037//0096-1523.28.3.682
More informationVerbruggen, F., & Logan, G. D. (2009). Proactive adjustments of response strategies in the
1 Verbruggen, F., & Logan, G. D. (2009). Proactive adjustments of response strategies in the stop-signal paradigm. Journal of Experimental Psychology: Human Perception and Performance, 35(3), 835-54. doi:10.1037/a0012726
More informationSelective changes of sensitivity after adaptation to simple geometrical figures*
Perception & Psychophysics 1973. Vol. 13. So. 2.356-360 Selective changes of sensitivity after adaptation to simple geometrical figures* ANGEL VASSILEV+ Institu te of Physiology. Bulgarian Academy of Sciences.
More informationExperiment HP-13: The Gaze Cue Paradigm
Experiment HP-13: The Gaze Cue Paradigm Background During almost all social interactions, people s eyes convey information about their direction of attention as well as their emotional and mental status.
More informationFactors Affecting Speed and Accuracy of Response Selection in Operational Environments
Factors Affecting Speed and Accuracy of Response Selection in Operational Environments Robert W. Proctor & Motonori Yamaguchi Purdue University, W. Lafayette, Indiana MURI Grant W9112NF-05-1-0153 from
More informationSensory Adaptation within a Bayesian Framework for Perception
presented at: NIPS-05, Vancouver BC Canada, Dec 2005. published in: Advances in Neural Information Processing Systems eds. Y. Weiss, B. Schölkopf, and J. Platt volume 18, pages 1291-1298, May 2006 MIT
More informationEFFECTS OF TEMPORAL FINE STRUCTURE ON THE LOCALIZATION OF BROADBAND SOUNDS: POTENTIAL IMPLICATIONS FOR THE DESIGN OF SPATIAL AUDIO DISPLAYS
Proceedings of the 14 International Conference on Auditory Display, Paris, France June 24-27, 28 EFFECTS OF TEMPORAL FINE STRUCTURE ON THE LOCALIZATION OF BROADBAND SOUNDS: POTENTIAL IMPLICATIONS FOR THE
More informationLimits to the Use of Iconic Memory
Limits to Iconic Memory 0 Limits to the Use of Iconic Memory Ronald A. Rensink Departments of Psychology and Computer Science University of British Columbia Vancouver, BC V6T 1Z4 Canada Running Head: Limits
More informationSELECTIVE ATTENTION AND CONFIDENCE CALIBRATION
SELECTIVE ATTENTION AND CONFIDENCE CALIBRATION Jordan Schoenherr, Craig Leth-Steensen, and William M. Petrusic psychophysics.lab@gmail.com, craig_leth_steensen@carleton.ca, bpetrusi@carleton.ca Carleton
More informationLimitations of Object-Based Feature Encoding in Visual Short-Term Memory
Journal of Experimental Psychology: Human Perception and Performance 2002, Vol. 28, No. 2, 458 468 Copyright 2002 by the American Psychological Association, Inc. 0096-1523/02/$5.00 DOI: 10.1037//0096-1523.28.2.458
More informationSequential Effects in Spatial Exogenous Cueing: Theoretical and Methodological Issues
Sequential Effects in Spatial Exogenous Cueing: Theoretical and Methodological Issues Alessandro Couyoumdjian (alessandro.couyoumdjian@uniroma1.it) Faculty of Psychology 1, University La Sapienza via dei
More informationRatwani & Trafton: Task Resumption. Spatial Memory Guides Task Resumption. Raj M. Ratwani
Running head: TASK RESUMPTION Spatial Memory Guides Task Resumption Raj M. Ratwani George Mason University, 4400 University Drive, MS3F5, Fairfax, VA, 22030 J. Gregory Trafton Naval Research Laboratory
More information[5]. Our research showed that two deafblind subjects using this system could control their voice pitch with as much accuracy as hearing children while
NTUT Education of Disabilities Vol.12 2014 Evaluation of voice pitch control in songs with different melodies using tactile voice pitch feedback display SAKAJIRI Masatsugu 1), MIYOSHI Shigeki 2), FUKUSHIMA
More informationAMERICAN JOURNAL OF PSYCHOLOGICAL RESEARCH
AMERICAN JOURNAL OF PSYCHOLOGICAL RESEARCH Volume 3, Number 1 Submitted: August 10, 2007 Revisions: August 20, 2007 Accepted: August 27, 2007 Publication Date: September 10, 2007 The Effect of Cell Phone
More informationCharacterizing Visual Attention during Driving and Non-driving Hazard Perception Tasks in a Simulated Environment
Title: Authors: Characterizing Visual Attention during Driving and Non-driving Hazard Perception Tasks in a Simulated Environment Mackenzie, A.K. Harris, J.M. Journal: ACM Digital Library, (ETRA '14 Proceedings
More informationProduct Model #: Digital Portable Radio XTS 5000 (Std / Rugged / Secure / Type )
Rehabilitation Act Amendments of 1998, Section 508 Subpart 1194.25 Self-Contained, Closed Products The following features are derived from Section 508 When a timed response is required alert user, allow
More informationVoice Pitch Control Using a Two-Dimensional Tactile Display
NTUT Education of Disabilities 2012 Vol.10 Voice Pitch Control Using a Two-Dimensional Tactile Display Masatsugu SAKAJIRI 1, Shigeki MIYOSHI 2, Kenryu NAKAMURA 3, Satoshi FUKUSHIMA 3 and Tohru IFUKUBE
More informationConsonant Perception test
Consonant Perception test Introduction The Vowel-Consonant-Vowel (VCV) test is used in clinics to evaluate how well a listener can recognize consonants under different conditions (e.g. with and without
More informationPERFORMANCE OPERATING CHARACTERISTICS FOR SPATIAL AND TEMPORAL DISCRIMINATIONS: COMMON OR SEPARATE CAPACITIES?
PROCEEDINGS of the HUMAN FACTORS AND ERGONOMICS SOCIETY 8th ANNUAL MEETING 88 PERFORMANCE OPERATING CHARACTERISTICS FOR SPATIAL AND TEMPORAL DISCRIMINATIONS: COMMON OR SEPARATE CAPACITIES? J. E. Thropp,
More informationThe path of visual attention
Acta Psychologica 121 (2006) 199 209 www.elsevier.com/locate/actpsy The path of visual attention James M. Brown a, *, Bruno G. Breitmeyer b, Katherine A. Leighty a, Hope I. Denney a a Department of Psychology,
More informationVirtual Dentistry: The Forces Behind the Pain
Virtual Dentistry: The Forces Behind the Pain Steven Dow Honors Project Presentation December 999 Background Experiment One: Formative Evaluation Design Results Experiment Two: Signal Detection Test Design
More informationFunctional Fixedness: The Functional Significance of Delayed Disengagement Based on Attention Set
In press, Journal of Experimental Psychology: Human Perception and Performance Functional Fixedness: The Functional Significance of Delayed Disengagement Based on Attention Set Timothy J. Wright 1, Walter
More informationoptimising the value of sound quality evaluations by observing assessors driving strategies
optimising the value of sound quality evaluations by observing assessors driving strategies S. S D Giudice a, P. Jennings b, R. Cain b, G. Dunne c, M. Allman-Ward d and R. Williams d a WMG, University
More informationFramework for Comparative Research on Relational Information Displays
Framework for Comparative Research on Relational Information Displays Sung Park and Richard Catrambone 2 School of Psychology & Graphics, Visualization, and Usability Center (GVU) Georgia Institute of
More informationVerbal-Spatial Cue Conflict: Implications for the Design of Collision-Avoidance Warning Systems
University of Iowa Iowa Research Online Driving Assessment Conference 2009 Driving Assessment Conference Jun 24th, 12:00 AM Verbal-Spatial Cue Conflict: Implications for the Design of Collision-Avoidance
More informationPerceptual averaging by eye and ear: Computing summary statistics from multimodal stimuli
Atten Percept Psychophys (2012) 74:810 815 DOI 10.3758/s13414-012-0293-0 Perceptual averaging by eye and ear: Computing summary statistics from multimodal stimuli Alice R. Albrecht & Brian J. Scholl &
More informationNeuroscience Letters
Neuroscience Letters 450 (2009) 60 64 Contents lists available at ScienceDirect Neuroscience Letters journal homepage: www. elsevier. com/ locate/ neulet Poke and pop: Tactile visual synchrony increases
More informationAre In-group Social Stimuli more Rewarding than Out-group?
University of Iowa Honors Theses University of Iowa Honors Program Spring 2017 Are In-group Social Stimuli more Rewarding than Out-group? Ann Walsh University of Iowa Follow this and additional works at:
More informationSupplemental Information: Task-specific transfer of perceptual learning across sensory modalities
Supplemental Information: Task-specific transfer of perceptual learning across sensory modalities David P. McGovern, Andrew T. Astle, Sarah L. Clavin and Fiona N. Newell Figure S1: Group-averaged learning
More informationTouch Behavior Analysis for Large Screen Smartphones
Proceedings of the Human Factors and Ergonomics Society 59th Annual Meeting - 2015 1433 Touch Behavior Analysis for Large Screen Smartphones Yu Zhang 1, Bo Ou 1, Qicheng Ding 1, Yiying Yang 2 1 Emerging
More informationObject-based attention in Chinese readers of Chinese words: Beyond Gestalt principles
Psychonomic Bulletin & Review 2008, 15 (5), 945-949 doi: 10.3758/PBR.15.5.945 Object-based attention in Chinese readers of Chinese words: Beyond Gestalt principles Xingshan Li and Gordon D. Logan Vanderbilt
More informationObject Substitution Masking: When does Mask Preview work?
Object Substitution Masking: When does Mask Preview work? Stephen W. H. Lim (psylwhs@nus.edu.sg) Department of Psychology, National University of Singapore, Block AS6, 11 Law Link, Singapore 117570 Chua
More informationSymbolic control of visual attention: Semantic constraints on the spatial distribution of attention
A130RA BC MJA/cla Attention, Perception, & Psychophysics 2009, 71(2), 363-374 doi:10.3758/app.71.2.363 Symbolic control of visual attention: Semantic constraints on the spatial distribution of attention
More informationPerceptual Plasticity in Spatial Auditory Displays
Perceptual Plasticity in Spatial Auditory Displays BARBARA G. SHINN-CUNNINGHAM, TIMOTHY STREETER, and JEAN-FRANÇOIS GYSS Hearing Research Center, Boston University Often, virtual acoustic environments
More informationMultimodal interactions: visual-auditory
1 Multimodal interactions: visual-auditory Imagine that you are watching a game of tennis on television and someone accidentally mutes the sound. You will probably notice that following the game becomes
More informationMENTAL WORKLOAD AS A FUNCTION OF TRAFFIC DENSITY: COMPARISON OF PHYSIOLOGICAL, BEHAVIORAL, AND SUBJECTIVE INDICES
MENTAL WORKLOAD AS A FUNCTION OF TRAFFIC DENSITY: COMPARISON OF PHYSIOLOGICAL, BEHAVIORAL, AND SUBJECTIVE INDICES Carryl L. Baldwin and Joseph T. Coyne Department of Psychology Old Dominion University
More informationAttentional Capture Under High Perceptual Load
Psychonomic Bulletin & Review In press Attentional Capture Under High Perceptual Load JOSHUA D. COSMAN AND SHAUN P. VECERA University of Iowa, Iowa City, Iowa Attentional capture by abrupt onsets can be
More informationAre there Hemispheric Differences in Visual Processes that Utilize Gestalt Principles?
Carnegie Mellon University Research Showcase @ CMU Dietrich College Honors Theses Dietrich College of Humanities and Social Sciences 2006 Are there Hemispheric Differences in Visual Processes that Utilize
More informationRules of apparent motion: The shortest-path constraint: objects will take the shortest path between flashed positions.
Rules of apparent motion: The shortest-path constraint: objects will take the shortest path between flashed positions. The box interrupts the apparent motion. The box interrupts the apparent motion.
More informationTrading Directional Accuracy for Realism in a Virtual Auditory Display
Trading Directional Accuracy for Realism in a Virtual Auditory Display Barbara G. Shinn-Cunningham, I-Fan Lin, and Tim Streeter Hearing Research Center, Boston University 677 Beacon St., Boston, MA 02215
More informationSeeing Sound: Changing Visual Perception Through Cross-Modal Interaction. Tracey D. Berger. New York University. Department of Psychology
Cross-Modal Effects on Perception 1 Seeing Sound: Changing Visual Perception Through Cross-Modal Interaction. Tracey D. Berger New York University Department of Psychology Faculty Sponsor : Denis Pelli
More informationReflexive Spatial Attention to Goal-Directed Reaching
Reflexive Spatial Attention to Goal-Directed Reaching Alexis A. Barton (aabarton@indiana.edu) Bennett I. Bertenthal (bbertent@indiana.edu) Samuel Harding (hardinsm@indiana.edu) Department of Psychological
More informationSpatially Diffuse Inhibition Affects Multiple Locations: A Reply to Tipper, Weaver, and Watson (1996)
Journal of Experimental Psychology: Human Perception and Performance 1996, Vol. 22, No. 5, 1294-1298 Copyright 1996 by the American Psychological Association, Inc. 0096-1523/%/$3.00 Spatially Diffuse Inhibition
More informationDifferences of Face and Object Recognition in Utilizing Early Visual Information
Differences of Face and Object Recognition in Utilizing Early Visual Information Peter Kalocsai and Irving Biederman Department of Psychology and Computer Science University of Southern California Los
More informationThe effects of subthreshold synchrony on the perception of simultaneity. Ludwig-Maximilians-Universität Leopoldstr 13 D München/Munich, Germany
The effects of subthreshold synchrony on the perception of simultaneity 1,2 Mark A. Elliott, 2 Zhuanghua Shi & 2,3 Fatma Sürer 1 Department of Psychology National University of Ireland Galway, Ireland.
More informationViewpoint-dependent recognition of familiar faces
Perception, 1999, volume 28, pages 483 ^ 487 DOI:10.1068/p2901 Viewpoint-dependent recognition of familiar faces Nikolaus F Trojeô Max-Planck Institut fïr biologische Kybernetik, Spemannstrasse 38, 72076
More informationLecturer: Rob van der Willigen 11/9/08
Auditory Perception - Detection versus Discrimination - Localization versus Discrimination - - Electrophysiological Measurements Psychophysical Measurements Three Approaches to Researching Audition physiology
More informationViewpoint dependent recognition of familiar faces
Viewpoint dependent recognition of familiar faces N. F. Troje* and D. Kersten *Max-Planck Institut für biologische Kybernetik, Spemannstr. 38, 72076 Tübingen, Germany Department of Psychology, University
More informationGick et al.: JASA Express Letters DOI: / Published Online 17 March 2008
modality when that information is coupled with information via another modality (e.g., McGrath and Summerfield, 1985). It is unknown, however, whether there exist complex relationships across modalities,
More informationTHE ATTENTIONAL COSTS OF INTERRUPTING TASK PERFORMANCE AT VARIOUS STAGES
THE ATTENTIONAL COSTS OF INTERRUPTING TASK PERFORMANCE AT VARIOUS STAGES Christopher A. Monk & Deborah A. Boehm-Davis George Mason University Fairfax, VA J. Gregory Trafton Naval Research Laboratory Washington,
More informationEVALUATION OF DRUG LABEL DESIGNS USING EYE TRACKING. Agnieszka Bojko, Catherine Gaddy, Gavin Lew, Amy Quinn User Centric, Inc. Oakbrook Terrace, IL
PROCEEDINGS of the HUMAN FACTORS AND ERGONOMICS SOCIETY 9th ANNUAL MEETING 00 0 EVALUATION OF DRUG LABEL DESIGNS USING EYE TRACKING Agnieszka Bojko, Catherine Gaddy, Gavin Lew, Amy Quinn User Centric,
More informationLecturer: Rob van der Willigen 11/9/08
Auditory Perception - Detection versus Discrimination - Localization versus Discrimination - Electrophysiological Measurements - Psychophysical Measurements 1 Three Approaches to Researching Audition physiology
More informationThe Danger of Incorrect Expectations In Driving: The Failure to Respond
University of Iowa Iowa Research Online Driving Assessment Conference 2007 Driving Assessment Conference Jul 11th, 12:00 AM The Danger of Incorrect Expectations In Driving: The Failure to Respond Martin
More informationEnhancement of Application Software for Examination of Differential Magnification Methods and Magnification Interface Factors
Enhancement of Application Software for Examination of Differential Magnification Methods and Magnification Interface Factors Fion C. H. Lee and Alan H. S. Chan Abstract The variable visual acuity nature
More informationA Multimodal Paradigm for Investigating the Perisaccadic Temporal Inversion Effect in Vision
A Multimodal Paradigm for Investigating the Perisaccadic Temporal Inversion Effect in Vision Leo G. Trottier (leo@cogsci.ucsd.edu) Virginia R. de Sa (desa@cogsci.ucsd.edu) Department of Cognitive Science,
More informationSelective Attention. Chapter Definition and Domain. Contents
Chapter 2 Selective Attention Contents 2.1 Definition and Domain............................. 5 2.2 Spatial Cueing.................................. 9 2.3 Partially-Valid Cueing.............................
More informationWhen it Sounds like a Duck and it Looks like a Dog Auditory icons vs. Earcons in Multimedia Environments
When it Sounds like a Duck and it Looks like a Dog Auditory icons vs. Earcons in Multimedia Environments Myra P. Bussemakers, Ab de Haan Nijmegen Institute for Cognition and Information University of Nijmegen
More informationTemplates for Rejection: Configuring Attention to Ignore Task-Irrelevant Features
Journal of Experimental Psychology: Human Perception and Performance 2012, Vol. 38, No. 3, 580 584 2012 American Psychological Association 0096-1523/12/$12.00 DOI: 10.1037/a0027885 OBSERVATION Templates
More informationTactile Communication of Speech
Tactile Communication of Speech RLE Group Sensory Communication Group Sponsor National Institutes of Health/National Institute on Deafness and Other Communication Disorders Grant 2 R01 DC00126, Grant 1
More informationAttention! 5. Lecture 16 Attention. Science B Attention. 1. Attention: What is it? --> Selection
Lecture 16 ttention Everyone knows what attention is. It is the taking possession by the mind, in clear and vivid form, of one out of what seem several simultaneously possible objects or trains of thought.
More informationActive suppression after involuntary capture of attention
Psychon Bull Rev (2013) 20:296 301 DOI 10.3758/s13423-012-0353-4 BRIEF REPORT Active suppression after involuntary capture of attention Risa Sawaki & Steven J. Luck Published online: 20 December 2012 #
More informationThe effect of stimulus duration on the persistence of gratings
Perception & Psychophysics 1980,27 (6),574-578 The effect of stimulus duration on the persistence of gratings ALISON BOWLING and WILLIAM LOVEGROVE University oftasmania, Hobart, Tasmania, Australia 700/
More informationInfluence of Frequency on Difference Thresholds for Magnitude of Vertical Sinusoidal Whole-Body Vibration
Industrial Health 2002, 40, 313 319 Original Article Influence of Frequency on Difference Thresholds for Magnitude of Vertical Sinusoidal Whole-Body Vibration Yasunao MATSUMOTO 1 *, Setsuo MAEDA 2 and
More informationJennifer J. McComas and Ellie C. Hartman. Angel Jimenez
The Psychological Record, 28, 58, 57 528 Some Effects of Magnitude of Reinforcement on Persistence of Responding Jennifer J. McComas and Ellie C. Hartman The University of Minnesota Angel Jimenez The University
More informationEarly posterior ERP components do not reflect the control of attentional shifts toward expected peripheral events
Psychophysiology, 40 (2003), 827 831. Blackwell Publishing Inc. Printed in the USA. Copyright r 2003 Society for Psychophysiological Research BRIEF REPT Early posterior ERP components do not reflect the
More informationObject-based attention with endogenous cuing and positional certainty
Perception & Psychophysics 2008, 70 (8), 1435-1443 doi: 10.3758/PP.70.8.1435 Object-based attention with endogenous cuing and positional certainty ZHE CHEN University of Canterbury, Christchurch, New Zealand
More informationPerceptual grouping in change detection
1 Perceptual grouping in change detection Yuhong Jiang Massachusetts Institute of Technology Marvin M. Chun Yale University Ingrid R. Olson University of Pennsylvania [In Press: Perception & Psychophysics,
More information