Natural Scene Statistics and Perception. W.S. Geisler
|
|
- Solomon Russell
- 5 years ago
- Views:
Transcription
1 Natural Scene Statistics and Perception W.S. Geisler
2 Some Important Visual Tasks Identification of objects and materials Navigation through the environment Estimation of motion trajectories and speeds Estimation of physical dimensions and shape Object manipulation Visual communication The first point I want to make is that the human visual system is designed to perform a number of important tasks. It is designed to perform these tasks though evolution as well as though learning/development during the life span. I have listed some of these tasks in this slide. These are very complex and difficult tasks that require complex neural machinery.
3 Fundamental Premise The human visual system is the result of evolution by natural selection, and hence its design must incorporate detailed knowledge of the physical regularities of the natural environment. Now, everyone who studies biological vision systems knows that this statement must be true. Nonetheless, vision scientists have only begun to take this fact seriously in recent years. This premise suggests that a potentially powerful strategy for gaining insight into the human visual system is by measuring and analyzing the physical regularities of the natural environment. The power of this approach is that if we can characterize the physical regularities in the visual environment then we will gain insight into how those regularities could be exploited to perform visual tasks. Those insights in turn allow us to know what to look for in the brain and how to interpret what we find. For example, to understand how the brain can create 3D representations from 2D retinal images it is crucial to understand the regularities in the retinal image produced by perspective projection of natural scenes. Because of the complexity of the natural environment and the loss of information due to projection onto a 2D retina, the physical regularities relevant for vision are best described in statistical terms, and the best way to understand what those statistical properties imply for vision is with statistical analysis.
4 Two Types of Natural Scene Statistics Absolute Statistics Bayesian Statistics Environment p( ω) p( ω s) p( ω z ) p( ω r) Image p() s p( sz ) p( sr) Neural response p( z) p( zr) Behavior p() r p ( ω s) = w p ( s ω) p( ω) p( sw) p( w) It is useful to distinguish between two general types of natural scene statistics, which can be measured at various levels along the pathway from environment to behavior. Absolute statistics are useful for understanding coding and representation. However, they say nothing about the relationship between the different levels and hence they are not as useful for understanding the information relevant for specific tasks. In most natural tasks the goal is to use the retinal image or some neural representation of the retinal image to make inferences about properties of the physical environment. In other words, the statistics one needs to know is the probability of different states of the environment given the image. These are what I am calling Bayesian statistics.
5 Two Examples (one if I run out of time) Contour Perception Fixation Selection I will describe two recent examples (from my lab) of measuring physical properties of the environment and analyzing their relationship to the design of the human visual system; one example concerns contour perception and the other gaze selection.
6 Humans have a remarkably ability to see meaningful (non-accidental) structure in images they have never seen before. Much of this structure is contained in the contours created by object, shadow, lighting and material boundaries. We have been interested in measuring the statistical properties of these contours in natural scenes and in trying to understand the relationship between those properties and human ability to see structure in images. One area of research has been to examine the 2D geometrical relationships between local edge elements extracted from natural scenes.
7 Contour Completion Task? same contour ω = different contour Do contour elements intersecting an occluding surface belong to the same or different contour? ( distance, direction, orientation, contrast polarity) s = We have used these statistics to characterize the information available to support performance of certain simple tasks, such as the contour completion and contour grouping.
8 Measuring Bayesian Contour Statistics Each red pixel in the right image is a edge element location. The orientation of each element was measured but is not shown here. Two observers then assigned edge elements to physical contours (sources); observers regarded boundary contours, lighting contours and surface marking contours as distinct. This assignment information was assumed to provide approximate ground truth.
9 Decimated edge samples with orientation shown.
10 ρ = 1 ρ = 0 ρ = 1 () s L = p = p d p( s ω= c) ( s ω= ~ c) p( d, φθρ,, c) (, φθρ,, ~ c) The geometrical and contrast-polarity relationship between two edge elements is given by 4 parameters. Once images are hand segmented it is straight forward to estimate the likelihood and prior probability distributions. In the specific task we consider next, the prior probabilities are forced to be equal, so the relevant function is the likelihood ratio distribution which is shown on the right. The reference is in the middle; distance is given by the ring, direction by the angle around the ring, orientation difference by the orientation of the plotted line segment, polarity by the particular half of the diagram, and likelihood ratio by the color of the plotted line segment. For an earlier version of this analysis (without contrast polarity) see Geisler, Perry, Super & Gallogly (2001) Vision Research, 41, These average Bayesian pair-wise statistics make it to possible to determine optimal performance in the contour completion task.
11 In the contour completion task, a pair of edge elements is selected at random from a natural image and an occluder is placed between them. The task (the display is shown in B) is to indicate whether the pair of elements is from the same or different physical contour, where the prior probability is 0.5. Three occluder diameters. No feedback is given for the first 600 trials, then 600 trials with feedback, then 600 trials with no feedback.
12 Comparison of human (symbols) and ideal (solid curves) performance, with (green) and without (red) contrast polarity information. Human efficiency is high and parallel to ideal. Average data for four observers (two experienced, two naïve).
13 Practice with feedback does not lead to improvements in performance. If anything performance gets worse. Unpracticed observers have excellent knowledge of the contour statistics of natural scenes. When they get feedback they may try to make trial-to-trial adjustments to their decision criteria which leads to non-optimal performance.
14 The pair-wise natural scene statistics can also be used to generate predictions for contour integration experiments (although it is not an ideal Bayesian observer). Here is an experiment we carried out several years ago to compare with the predictions from natural scene statistics. Computer vision researchers (e.g., Parent & Zuker 1989; Sha ashua & Ullman 1988; Jacobs 1996) proposed algorithms for solving the contour integration problem. Hayes Field, Hess & Hayes (1993) were the first to do careful psychophysical work using this kind of task, and they raised awareness of the importance of the task in the biological vision science community. 2.5 o
15 Made parametric measurements for all four dimensions.
16 Groups obtained using pair-wise natural image statistics.
17 A Bayesian grouping rule based on natural scene statistics predicts human contour grouping performance quite well (correlation of about 0.9, as shown in next slide).
18
19 Conclusions from First Example It is possible to measure the statistics of edge geometry in natural scenes The human visual system appears to have incorporated those statistics efficiently into its contour grouping mechanisms
20 Two Examples Contour Perception Fixation Selection As a second example, I will briefly describe some of our measurements of natural scene statistics that may be relevant for understanding how humans pick locations to fixate. The starting point for analyzing how humans select fixation points is to understand how the spatial resolution of the eye varies across the visual field.
21 Spatial Resolution Across the Visual Field This fall off is primarily due to spatial filtering in the retina of the eye. Show foveated-imaging demo. It is precisely because of the this fall off that humans (and many other animals) make eye movements. Why do we have a foveated visual system? It is a solution to several competing goals.
22 Competing Goals for Visual System Design Maximize spatial resolution Maximize field of view Minimize neural resources
23 Examples of eye scanning records made by Yarbus (1967). 1. Free examination. 2. Estimate material circumstances of family. 3. Give ages of people. 4. Surmise what the family members were doing before the visitor s arrival. 5. Remember the clothes worn by the people. 6. Remember the positions and objects in the room. 7. Estimate how long the unexpected visitor had been away. Eye movements strategies are task dependent.
24 Eye Movement Strategies for Two Tasks Visual search: Find a known target embedded at random location Scene encoding: Maximize the encoded image information Now, let s consider the task of encoding or memorizing scenes (not searching for a particular object). Determining how one should fixate in order to maximize the total encoded image information is a daunting problem. Thus, to get started we have first considered the simpler task of picking fixations that maximize the gain in total contrast information, or equivalently, that minimize the total uncertainty about local contrast.
25 Effects of Foveation The greater the eccentricity the greater the reduction in contrast The greater the eccentricity the greater the loss of contrast information A major effect foveation is to effectively reduce contrast. The greater the eccentricity the greater the reduction in contrast information. Presumbably, one the reasons we make eye movements is to collect this lost contrast information. We have begun trying to measure that lost contrast information, so we can better understand how the visual system selects fixation locations.
26 c = sd/mean The idea is illustrated in this slide (explain). The image on the left has been blurred using a fairly accurate descriptive formula of the human contrast sensitivity function at different eccentricities (for brief stimulus presentations). These contrast sensitivity functions are quantitatively consistent with the increase in ganglion center sizes with eccentricity. As you can see, the greater the eccentricity the more effective blurring by the retina and hence the greater the uncertainty about the true local contrast. The question we ask is: Where should one fixate next to maximally reduce the total uncertainty about contrast for the entire image? To answer this question we need to know how contrast uncertainty depends on eccentricity. The direct way to answer this is to measure the statistics of local contrast in natural images, so that is what we did for 300 calibrated (1024 x 1024) 12-bit gray-scale natural images.
27 Calibrated Natural Images (van Hateren and van der Schaaf, 1998) We measured the effects of retinal blurring on local contrast in 300 natural images. These are calibrated 12-bit gray scale images. The measurements were straight forward. We blur each image by the transfer function of the human retina at a number of different retinal eccentricities. We then sample the images at a large number of randomly chosen locations and measure the probability distribution of the original unblurred contrast conditional on eccentricity and the observed blurred contrast at that eccentricity.
28 Posterior Probability Distributions for Local Contrast Here is a sample of these probability distributions. They are very systematic and can be summarized by three simple equations.
29 Descriptive Model of Posterior Probability Distributions of Local Contrast Mode: Average SD: Entropy: retinal eccentricity (deg) blurred RMS contrast Note uncertainty about contrast grows both with eccentricity and with the contrast that is observed at that eccentricity. How might the design of the visual system reflect these natural scene statistics.
30 Note that updating contrast uncertainty means saving the minimum uncertainty obtained so far during the fixation sequence, and that the stopping criterion might also be to fixate until time runs out.
31 First 9 fixations of the CEM algorithm. For the 16 images tested, the mean fixation length is 9 deg and the standard deviation is 2.5 deg. These are substantially larger saccades than is optimal for a search task. CEM algorithm performs very well at reducing total contrast uncertainty on individual images.
32 Here are average results for all 16 test images. The CEM algorithm performs substantially better than some simple alternatives (tile and random). The CEM algorithm does quite well at reducing total uncertainty as measured by mean squared error from original image (about 90% of optimal on average).
33 Conclusions from Second Example It is possible to measure the effects of the variable spatial resolution of the eye on the contrast statistics of natural scenes A potentially efficient fixation selection strategy may be to pick fixations that maximally reduce total contrast uncertainty Models based on this general approach could potentially be useful in predicting how humans use eye movements when extracting information from visual displays
34 Why Measure Natural Scene Statistics? Characterize natural stimuli Identify sources of stimulus information available for performing natural tasks Determine the dynamic range, reliability and utility of the stimulus information Generate hypotheses for visual mechanisms that might exploit the stimulus information Design experiments to test for the hypothesized mechanisms
Contour grouping: closure effects are explained by good continuation and proximity
Vision Research xxx (2004) xxx xxx www.elsevier.com/locate/visres Contour grouping: closure effects are explained by good continuation and proximity Tal Tversky a,b, Wilson S. Geisler a,c, *, Jeffrey S.
More informationPrincipals of Object Perception
Principals of Object Perception Elizabeth S. Spelke COGNITIVE SCIENCE 14, 29-56 (1990) Cornell University Summary Infants perceive object by analyzing tree-dimensional surface arrangements and motions.
More informationNeural circuits PSY 310 Greg Francis. Lecture 05. Rods and cones
Neural circuits PSY 310 Greg Francis Lecture 05 Why do you need bright light to read? Rods and cones Photoreceptors are not evenly distributed across the retina 1 Rods and cones Cones are most dense in
More informationPupil Dilation as an Indicator of Cognitive Workload in Human-Computer Interaction
Pupil Dilation as an Indicator of Cognitive Workload in Human-Computer Interaction Marc Pomplun and Sindhura Sunkara Department of Computer Science, University of Massachusetts at Boston 100 Morrissey
More informationAn Attentional Framework for 3D Object Discovery
An Attentional Framework for 3D Object Discovery Germán Martín García and Simone Frintrop Cognitive Vision Group Institute of Computer Science III University of Bonn, Germany Saliency Computation Saliency
More informationChanging expectations about speed alters perceived motion direction
Current Biology, in press Supplemental Information: Changing expectations about speed alters perceived motion direction Grigorios Sotiropoulos, Aaron R. Seitz, and Peggy Seriès Supplemental Data Detailed
More informationWhat is mid level vision? Mid Level Vision. What is mid level vision? Lightness perception as revealed by lightness illusions
What is mid level vision? Mid Level Vision March 18, 2004 Josh McDermott Perception involves inferring the structure of the world from measurements of energy generated by the world (in vision, this is
More informationMorton-Style Factorial Coding of Color in Primary Visual Cortex
Morton-Style Factorial Coding of Color in Primary Visual Cortex Javier R. Movellan Institute for Neural Computation University of California San Diego La Jolla, CA 92093-0515 movellan@inc.ucsd.edu Thomas
More informationAnnouncements. Perceptual Grouping. Quiz: Fourier Transform. What you should know for quiz. What you should know for quiz
Announcements Quiz on Tuesday, March 10. Material covered (Union not Intersection) All lectures before today (March 3). Forsyth and Ponce Readings: Chapters 1.1, 4, 5.1, 5.2, 5.3, 7,8, 9.1, 9.2, 9.3, 6.5.2,
More informationAttention Response Functions: Characterizing Brain Areas Using fmri Activation during Parametric Variations of Attentional Load
Attention Response Functions: Characterizing Brain Areas Using fmri Activation during Parametric Variations of Attentional Load Intro Examine attention response functions Compare an attention-demanding
More informationChapter 5: Perceiving Objects and Scenes
PSY382-Hande Kaynak, PhD 2/13/17 Chapter 5: Perceiving Objects and Scenes 1 2 Figure 5-1 p96 3 Figure 5-2 p96 4 Figure 5-4 p97 1 Why Is It So Difficult to Design a Perceiving Machine? The stimulus on the
More informationV1 (Chap 3, part II) Lecture 8. Jonathan Pillow Sensation & Perception (PSY 345 / NEU 325) Princeton University, Fall 2017
V1 (Chap 3, part II) Lecture 8 Jonathan Pillow Sensation & Perception (PSY 345 / NEU 325) Princeton University, Fall 2017 Topography: mapping of objects in space onto the visual cortex contralateral representation
More informationFundamentals of Psychophysics
Fundamentals of Psychophysics John Greenwood Department of Experimental Psychology!! NEUR3045! Contact: john.greenwood@ucl.ac.uk 1 Visual neuroscience physiology stimulus How do we see the world? neuroimaging
More informationLecturer: Rob van der Willigen 11/9/08
Auditory Perception - Detection versus Discrimination - Localization versus Discrimination - - Electrophysiological Measurements Psychophysical Measurements Three Approaches to Researching Audition physiology
More informationLecturer: Rob van der Willigen 11/9/08
Auditory Perception - Detection versus Discrimination - Localization versus Discrimination - Electrophysiological Measurements - Psychophysical Measurements 1 Three Approaches to Researching Audition physiology
More informationMEMORABILITY OF NATURAL SCENES: THE ROLE OF ATTENTION
MEMORABILITY OF NATURAL SCENES: THE ROLE OF ATTENTION Matei Mancas University of Mons - UMONS, Belgium NumediArt Institute, 31, Bd. Dolez, Mons matei.mancas@umons.ac.be Olivier Le Meur University of Rennes
More informationReading Assignments: Lecture 5: Introduction to Vision. None. Brain Theory and Artificial Intelligence
Brain Theory and Artificial Intelligence Lecture 5:. Reading Assignments: None 1 Projection 2 Projection 3 Convention: Visual Angle Rather than reporting two numbers (size of object and distance to observer),
More informationClassical Psychophysical Methods (cont.)
Classical Psychophysical Methods (cont.) 1 Outline Method of Adjustment Method of Limits Method of Constant Stimuli Probit Analysis 2 Method of Constant Stimuli A set of equally spaced levels of the stimulus
More informationAdapting internal statistical models for interpreting visual cues to depth
Journal of Vision (2010) 10(4):1, 1 27 http://journalofvision.org/10/4/1/ 1 Adapting internal statistical models for interpreting visual cues to depth Anna Seydell David C. Knill Julia Trommershäuser Department
More informationVIDEO SALIENCY INCORPORATING SPATIOTEMPORAL CUES AND UNCERTAINTY WEIGHTING
VIDEO SALIENCY INCORPORATING SPATIOTEMPORAL CUES AND UNCERTAINTY WEIGHTING Yuming Fang, Zhou Wang 2, Weisi Lin School of Computer Engineering, Nanyang Technological University, Singapore 2 Department of
More informationReading Assignments: Lecture 18: Visual Pre-Processing. Chapters TMB Brain Theory and Artificial Intelligence
Brain Theory and Artificial Intelligence Lecture 18: Visual Pre-Processing. Reading Assignments: Chapters TMB2 3.3. 1 Low-Level Processing Remember: Vision as a change in representation. At the low-level,
More informationSupplementary materials for: Executive control processes underlying multi- item working memory
Supplementary materials for: Executive control processes underlying multi- item working memory Antonio H. Lara & Jonathan D. Wallis Supplementary Figure 1 Supplementary Figure 1. Behavioral measures of
More informationBiologically-Inspired Human Motion Detection
Biologically-Inspired Human Motion Detection Vijay Laxmi, J. N. Carter and R. I. Damper Image, Speech and Intelligent Systems (ISIS) Research Group Department of Electronics and Computer Science University
More informationID# Exam 1 PS 325, Fall 2001
ID# Exam 1 PS 325, Fall 2001 As always, the Skidmore Honor Code is in effect, so keep your eyes foveated on your own exam. I tend to think of a point as a minute, so be sure to spend the appropriate amount
More informationModels of Attention. Models of Attention
Models of Models of predictive: can we predict eye movements (bottom up attention)? [L. Itti and coll] pop out and saliency? [Z. Li] Readings: Maunsell & Cook, the role of attention in visual processing,
More informationValidating the Visual Saliency Model
Validating the Visual Saliency Model Ali Alsam and Puneet Sharma Department of Informatics & e-learning (AITeL), Sør-Trøndelag University College (HiST), Trondheim, Norway er.puneetsharma@gmail.com Abstract.
More informationINDIVIDUAL DIFFERENCES, COGNITIVE ABILITIES, AND THE INTERPRETATION OF AUDITORY GRAPHS. Bruce N. Walker and Lisa M. Mauney
INDIVIDUAL DIFFERENCES, COGNITIVE ABILITIES, AND THE INTERPRETATION OF AUDITORY GRAPHS Bruce N. Walker and Lisa M. Mauney Sonification Lab, School of Psychology Georgia Institute of Technology, 654 Cherry
More informationIntroduction to Computational Neuroscience
Introduction to Computational Neuroscience Lecture 5: Data analysis II Lesson Title 1 Introduction 2 Structure and Function of the NS 3 Windows to the Brain 4 Data analysis 5 Data analysis II 6 Single
More informationLighta part of the spectrum of Electromagnetic Energy. (the part that s visible to us!)
Introduction to Physiological Psychology Vision ksweeney@cogsci.ucsd.edu cogsci.ucsd.edu/~ /~ksweeney/psy260.html Lighta part of the spectrum of Electromagnetic Energy (the part that s visible to us!)
More informationSpectrograms (revisited)
Spectrograms (revisited) We begin the lecture by reviewing the units of spectrograms, which I had only glossed over when I covered spectrograms at the end of lecture 19. We then relate the blocks of a
More informationPrentice Hall Connected Mathematics 2, Grade Correlated to: Michigan Grade Level Content Expectations (Grade 6)
NUMBER AND OPERATIONS Multiply and divide fractions N.MR.06.01 Understand division of fractions as the inverse of multiplication, e.g., if 4/5 2/3 =, then 2/3 = 4/5, so = 4/5 3/2 = 12/10. N.FL.06.02 Given
More informationIdentification of Tissue Independent Cancer Driver Genes
Identification of Tissue Independent Cancer Driver Genes Alexandros Manolakos, Idoia Ochoa, Kartik Venkat Supervisor: Olivier Gevaert Abstract Identification of genomic patterns in tumors is an important
More informationIntegration Mechanisms for Heading Perception
Seeing and Perceiving 23 (2010) 197 221 brill.nl/sp Integration Mechanisms for Heading Perception Elif M. Sikoglu 1, Finnegan J. Calabro 1, Scott A. Beardsley 1,2 and Lucia M. Vaina 1,3, 1 Brain and Vision
More informationDoes scene context always facilitate retrieval of visual object representations?
Psychon Bull Rev (2011) 18:309 315 DOI 10.3758/s13423-010-0045-x Does scene context always facilitate retrieval of visual object representations? Ryoichi Nakashima & Kazuhiko Yokosawa Published online:
More information(Visual) Attention. October 3, PSY Visual Attention 1
(Visual) Attention Perception and awareness of a visual object seems to involve attending to the object. Do we have to attend to an object to perceive it? Some tasks seem to proceed with little or no attention
More informationMental Imagery. What is Imagery? What We Can Imagine 3/3/10. What is nature of the images? What is the nature of imagery for the other senses?
Mental Imagery What is Imagery? What is nature of the images? Exact copy of original images? Represented in terms of meaning? If so, then how does the subjective sensation of an image arise? What is the
More informationSensory Cue Integration
Sensory Cue Integration Summary by Byoung-Hee Kim Computer Science and Engineering (CSE) http://bi.snu.ac.kr/ Presentation Guideline Quiz on the gist of the chapter (5 min) Presenters: prepare one main
More informationTheoretical Neuroscience: The Binding Problem Jan Scholz, , University of Osnabrück
The Binding Problem This lecture is based on following articles: Adina L. Roskies: The Binding Problem; Neuron 1999 24: 7 Charles M. Gray: The Temporal Correlation Hypothesis of Visual Feature Integration:
More informationSensory Adaptation within a Bayesian Framework for Perception
presented at: NIPS-05, Vancouver BC Canada, Dec 2005. published in: Advances in Neural Information Processing Systems eds. Y. Weiss, B. Schölkopf, and J. Platt volume 18, pages 1291-1298, May 2006 MIT
More informationChapter 11. Experimental Design: One-Way Independent Samples Design
11-1 Chapter 11. Experimental Design: One-Way Independent Samples Design Advantages and Limitations Comparing Two Groups Comparing t Test to ANOVA Independent Samples t Test Independent Samples ANOVA Comparing
More informationChapter 23. Inference About Means. Copyright 2010 Pearson Education, Inc.
Chapter 23 Inference About Means Copyright 2010 Pearson Education, Inc. Getting Started Now that we know how to create confidence intervals and test hypotheses about proportions, it d be nice to be able
More informationSensation & Perception PSYC420 Thomas E. Van Cantfort, Ph.D.
Sensation & Perception PSYC420 Thomas E. Van Cantfort, Ph.D. Objects & Forms When we look out into the world we are able to see things as trees, cars, people, books, etc. A wide variety of objects and
More informationIntroductory Laboratory 0: Buffon's Needle
Introductory Laboratory 0: Buffon's Needle Introduction: In geometry, the circumference of a circle divided by its diameter is a fundamental constant, denoted by the symbol ππ. Curiously, this number has
More informationSound Localization PSY 310 Greg Francis. Lecture 31. Audition
Sound Localization PSY 310 Greg Francis Lecture 31 Physics and psychology. Audition We now have some idea of how sound properties are recorded by the auditory system So, we know what kind of information
More informationIs Cognitive Science Special? In what way is it special? Cognitive science is a delicate mixture of the obvious and the incredible
Sept 3, 2013 Is Cognitive Science Special? In what way is it special? Zenon Pylyshyn, Rutgers Center for Cognitive Science Cognitive science is a delicate mixture of the obvious and the incredible What
More informationAutomated Assessment of Diabetic Retinal Image Quality Based on Blood Vessel Detection
Y.-H. Wen, A. Bainbridge-Smith, A. B. Morris, Automated Assessment of Diabetic Retinal Image Quality Based on Blood Vessel Detection, Proceedings of Image and Vision Computing New Zealand 2007, pp. 132
More informationIdeal cue combination for localizing texture-defined edges
M. S. Landy and H. Kojima Vol. 18, No. 9/September 2001/J. Opt. Soc. Am. A 2307 Ideal cue combination for localizing texture-defined edges Michael S. Landy and Haruyuki Kojima Department of Psychology
More informationMS&E 226: Small Data
MS&E 226: Small Data Lecture 10: Introduction to inference (v2) Ramesh Johari ramesh.johari@stanford.edu 1 / 17 What is inference? 2 / 17 Where did our data come from? Recall our sample is: Y, the vector
More informationContour Integration by the Human Visual System: Evidence for a Local Association Field
Vision Res. Vol. 33, No. 2, pp. 173-193, 1993 Printed in Great Britain. All rights reserved 0042-6989/93 $5.00 + 0.00 Copyright 0 1993 Pergamon Press Ltd Contour Integration by the Human Visual System:
More informationCompeting Frameworks in Perception
Competing Frameworks in Perception Lesson II: Perception module 08 Perception.08. 1 Views on perception Perception as a cascade of information processing stages From sensation to percept Template vs. feature
More informationCompeting Frameworks in Perception
Competing Frameworks in Perception Lesson II: Perception module 08 Perception.08. 1 Views on perception Perception as a cascade of information processing stages From sensation to percept Template vs. feature
More informationCoordination in Sensory Integration
15 Coordination in Sensory Integration Jochen Triesch, Constantin Rothkopf, and Thomas Weisswange Abstract Effective perception requires the integration of many noisy and ambiguous sensory signals across
More informationThe Color Between Two Others
The Color Between Two Others Ethan D. Montag Munsell Color Science Laboratory, Chester F. Carlson Center for Imaging Science Rochester Institute of Technology, Rochester, New York Abstract A psychophysical
More informationVisual Selection and Attention
Visual Selection and Attention Retrieve Information Select what to observe No time to focus on every object Overt Selections Performed by eye movements Covert Selections Performed by visual attention 2
More informationThe effects of subthreshold synchrony on the perception of simultaneity. Ludwig-Maximilians-Universität Leopoldstr 13 D München/Munich, Germany
The effects of subthreshold synchrony on the perception of simultaneity 1,2 Mark A. Elliott, 2 Zhuanghua Shi & 2,3 Fatma Sürer 1 Department of Psychology National University of Ireland Galway, Ireland.
More informationAn Ideal Observer Model of Visual Short-Term Memory Predicts Human Capacity Precision Tradeoffs
An Ideal Observer Model of Visual Short-Term Memory Predicts Human Capacity Precision Tradeoffs Chris R. Sims Robert A. Jacobs David C. Knill (csims@cvs.rochester.edu) (robbie@bcs.rochester.edu) (knill@cvs.rochester.edu)
More informationM Cells. Why parallel pathways? P Cells. Where from the retina? Cortical visual processing. Announcements. Main visual pathway from retina to V1
Announcements exam 1 this Thursday! review session: Wednesday, 5:00-6:30pm, Meliora 203 Bryce s office hours: Wednesday, 3:30-5:30pm, Gleason https://www.youtube.com/watch?v=zdw7pvgz0um M Cells M cells
More informationComputational Cognitive Science
Computational Cognitive Science Lecture 15: Visual Attention Chris Lucas (Slides adapted from Frank Keller s) School of Informatics University of Edinburgh clucas2@inf.ed.ac.uk 14 November 2017 1 / 28
More informationPerception. Chapter 8, Section 3
Perception Chapter 8, Section 3 Principles of Perceptual Organization The perception process helps us to comprehend the confusion of the stimuli bombarding our senses Our brain takes the bits and pieces
More informationLearning the Meaning of Neural Spikes Through Sensory-Invariance Driven Action
Learning the Meaning of Neural Spikes Through Sensory-Invariance Driven Action Yoonsuck Choe and S. Kumar Bhamidipati Department of Computer Science Texas A&M University College Station, TX 77843-32 {choe,bskumar}@tamu.edu
More informationEARLY STAGE DIAGNOSIS OF LUNG CANCER USING CT-SCAN IMAGES BASED ON CELLULAR LEARNING AUTOMATE
EARLY STAGE DIAGNOSIS OF LUNG CANCER USING CT-SCAN IMAGES BASED ON CELLULAR LEARNING AUTOMATE SAKTHI NEELA.P.K Department of M.E (Medical electronics) Sengunthar College of engineering Namakkal, Tamilnadu,
More informationCh.20 Dynamic Cue Combination in Distributional Population Code Networks. Ka Yeon Kim Biopsychology
Ch.20 Dynamic Cue Combination in Distributional Population Code Networks Ka Yeon Kim Biopsychology Applying the coding scheme to dynamic cue combination (Experiment, Kording&Wolpert,2004) Dynamic sensorymotor
More informationSelective Attention. Chapter Definition and Domain. Contents
Chapter 2 Selective Attention Contents 2.1 Definition and Domain............................. 5 2.2 Spatial Cueing.................................. 9 2.3 Partially-Valid Cueing.............................
More informationChapter 5: Perceiving Objects and Scenes
Chapter 5: Perceiving Objects and Scenes The Puzzle of Object and Scene Perception The stimulus on the receptors is ambiguous. Inverse projection problem: An image on the retina can be caused by an infinite
More informationOverview of the visual cortex. Ventral pathway. Overview of the visual cortex
Overview of the visual cortex Two streams: Ventral What : V1,V2, V4, IT, form recognition and object representation Dorsal Where : V1,V2, MT, MST, LIP, VIP, 7a: motion, location, control of eyes and arms
More informationObject vision (Chapter 4)
Object vision (Chapter 4) Lecture 8 Jonathan Pillow Sensation & Perception (PSY 345 / NEU 325) Princeton University, Spring 2015 1 Outline for today: Chap 3: adaptation Chap 4: intro to object vision gestalt
More informationNeural codes PSY 310 Greg Francis. Lecture 12. COC illusion
Neural codes PSY 310 Greg Francis Lecture 12 Is 100 billion neurons enough? COC illusion The COC illusion looks like real squares because the neural responses are similar True squares COC squares Ganglion
More informationSupplementary Note Psychophysics:
Supplementary Note More detailed description of MM s subjective experiences can be found on Mike May s Perceptions Home Page, http://www.senderogroup.com/perception.htm Psychophysics: The spatial CSF was
More informationRules of apparent motion: The shortest-path constraint: objects will take the shortest path between flashed positions.
Rules of apparent motion: The shortest-path constraint: objects will take the shortest path between flashed positions. The box interrupts the apparent motion. The box interrupts the apparent motion.
More informationPerception Lab Reports. Style Guide. Aaron Bornstein
Perception Lab Reports Style Guide Aaron Bornstein - aaronb@nyu.edu 09.23.2008 Introduction - Goals Motivate the study What is this illusion / effect, what might it say about basic perception? Motivate
More informationGraphical Modeling Approaches for Estimating Brain Networks
Graphical Modeling Approaches for Estimating Brain Networks BIOS 516 Suprateek Kundu Department of Biostatistics Emory University. September 28, 2017 Introduction My research focuses on understanding how
More informationCOGS 121 HCI Programming Studio. Week 03
COGS 121 HCI Programming Studio Week 03 Direct Manipulation Principles of Direct Manipulation 1. Continuous representations of the objects and actions of interest with meaningful visual metaphors. 2. Physical
More informationFirefighter safety: How visible is your protective clothing?
News Article ID: 4028 Fire international 23 April 2003 Firefighter safety: How visible is your protective clothing? TNO Human Factors Research Institute has developed a method to determine visual conspicuity
More informationWhy do we need vision? We need vision for two quite different but complementary reasons We need vision to give us detailed knowledge of the world beyo
So, What Has Vision Done For Me Lately? Prepared for ICBO Ontario, CA By: R. A. Hohendorf OD April 2010 Why do we need vision? We need vision for two quite different but complementary reasons We need vision
More informationCancer Cells Detection using OTSU Threshold Algorithm
Cancer Cells Detection using OTSU Threshold Algorithm Nalluri Sunny 1 Velagapudi Ramakrishna Siddhartha Engineering College Mithinti Srikanth 2 Velagapudi Ramakrishna Siddhartha Engineering College Kodali
More informationComputational Models of Visual Attention: Bottom-Up and Top-Down. By: Soheil Borhani
Computational Models of Visual Attention: Bottom-Up and Top-Down By: Soheil Borhani Neural Mechanisms for Visual Attention 1. Visual information enter the primary visual cortex via lateral geniculate nucleus
More informationPearson Edexcel International GCSE in Mathematics (Specification A) (9-1) Exemplar student answers with examiner comments
Pearson Edexcel International GCSE in Mathematics (Specification A) (9-1) Exemplar student answers with examiner comments 1 Contents About this booklet... 3 How to use this booklet.... 3 Guide on the use
More informationUnit 1 Exploring and Understanding Data
Unit 1 Exploring and Understanding Data Area Principle Bar Chart Boxplot Conditional Distribution Dotplot Empirical Rule Five Number Summary Frequency Distribution Frequency Polygon Histogram Interquartile
More informationModeling the Deployment of Spatial Attention
17 Chapter 3 Modeling the Deployment of Spatial Attention 3.1 Introduction When looking at a complex scene, our visual system is confronted with a large amount of visual information that needs to be broken
More informationName Psychophysical Methods Laboratory
Name Psychophysical Methods Laboratory 1. Classical Methods of Psychophysics These exercises make use of a HyperCard stack developed by Hiroshi Ono. Open the PS 325 folder and then the Precision and Accuracy
More informationANALYSIS AND DETECTION OF BRAIN TUMOUR USING IMAGE PROCESSING TECHNIQUES
ANALYSIS AND DETECTION OF BRAIN TUMOUR USING IMAGE PROCESSING TECHNIQUES P.V.Rohini 1, Dr.M.Pushparani 2 1 M.Phil Scholar, Department of Computer Science, Mother Teresa women s university, (India) 2 Professor
More informationEDGE DETECTION. Edge Detectors. ICS 280: Visual Perception
EDGE DETECTION Edge Detectors Slide 2 Convolution & Feature Detection Slide 3 Finds the slope First derivative Direction dependent Need many edge detectors for all orientation Second order derivatives
More informationIAT 355 Perception 1. Or What You See is Maybe Not What You Were Supposed to Get
IAT 355 Perception 1 Or What You See is Maybe Not What You Were Supposed to Get Why we need to understand perception The ability of viewers to interpret visual (graphical) encodings of information and
More informationGrounding Ontologies in the External World
Grounding Ontologies in the External World Antonio CHELLA University of Palermo and ICAR-CNR, Palermo antonio.chella@unipa.it Abstract. The paper discusses a case study of grounding an ontology in the
More informationVision and Action. 10/3/12 Percep,on Ac,on 1
Vision and Action Our ability to move thru our environment is closely tied to visual perception. Simple examples include standing one one foot. It is easier to maintain balance with the eyes open than
More informationLEA Color Vision Testing
To The Tester Quantitative measurement of color vision is an important diagnostic test used to define the degree of hereditary color vision defects found in screening with pseudoisochromatic tests and
More informationIntroduction to Computational Neuroscience
Introduction to Computational Neuroscience Lecture 11: Attention & Decision making Lesson Title 1 Introduction 2 Structure and Function of the NS 3 Windows to the Brain 4 Data analysis 5 Data analysis
More informationIAT 814 Knowledge Visualization. Visual Attention. Lyn Bartram
IAT 814 Knowledge Visualization Visual Attention Lyn Bartram Why we care in an information-rich world, the wealth of information means a dearth of something else: a scarcity of whatever it is that information
More informationLearning from data when all models are wrong
Learning from data when all models are wrong Peter Grünwald CWI / Leiden Menu Two Pictures 1. Introduction 2. Learning when Models are Seriously Wrong Joint work with John Langford, Tim van Erven, Steven
More informationThe Attraction of Visual Attention to Texts in Real-World Scenes
The Attraction of Visual Attention to Texts in Real-World Scenes Hsueh-Cheng Wang (hchengwang@gmail.com) Marc Pomplun (marc@cs.umb.edu) Department of Computer Science, University of Massachusetts at Boston,
More informationpsychology of visual perception C O M M U N I C A T I O N D E S I G N, A N I M A T E D I M A G E 2014/2015
psychology of visual perception C O M M U N I C A T I O N D E S I G N, A N I M A T E D I M A G E 2014/2015 Lesson #2: Sept. 29 th 2014 Lecture plan: SENSORY AND PERCEPTUAL PROCESSES Basic concepts; Sensation;
More informationLimitations of Object-Based Feature Encoding in Visual Short-Term Memory
Journal of Experimental Psychology: Human Perception and Performance 2002, Vol. 28, No. 2, 458 468 Copyright 2002 by the American Psychological Association, Inc. 0096-1523/02/$5.00 DOI: 10.1037//0096-1523.28.2.458
More informationLocal Image Structures and Optic Flow Estimation
Local Image Structures and Optic Flow Estimation Sinan KALKAN 1, Dirk Calow 2, Florentin Wörgötter 1, Markus Lappe 2 and Norbert Krüger 3 1 Computational Neuroscience, Uni. of Stirling, Scotland; {sinan,worgott}@cn.stir.ac.uk
More informationNeural Networks: Tracing Cellular Pathways. Lauren Berryman Sunfest 2000
Neural Networks: Tracing Cellular Pathways Lauren Berryman Sunfest 000 Neural Networks: Tracing Cellular Pathways Research Objective Background Methodology and Experimental Approach Results and Conclusions
More informationVISUAL PERCEPTION & COGNITIVE PROCESSES
VISUAL PERCEPTION & COGNITIVE PROCESSES Prof. Rahul C. Basole CS4460 > March 31, 2016 How Are Graphics Used? Larkin & Simon (1987) investigated usefulness of graphical displays Graphical visualization
More informationDo you have to look where you go? Gaze behaviour during spatial decision making
Do you have to look where you go? Gaze behaviour during spatial decision making Jan M. Wiener (jwiener@bournemouth.ac.uk) Department of Psychology, Bournemouth University Poole, BH12 5BB, UK Olivier De
More informationThe influence of clutter on real-world scene search: Evidence from search efficiency and eye movements
The influence of clutter on real-world scene search: Evidence from search efficiency and eye movements John Henderson, Myriam Chanceaux, Tim Smith To cite this version: John Henderson, Myriam Chanceaux,
More informationToday s Agenda. Human abilities Cognition Review for Exam1
Today s Agenda Human abilities Cognition Review for Exam1 Announcement Exam 1 is scheduled Monday, Oct. 1 st, in class Cover materials until Sep. 24 Most of materials from class lecture notes You are allowed
More informationFramework for Comparative Research on Relational Information Displays
Framework for Comparative Research on Relational Information Displays Sung Park and Richard Catrambone 2 School of Psychology & Graphics, Visualization, and Usability Center (GVU) Georgia Institute of
More informationCognitive Processes PSY 334. Chapter 2 Perception
Cognitive Processes PSY 334 Chapter 2 Perception Object Recognition Two stages: Early phase shapes and objects are extracted from background. Later phase shapes and objects are categorized, recognized,
More information