RESEARCH ON SPOKEN LANGUAGE PROCESSING Progress Report No. 26 (2003-2004) David B. Pisoni, Ph.D. Principal Investigator Speech Research Laboratory Department of Psychology Indiana University Bloomington, Indiana 47405-1301 Research Supported by: Department of Health and Human Services U.S. Public Health Service National Institutes of Health Research Grant No. DC-00111 and National Institutes of Health Training Grant No. DC-00012 2004 Indiana University
ii
RESEARCH ON SPOKEN LANGUAGE PROCESSING Progress Report No. 26 (2003-2004) Table of Contents Introduction... v Speech Research Laboratory Faculty, Staff, and Technical Personnel... vi I. Extended Manuscripts... 1 Speech Perception in Deaf Children with Cochlear Implants David B. Pisoni... 3 Some New Experiments on Perceptual Categorization of Dialect Variation in American English: Acoustic Analysis and Linguistic Experience Cynthia G. Clopper and David B. Pisoni... 29 Working Memory Capacity, Verbal Rehearsal Speed, and Scanning in Deaf Children with Cochlear Implants Rose A. Burkholder and David B. Pisoni... 47 Detection of Auditory-Visual Asynchrony in Speech and Nonspeech Signals Brianna L. Conrey and David B. Pisoni... 71 Perception and Comprehension of Synthetic Speech Stephen J. Winters and David B. Pisoni... 95 Some Effects of Feedback on the Perception of Point-Light and Full-Face Visual Displays of Speech: A Preliminary Report Stephen J. Winters and David B. Pisoni... 139 Speech and Language Development in Cognitively Delayed Children with Cochlear Implants Rachael F. Holt and Karen I. Kirk... 165 Nonword Repetition and Reading in Deaf Children with Cochlear Implants Caitlin M. Dillon and David B. Pisoni... 187 Development of Visual Attention Skills of Prelingually Deaf Children Who Use Cochlear Implants David L. Horn, Rebecca A.O. Davis, and David B. Pisoni... 205 II. Short Reports and Work-in Progress... 233 Mothers Speech to Hearing-Impaired Infants with Cochlear Implants: Some Preliminary Findings Tonya R. Bergeson and Kasi McCune... 235 iii
Effects of a Cochlear Implant Simulation on Immediate Memory Span in Normal-Hearing Adults Rose A. Burkholder, David B. Pisoni and Mario A. Svirsky... 245 Visual and Visual-Spatial Memory Measures in Children with Cochlear Implants Miranda Cleary and David B. Pisoni... 259 Perceptual Learning and Nonword Repetition using a Cochlear Implant Simulation Rose A. Burkholder, David B. Pisoni and Mario A. Svirsky... 275 Some Effects of Early Musical Experience on Sequence Memory Spans Adam T. Tierney and David B. Pisoni... 289 Behavioral Inhibition and Audiological Outcomes in Prelingually Deaf Children with Cochlear Implants David L. Horn, Rebecca A.O. Davis, and David B. Pisoni... 307 Sequence Learning as a Predictor of Outcomes in Deaf Children with Cochlear Implants David B. Pisoni and Rebecca A.O. Davis... 319 Speech Perception Skills of Deaf Children with Cochlear Implants David B. Pisoni... 331 Multimodal Sentence Intelligibility and the Detection of Auditory-Visual Asynchrony in Speech and Nonspeech Signals: A First Report Brianna L. Conrey... 345 III. Publications: 2003-2004... 357 IV. Cumulative Index: Progress Reports Nos. 1-25 Steven B. Chin... 367 iv
INTRODUCTION This is the twenty-sixth annual progress report summarizing research activities on speech perception and spoken language processing carried out in the Speech Research Laboratory, Department of Psychology, Indiana University in Bloomington. As with previous reports, our main goal has been to summarize our accomplishments over the past year and make them readily available to granting agencies, sponsors and interested colleagues in the field. Some of the papers contained in this report are extended manuscripts that have been prepared for formal publication as journal articles or book chapters. Other papers are simply short reports of research presented at professional meetings during the past year or brief summaries of on-going research projects in the laboratory. From time to time, we also have included new information on instrumentation and software developments when we think this information would be of interest or help to others. We have found the sharing of this information to be very useful in facilitating research. We are distributing progress reports of our research activities because of the ever increasing lag in journal publications and the resulting delay in the dissemination of new information and research findings in the field of spoken language processing. We are, of course, very interested in following the work of other colleagues who are carrying out research on speech perception and spoken language processing and we would be grateful if you and your colleagues would send us copies of any recent reprints, preprints and progress reports as they become available so that we can keep up with your latest findings. Please address all correspondence to: Professor David B. Pisoni Speech Research Laboratory Department of Psychology Indiana University Bloomington, Indiana 47405-1301 USA Telephone: (812) 855-1155, 855-1768 Facsimile: (812) 855-1300 E-mail: pisoni@indiana.edu Web: http://www.indiana.edu/~srlweb Copies of this report are being sent primarily to libraries and specific research institutions rather than individual scientists. Because of the rising costs of publication and printing, it is not possible to provide multiple copies of this report to people at the same institution or issue copies to individuals. We are eager to enter into exchange agreements with other institutions for their reports and publications. Please write to the above address for further information. The information contained in this progress report is freely available to the public and is not restricted in any way. The views expressed in these research reports are those of the individual authors and do not reflect the opinions of the granting agencies or sponsors of the specific research. SPEECH THE FINAL FRONTIER v
SPEECH RESEARCH LABORATORY FACULTY, STAFF, AND TECHNICAL PERSONNEL (January 1, 2003 September 1, 2004) RESEARCH PERSONNEL David B. Pisoni, Ph.D... Chancellors Professor of Psychology and Cognitive Science 1,2 Karen I. Kirk, Ph.D... Associate Professor of Otolaryngology Head and Neck Surgery 3, 4 Mario A. Svirsky, Ph.D...Professor of Otolaryngology Head and Neck Surgery 3,5 Steven B. Chin, Ph.D....Associate Scientist in Otolaryngology Head and Neck Surgery 3 Derek Houston, Ph.D.... Assistant Professor of Otolaryngology Head and Neck Surgery 3 Tonya Bergeson, Ph.D.... Assistant Professor of Otolaryngology Head and Neck Surgery 3 Woo Sui Teoh, M.D...NIH Postdoctoral Trainee 3 David L. Horn, M.D...NIH Postdoctoral Trainee 3 Rachael F. Holt, Ph.D....NIH Postdoctoral Trainee 3 Stephen J. Winters, Ph.D.... NIH Postdoctoral Trainee Ana Schwartz, Ph.D...NIH Postdoctoral Trainee 6 Rose Burkholder, B.S....NIH Predoctoral Trainee Cynthia G. Clopper, B.A...NIH Predoctoral Trainee Brianna Conrey, B.A... NSF Predoctoral Trainee Caitlin M. Dillon, B.A....NIH Predoctoral Trainee Elena Breiter... Undergraduate Research Assistant Adam Tierney... Undergraduate Research Assistant Sara Phillips... Undergraduate Research Assistant TECHNICAL PERSONNEL Luis R. Hernández, B.A... Research Associate in Psychology Darla J. Sallee...Administrative Assistant Kuai Hinojosa...Applications Programmer Rebecca A.O. Davis...Research Technician Lanier F. Holt, B.A....Editorial Assistant 1 Also Adjunct Professor of Linguistics, Indiana University, Bloomington, IN. 2 Also Adjunct Professor of Otolaryngology Head and Neck Surgery, Indiana University School of Medicine, Indianapolis, IN. 3 Department of Otolaryngology Head and Neck Surgery, Indiana University School of Medicine, Indianapolis, IN. 4 Also Adjunct Associate Professor of Speech and Hearing Sciences, Indiana University, Bloomington, IN. 5 Also Adjunct Professor of Electrical Engineering, Purdue School of Engineering and Technology, Indianapolis, IN. 6 Now at the Department of Psychology, University of Texas at El Paso, El Paso, TX. vi
E-MAIL ADDRESSES Tonya Bergeson... tbergeso@iupui.edu Elena Brieter...ebrieter@indiana.edu Rose Burkholder... rburkhol@indiana.edu Steven B. Chin... schin@iupui.edu Cynthia G. Clopper... cclopper@indiana.edu Rebecca Davis... robryan@iupui.edu Caitlin M. Dillon...cmdillon@indiana.edu Luis R. Hernández... hernande@indiana.edu Rachael F. Holt...raholt@indiana.edu David L. Horn... dlhorn@iupui.edu Derek Houston... dmhousto@indiana.edu Karen I. Kirk... kkirk@iupui.edu Sara Phillips...sacphill@indiana.edu David B. Pisoni... pisoni@indiana.edu Darla J. Sallee...dsallee@indiana.edu Mario A. Svirsky...msvirsky@iupui.edu Woo Sui Teoh... stech@iupui.edu Adam Tierney... attierne@indiana.edu Stephen J. Winters... stwinter@indiana.edu vii