Springer. Springer Handbook of Auditory Research. Series Editors: Richard R. Fay and Arthur N. Popper

Transcription

1 Springer Handbook of Auditory Research Series Editors: Richard R. Fay and Arthur N. Popper Springer New York Berlin Heidelberg Hong Kong London Milan Paris Tokyo

2 Steven Greenberg Arthur N. Popper Editors William A. Ainsworth Richard R. Fay Speech Processing in the Auditory System With 83 Illustrations 13

3 Steven Greenberg The Speech Institute Berkeley, CA 94704, USA Arthur N. Popper Department of Biology and Neuroscience and Cognitive Science Program and Center for Comparative and Evolutionary Biology of Hearing University of Maryland College Park, MD , USA William A. Ainsworth (deceased) Department of Communication and Neuroscience Keele University Keele, Staffordshire ST5 3BG, UK Richard R. Fay Department of Psychology and Parmly Hearing Institute Loyola University of Chicago Chicago, IL USA Series Editors: Richard R. Fay and Arthur N. Popper Cover illustration: Details from Figs. 5.8: Effects of reverberation on speech spectrogram (p. 270) and 8.4: Temporospatial pattern of action potentials in a group of nerve fibers (p. 429). Library of Congress Cataloging-in-Publication Data Speech processing in the auditory system / editors, Steven Greenberg...[et al.]. p. cm. (Springer handbook of auditory research ; v. 18) Includes bibliographical references and index. ISBN (hbk. : alk. paper) 1. Audiometry Handbooks, manuals, etc. 2. Auditory pathways Handbooks, manuals, etc. 3. Speech perception Handbooks, manuals, etc. 4. Speech processing systems Handbooks, manuals, etc. 5. Hearing Handbooks, manuals, etc. I. Greenberg, Steven. II. Series. RF291.S dc ISBN Printed on acid-free paper Springer-Verlag New York, Inc. All rights reserved. This work may not be translated or copied in whole or in part without the written permission of the publisher (Springer-Verlag New York, Inc., 175 Fifth Avenue, New York, NY 10010, USA), except for brief excerpts in connection with reviews or scholarly analysis. Use in connection with any form of information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed is forbidden. The use in this publication of trade names, trademarks, service marks, and similar terms, even if they are not identified as such, is not to be taken as an expression of opinion as to whether or not they are subject to proprietary rights. Printed in the United States of America. (EB) SPIN Springer-Verlag is a part of Springer Science+Business Media springeronline.com

4 In Memoriam William A. Ainsworth This book is dedicated to the memory of Bill Ainsworth, who unexpectedly passed away shortly before this book s completion. He was an extraordinarily gifted scientist who pioneered many areas of speech research relating to perception, production, recognition, and synthesis. Bill was also an exceptionally warm and friendly colleague who touched the lives of many in the speech community. He will be sorely missed.

5 Series Preface The Springer Handbook of Auditory Research presents a series of comprehensive and synthetic reviews of the fundamental topics in modern auditory research. The volumes are aimed at all individuals with interests in hearing research including advanced graduate students, post-doctoral researchers, and clinical investigators. The volumes are intended to introduce new investigators to important aspects of hearing science and to help established investigators to better understand the fundamental theories and data in fields of hearing that they may not normally follow closely. Each volume presents a particular topic comprehensively, and each chapter serves as a synthetic overview and guide to the literature. As such, the chapters present neither exhaustive data reviews nor original research that has not yet appeared in peer-reviewed journals. The volumes focus on topics that have developed a solid data and conceptual foundation rather than on those for which a literature is only beginning to develop. New research areas will be covered on a timely basis in the series as they begin to mature. Each volume in the series consists of a few substantial chapters on a particular topic. In some cases, the topics will be ones of traditional interest for which there is a substantial body of data and theory, such as auditory neuroanatomy (Vol. 1) and neurophysiology (Vol. 2). Other volumes in the series will deal with topics that have begun to mature more recently, such as development, plasticity, and computational models of neural processing. In many cases, the series editors will be joined by a co-editor having special expertise in the topic of the volume. Richard R. Fay, Chicago, Illinois Arthur N. Popper, College Park, Maryland vii

6 Preface Although our sense of hearing is exploited for many ends, its communicative function stands paramount in our daily lives. Humans are, by nature, a vocal species and it is perhaps not too much of an exaggeration to state that what makes us unique in the animal kingdom is our ability to communicate via the spoken word. Virtually all of our social nature is predicated on verbal interaction, and it is likely that this capability has been largely responsible for the rapid evolution of humans. Our verbal capability is often taken for granted; so seamlessly does it function under virtually all conditions encountered. The intensity of the acoustic background hardly matters from the hubbub of a cocktail party to the roar of waterfall s descent, humans maintain their ability to interact verbally in a remarkably diverse range of acoustic environments. Only when our sense of hearing falters does the auditory system s masterful role become truly apparent. This volume of the Springer Handbook of Auditory Research examines speech communication and the processing of speech sounds by the nervous system. As such, it is a natural companion to many of the volumes in the series that ask more fundamental questions about hearing and processing of sound. In the first chapter, Greenberg and the late Bill Ainsworth provide an important overview on the processing of speech sounds and consider a number of the theories pertaining to detection and processing of communication signals. In Chapter 2, Avendaño, Deng, Hermansky, and Gold discuss the analysis and representation of speech in the brain, while in Chapter 3, Diehl and Lindblom deal with specific features and phonemes of speech. The physiological representations of speech at various levels of the nervous system are considered by Palmer and Shamma in Chapter 4. One of the most important aspects of speech perception is that speech can be understood under adverse acoustic conditions, and this is the theme of Chapter 5 by Assmann and Summerfield. The growing interest in speech recognition and attempts to automate this process are discussed by Morgan, Bourlard, and Hermansky in Chapter 6. Finally, the very significant issues related to hearing impairment and ways to mitigate these issues are considered first ix

7 x Preface by Edwards (Chapter 7) with regard to hearing aids and then by Clark (Chapter 8) for cochlear implants and speech processing. Clearly, while previous volumes in the series have not dealt with speech processing per se, chapters in a number of volumes provide background and related topics from a more basic perspective. For example, chapters in The Mammalian Auditory Pathway: Neurophysiology (Vol. 2) and in Integrative Functions in the Mammalian Auditory Pathway (Vol. 15) help provide an understanding of central processing of sounds in mammals. Various chapters in Human Psychophysics (Vol. 3) deal with sound perception and processing by humans, while chapters in Auditory Computation (Vol. 6) discuss computational models related to speech detection and processing. The editors would like to thank the chapter authors for their hard work and diligence in preparing the material that appears in this book. Steven Greenberg expresses his gratitude to the series editors, Arthur Popper and Richard Fay, for their encouragement and patience throughout this volume s lengthy gestation period. Steven Greenberg, Berkeley, California Arthur N. Popper, College Park, Maryland Richard R. Fay, Chicago, Illinois

8 Contents Series Preface Preface Contributors vii ix xiii Chapter 1 Speech Processing in the Auditory System: An Overview Steven Greenberg and William A. Ainsworth Chapter 2 The Analysis and Representation of Speech Carlos Avendaño,Li Deng,Hynek Hermansky, and Ben Gold Chapter 3 Explaining the Structure of Feature and Phoneme Inventories: The Role of Auditory Distinctiveness Randy L. Diehl and Björn Lindblom Chapter 4 Physiological Representations of Speech Alan Palmer and Shihab Shamma Chapter 5 The Perception of Speech Under Adverse Conditions Peter Assmann and Quentin Summerfield Chapter 6 Automatic Speech Recognition: An Auditory Perspective Nelson Morgan, Hervé Bourlard, and Hynek Hermansky Chapter 7 Hearing Aids and Hearing Impairment Brent Edwards Chapter 8 Cochlear Implants Graeme Clark Index xi

9 Contributors William A. Ainsworth Department of Communication & Neuroscience, Keele University, Keele, Staffordshire ST5 3BG, UK Peter Assmann School of Human Development, University of Texas Dallas, Richardson, TX , USA Carlos Avendaño Creative Advanced Technology Center, Scotts Valley, CA 95067, USA Hervé Bourlard Dalle Molle Institute for Perceptual Artificial Intelligence, CH-1920 Martigny, Switzerland Graeme Clark Centre for Hearing Communication Research and Co-operative Research Center for Cochlear Implant Speech and Hearing Center, Melbourne, Australia Li Deng Microsoft Corporation, Redmond, WA 98052, USA Randy Diehl Psychology Department, University of Texas, Austin, TX 78712, USA Brent Edwards Sound ID, Palo Alto, CA 94303, USA Ben Gold MIT Lincoln Laboratory, Lexington, MA 02173, USA Deceased xiii

10 xiv Contributors Steven Greenberg The Speech Institute, Berkeley, CA 94704, USA Hynek Hermansky Dalle Molle Institute for Perceptual Artificial Intelligence, CH-1920, Martigny, Switzerland Björn Lindblom Department of Linguistics, Stockholm University, S Stockholm, Sweden Nelson Morgan International Computer Science Institute, Berkeley, CA 94704, USA Alan Palmer MRC Institute of Hearing Research, University Park, Nottingham NG7 2RD, UK Shihab Shamma Department of Electrical and Computer Engineering, University of Maryland, College Park, MD 20742, USA Quentin Summerfield MRC Institute of Hearing Research, University Park, Nottingham NG7 2RD, UK