Institute of Communication Acoustics Chair of Information Technology. Ruhr-Universität Bochum

Transcription

1 Institute of Communication Acoustics Chair of Information Technology Ruhr-Universität Bochum

2 Institute of Communication Acoustics Institute of Communication Acoustics Ruhr-Universität Bochum 2

3 Institute of Communication Acoustics Founded in 1974 by Prof. J. Blauert Staff: Prof. R. Martin (since October 1, 2003) Prof. em. J. Blauert Prof. H. Hudde PD Dr.-phil. U. Jekosch 13 fulltime researchers (75 % external funding) 10 part time research assistents 2 guest scientists 8 support staff (administration, computer services, etc.) Institute of Communication Acoustics Ruhr-Universität Bochum 3

4 Research Groups Speech Processing (Prof. Martin) Acoustic Simulations and Vibration Measurements (Prof. Hudde) Auditory Quality of Systems (Dr. Jekosch, Dr. Möller) Analysis and Synthesis of Auditory Scenes (Prof. Blauert, Dr. Novo) Institute of Communication Acoustics Ruhr-Universität Bochum 4

5 Current Research Projects EU-CROSSES: Crowds simulation for emergency situations EU-INSPIRE: Infotainment management with speech interaction via remote microphones and telephone interfaces EU-MOVII: Multi-user virtual interactive interface IGSN: International Graduate School of Neuroscience: Auditory-Tactile Interaction in Virtual Environments NICCIMON: Competence Center of Lower Saxony for Information Systems for Mobile Usage VW: Microphone Arrays for Detection and Localisation of Noise Sources Harman/Becker: Quality Assessment of Rooms by Means of Binaural Models. Institute of Communication Acoustics Ruhr-Universität Bochum 5

6 Current Research Projects DFG: Enhancement of Noisy Speech DFG: Typology and Rule-Based Modelling of Non-Native Pronunciation Variants for Speech Technology DFG: Binaural Hearing in Multiple-Sound-Source-Scenarios EU-HOARSE: Evaluating Spaciousness and Other Psychoacoustical Effects Related to Room Acoustics EU-HOARSE: Psychoacoustical Investigations on the Precedence Effect (DFG: German Research Foundation) Institute of Communication Acoustics Ruhr-Universität Bochum 6

7 Teaching IKA plays an active role in the Electrical Engineering and Information Technology IT-Security Applied Computer Science curricula. Institute of Communication Acoustics Ruhr-Universität Bochum 7

8 Lectures and Laboratories Principles of Information Technology I + II Speech Processing I + II Principles of Communication Acoustics Acoustics of Hearing Communication Quality in Speech Technology Information Technology Lab Communication Acoustics Lab Institute of Communication Acoustics Ruhr-Universität Bochum 8

9 Research Group Speech Processing and Signal Theory Prof. Dr.-Ing. Rainer Martin Dipl.-Ing. Colin Breithaupt Nilesh Madhu, MSc. Dipl.-Ing. Dirk Mauler

10 Speech Processing and Signal Theory Objectives: Systems for human-human and humanmachine communication Research topics: Noise reduction and microphone arrays Source localization Robust speech recognition and speech coding Blind source separation Systems for real-time processing Multi-modal human-machine interfaces Institute of Communication Acoustics Ruhr-Universität Bochum 10

11 Speech Enhancement Improved statistical models speech transmission in mobile radio, hearing aids, and robust speech recognition. Improvement of intelligibility of monaural algorithms Improvement of recognition rates Dereverberation of speech (binaural, arrays) Institute of Communication Acoustics Ruhr-Universität Bochum 11

12 Multi-modal Interfaces Combination of speech recognition and other modes of interaction, e. g., gesture recognition Multi-modal human-human and human-machine interfaces lab Applications: Teleconferencing Telepresence Virtual (auditory) environments Quality assessment Institute of Communication Acoustics Ruhr-Universität Bochum 12

13 Joint Recognition of Speech and Gestures gesture recognition camera combination of recognition results application preprocessing speech recognition microphone array Institute of Communication Acoustics Ruhr-Universität Bochum 13

14 Research Group Acoustic Simulations and Measurement Prof. Dr.-Ing. Herbert Hudde Dipl.-Ing. Yvonne Curdes Dipl.-Ing. Henning Taschke Dipl.- Ing. Sebastian Schmidt

15 Acoustic Simulations and Measurement Goals: Investigation of the peripheral hearing organ and of hearing aids devices by measuring, modelling and simulations Topics: Simulation of the peripheral hearing organ Sound and Vibration Measurement Hearing aids Finite-Element Models of the head Institute of Communication Acoustics Ruhr-Universität Bochum 15

16 Finite-Element-Model of the Head Geometry Raw Data: CT-images (Head, Skull) anatomical slices (temporal bone) Image Processing: smoothing, edge emphasis contour extraction Reconstruction: areas manually created using CAD (detailed) FE-Model vibratory model modular layout includes complete peripheral hearing organ in a simple form Mechanical Parameters Raw data: CT-grey values density Measurements: of little bone specimen of dry skulls of the head in vivo Derived Quantities: Young s Modules from density Literature: Data of soft tissue Fundamental research, e.g. Mechanisms of bone-conduction Optimisation of hearing aids Optimisation of ear protection Conputation of HRTFs Institute of Communication Acoustics Ruhr-Universität Bochum 16

17 Research Group Analysis and Synthesis of Auditory Scenes Prof. em. Dr.-Ing. Dr. h.c. techn. Jens Blauert Dr. Pedro Novo Antonio Guzman, M.Sc. Dipl.-Ing. Wolfgang G. Hess Juha Merimaa, M.Sc. Dipl.-Ing. Ercan Altinsoy Dipl.-Ing. Andreas Silzle Institute of Communication Acoustics Ruhr-Universität Bochum 17

18 Analysis and Synthesis of Auditory Scenes Investigating the strategies of binaural hearing in humans. Developing powerful and robust signal processing algorithms. Utilizing these algorithms in technical applications. Institute of Communication Acoustics Ruhr-Universität Bochum 18

19 Analysis and Synthesis of Auditory Scenes Wolfgang G. Hess Juha Merimaa John Worley Quality assessment of rooms by means of binaural models. Harman/Becker Automotive Systems. Evaluating spaciousness and other psychoacoustical effects related to room acoustics. HOARSE (EU). Psychoacoustical investigations on the precedence effect. HOARSE (EU). Institute of Communication Acoustics Ruhr-Universität Bochum 19

20 Auditory Virtual Environments Aim: to dislocate the listener to a virtual environment, perceived as being natural or highly plausible Based on a binaural room simulation technology, which facilitates listening into spaces that only exist into the form of computer models Temporal, spectral and spatial characteristics of sounds have to be taken into account Institute of Communication Acoustics Ruhr-Universität Bochum 20

21 Virtual Acoustics Institute of Communication Acoustics Ruhr-Universität Bochum 21

22 Research Group Auditory Quality of Systems PD Dr. phil. Ute Jekosch Dr.-Ing. Sebastian Möller Dipl.-Ing. Jan Krebber Dipl.-Ing. Alexander Raake MA Stefan Schaden

23 Auditory Quality of Systems Objectives: Measurement procedures and design methodologies for quality assessment, evaluation and prediction Research topics: Speech communication quality Quality of the acoustics Quality of auditory displays Product-sound quality Institute of Communication Acoustics Ruhr-Universität Bochum 23

24 EU-Project INSPIRE INfotainment management with SPeech Interaction via REmote microphones and telephone interfaces Office scenario ISDN PSTN VoIP CAR appliance INSPIRE Dialogue system appliance appliance Home scenario Institute of Communication Acoustics Ruhr-Universität Bochum 24

25 Summary acoustic simulation &measurements quality of systems acoustics virtual acoustic environments robust speech reorgnition signal theory perception multimodal interfaces noise reduction & microphone arrays Institute of Communication Acoustics Ruhr-Universität Bochum 25