ホーム » 講義 » (English) Spatial Hearing and Virtual 3D Sound

(English) Spatial Hearing and Virtual 3D Sound

申し訳ありません、このコンテンツはただ今 アメリカ英語 のみです。 For the sake of viewer convenience, the content is shown below in the alternative language. You may click the link to switch the active language.

  • Official code: ITA10

    • Course period: second quarter
    • Course year: 1,2
    • Course type: elective
    • Credits: 2
    • Coordinator: Julián Villegas
    • Instructor(s): Julián Villegas and Michael Cohen.

    Description

    The purpose of this course is to study the fundamentals of spatial hearing and its application to virtual environments. By using two ears, human among other species, are able to accurately determine the direction from where a sound is being emitted in a real environment. For virtual environments (e.g., movies, games, recorded or live concerts) is desirable to provide the spatial cues found in nature to increase the realism of the scene. Besides reviewing the underlying theories of spatial hearing, this course focuses in practical implementations of binaural hearing techniques, so the course is intense in hands-on exercises, assignments, and projects mainly based on Pure-data programming language (http://puredata.info).

    Objectives

    • Students who approve this course are expected to understand the basic underlying mechanisms of spatial hearing, as well as the literature and terminology on this topic.
    • Given some application constraints (real-time, computing power, etc.) students at the end of the term should be able to decide which of the presented techniques is best for creating the 3D aural illusion.
    • Upon completion of this course, students should be able to successfully implement virtual 3D sound environments based on head-related transfer functions (HRTF) and multi-speaker systems.

    Schedule/themes

    Introduction to ITA10
    Spatial hearing and psychoacoustics
    Binaural difference cues
    (continuation)
    Elevation cues
    Distance cues
    Head-related impulse response and transfer function
    (continuation)
    Motion cues
    Room cues
    Loudspeaker techniques
    (continuation)
    Applications
    Presentation of final projects

    Texts

    Related courses which include important concepts relevant to the course

    This class does not have prerequisites, but it is recommended that students be familiarized with Pure-data programming paradigm, and general audio signal processing techniques. These are some classes that students are encouraged to take, i.e.:

    • ITC02 Introduction to Sound and Audio
    • ITA01 Music Technology
    • ITA07 Advanced Signal Processing

    Evaluation method

    Quizzes 30%
    Assignments 15%
    Mid-term project 25%
    Final project 30%

    Referential sources

    • Course website: http://onkyo.u-aizu.ac.jp/index.php/3d-sound/
    • J. Blauert, Spatial Hearing: The Psychophysics of Human Sound Localization. MIT Press, 1997.
    • Bregman, Albert S., Auditory Scene Analysis: The Perceptual Organization of sound. Cambridge, Massachusetts: The MIT Press, 1990 (hardcover)/1994 (paperback).