- Official code: ITA01
- Course period: Third quarter
- Course year: 1,2,
- Course type: Elective
- Credits: 2
- Coordinator: Julián Villegas
- Instructor: Julián Villegas and Michael Cohen.
The purpose of this course is to study the fundamentals of audio signal processing and its application to music.
Besides reviewing the underlying techniques, this course focuses in practical implementations of sound effects, so the course is intense in hands-on exercises, mainly based on Matlab, C/C++, and Pure-data.
Students who approve this course are expected to:
- Understand some basic techniques used in computer music, as well as the literature and terminology on this topic.
- Be able to decide which of the presented techniques is best for creating a desired sound effect in music.
- Be able to create their own (simple) sound effect chain.
- Introductions: Course overview, materials, examination, introduction to computer music technologies,
- FFT workshop: Spectrograms, long-term average spectrum, short-term average spectrum, etc.
- Consonance origin: Tonotopic theory, Roughness, Roughness models, musical sounds
- Consonance workshop Computing scales from spectra
- Shepard Tones: Pitch as a complex sensation, chroma, pitch-height, circularity
- Shepard Tone workshop: Create a parametric Shepard tone in Matlab
- PSOLA and DTW: Changing pitch and speed without artifacts
- PSOLA workshop: Time alignment of two audio signals
- Beat Detection: Onset detection functions, linear programming, signal transformations
- Beat Detection Workshop: Detecting the beat from different musical signals
- Intro to Pd audio objects: Pure-data introductions, Pure-data structures, C compilation
- Pd object workshop: Creating an audio processing object in Pd
- Intro to Faust: Functional languages, Faust syntax, libraries overview
- Faust Workshop: Creating an audio plugin in Faust
- Intro. to sound and micro-controllers: Micro-controller vs. Micro-processors, audio hardware architecture, Arduino, etc.
- Micro-controller: Workshop Creating a simple audio effect on a Arduino micro-controller.
- U. Zölzer, editor. DAFX – Digital Audio Effects. John Wiley & Sons, New York, NY, USA, 2nd edition, 2011.
- Various materials prepared by the instructors
This class does not have prerequisites, but it is recommended that students be familiarized with Pure-data programming paradigm, and general audio signal processing techniques. These are some classes that students are encouraged to take:
- ITC02 Introduction to Sound and Audio
- ITA07 Advanced Signal Processing
- ITA10 Spatial Hearing and Virtual 3D Sound
- Quizzes and homework: 50%
- Exercises (workshops): 50%
- This course website: http://onkyo.u-aizu.ac.jp/index.php/classes/music-tech/
- Theory and Techniques of Electronic Music (M. Puckette): http://msp.ucsd.edu/techniques.htm
- Julius Orion Smith III website: https://ccrma.stanford.edu/~jos/
- Matlab documentation: www.mathworks.com/help/matlab/