Audio
and
Music
Processing
Master in Sound and Music Computing
Department of Information and
Communication Technologies
Universitat Pompeu Fabra,
Barcelona
Instructor: Xavier
Serra
Web for the students: http://aulaglobal2012-2013.upf.edu/course/view.php?id=1453&username=guest
Course of the Master in Sound and Music Computing that
focuses on a number of signal processing methodologies and technologies
that are specific for audio and music applications. Special emphasis is
given to the use of spectral processing techniques for the description
and transformation of music signals.
The course is offered in 10 weeks, with 25 hours of
lectures and seminars. The evaluation of the students is
based on the weekly assignments (30%), final exam (60%), and student
participation in the seminars (10%).
Topics covered
- Introduction to audio signal processing for music
applications.
- The mathematics of the Discrite Fourier Transform:
Euler's identity; Sinusoids and Exponentials; Derivation of the DFT;
Fourier Theorems.
- Short-Time Fourier Transform: STFT equation; Analysis
window; DFT computation; Window hop-size; Inverse STFT; the
Phase-vocoder.
- Sinusoidal modeling: Sinusoidal Model; Peak
detection; Peak continuation; Sinusoidal synthesis; Harmonics versus
partials; Harmonic Model; Fundamental frequency detection.
- Sinusoidal plus residual modeling: Sinusoidal plus
Residual Model; Sinusoidal subtraction; Residual reconstruction;
Deterministic plus Stochastic Model; Deterministic analysis; Stochastic
approximation; Deterministic plus Stochastic synthesis; Applications;
Related research.
- Audio-based Sound and Music Description: Feature
analysis; Segmentation; Instrument models; Musical features; Content
description; Towards semantic description; Applications.
References
- Zölzer, Udo, ed. 2011. DAFX: Digital Audio Effects.
John Wiley & Sons. (second edition)
(matlab files in http://www.dafx.de/)
- Spectral
Modeling
Synthesis
Tools
page
- Smith, Julius O. Mathematics of the Discrete Fourier
Transform (DFT),
http://ccrma.stanford.edu/~jos/mdft/,
2003,
ISBN
0-9745607-0-7.
- Rocchesso, Davide. 2003. Introduction to Sound
Processing,
http://profs.sci.univr.it/~rocchess/SP/sp.pdf
- Oppenheim, A. V., and R. W. Schafer. 2010.
Discrete-time signal processing. Upper Saddle River: Pearson education.
Relevant Software