Integration of Audio Music and Computer – Audio Music Technology
CourseArticle
Jan 09, 2023
Overview
This course focuses on the emerging interdisciplinary field of music technology, music artificial intelligence, and computer audition/AI acoustics. The field is generally considered to have started with the establishment of the ISMIR (International Society of Music Information Retrieval Conference) in 2000. As a high-threshold interdisciplinary subject with significant academic and practical value, talent cultivation is both challenging and crucial for the development of the discipline.
Due to the long-standing separation of arts and sciences in China, there are very few interdisciplinary talents in this field domestically, while such talents are more common in developed countries due to their general education philosophy. In the entire industry chain of music technology, music AI, and computer audition/AI acoustics, developed countries occupy high-end positions, generating significant profits from China each year. In recent years, with the rise of interdisciplinary thinking and the popularity of AI technology, the demand for domestic talents in music technology and related fields has rapidly increased.
Previously, research and teaching in this field in China were scattered. Since the establishment of the National Conference on Sound and Music Technology (CSMT) in 2013, the field has gradually become more cohesive. The course leader has authored two major reviews (2017–2020) on music technology and computer audition, edited the Chinese academic monograph "Integration of Audio Music and Computer – Audio Music Technology (Vol. 1 & 2)", and defined key terms in Baidu Baike. These efforts laid the foundation for launching the first online course in this field in China.
The course is structured as a series of popular science reports, open to the public, providing a comprehensive overview of academic theories and industrial applications. Those interested in specific directions can collaborate with relevant mentors for deeper research. The faculty is distributed across comprehensive universities, technical universities, and music academies, making online courses an effective solution.
Due to the long-standing separation of arts and sciences in China, there are very few interdisciplinary talents in this field domestically, while such talents are more common in developed countries due to their general education philosophy. In the entire industry chain of music technology, music AI, and computer audition/AI acoustics, developed countries occupy high-end positions, generating significant profits from China each year. In recent years, with the rise of interdisciplinary thinking and the popularity of AI technology, the demand for domestic talents in music technology and related fields has rapidly increased.
Previously, research and teaching in this field in China were scattered. Since the establishment of the National Conference on Sound and Music Technology (CSMT) in 2013, the field has gradually become more cohesive. The course leader has authored two major reviews (2017–2020) on music technology and computer audition, edited the Chinese academic monograph "Integration of Audio Music and Computer – Audio Music Technology (Vol. 1 & 2)", and defined key terms in Baidu Baike. These efforts laid the foundation for launching the first online course in this field in China.
The course is structured as a series of popular science reports, open to the public, providing a comprehensive overview of academic theories and industrial applications. Those interested in specific directions can collaborate with relevant mentors for deeper research. The faculty is distributed across comprehensive universities, technical universities, and music academies, making online courses an effective solution.
Syllabus
1Chapter 1: Overview of Music Technology, Music AI, and Computer Audition
2Chapter 2: Fundamentals of Acoustics
3Chapter 3: Music Psychology
4Chapter 4: Audio Features and Signal Processing
5Chapter 5: Pitch Estimation, Melody Extraction, Automatic Music Transcription, Rhythm Analysis
6Chapter 6: Harmony Analysis, Singing Voice Processing
7Chapter 7: Music Search, Structure Analysis
8Chapter 8: Music Emotion Computing, Music Recommendation
9Chapter 9: Music Classification, Timbre Analysis, Copyright Protection
10Chapter 10: Automatic Composition, Singing Voice Synthesis
11Chapter 11: Performance Data & Modeling, AI-assisted Music Education, Quantitative Analysis of Performance
12Chapter 12: Intelligent Recording/Mixing, Soundscape & Sound Design, Computer Interaction & Sound Art
13Chapter 13: Digital Instrument Synthesis, New Instrument Design, Music Robots
14Chapter 14: Computer Audition for General Audio (I)
15Chapter 15: Computer Audition for General Audio (II)
16Chapter 16: Cochlear Implants, Artistic Voice Analysis, Music Therapy
Course Access
References
Antonio Camurri, Giovanni De Poli, and Davide Rocchesso, 'A Taxonomy for Sound and Music Computing', Computer Music Journal (CMJ), Vol. 19, No. 2, Summer 1995, pp. 4-5.
Shlomo Dubnov, 'Computer Audition: An introduction and research survey', ACM Multimedia International Conference (ACM MM), Tutorial, October 2006, USA.
Michael J. Bianco et al., 'Machine learning in acoustics: Theory and applications', JASA, Vol. 146, No. 5, Nov 2019, pp. 3590–3628.
'Integration of Audio Music and Computer – Audio Music Technology', Fudan University Press, 2019/2021.
'Understanding Digital Music – MIR Technology Review', CSMT 2017, Fudan Journal (Natural Science), 2018.
'Understanding Digital Sound – Computer Audition Review', CSMT 2018, Fudan Journal (Natural Science), 2019.
Baidu Baike entries: Music Technology, Music AI, MIR, Computer Audition, CSMT.