AI-assisted audio analysis of music and soundscapes

In the computer-aided analysis of music recordings and environmental sounds, algorithms of the so-called Artificial Intelligence (AI) are used today, which are specifically trained for certain tasks and fields of application with approaches of the so-called Machine Learning or Deep Learning and special audio data sets. The goal of the seminar at the HfM Weimar (WS 2022/23) was the practical introduction to approaches of audio signal processing as well as these AI-based methods; the basis for this is the programming language Python, whose basic knowledge is also taught. In the second half of the seminar, these approaches and methods were applied to concrete examples. The focus is on the recognition and classification of auditory events and textures in the context of issues in music analysis and soundscape research.

On this website, Jakob Abeßer's teaching materials are made available and student project reports (in German) are presented. Updated versions of the teaching materials, as well as other materials, are available on the Machine Listening Lectures website.

Folien:
AIAA 0 Introduction
AIAA 1 Installation Python
AIAA 2 Audio Processing
AIAA 3 Research Projects
AIAA 4 Machine Learing
AIAA 5 Deep Learning

… and the corresponding Jupyter Notebooks:
AIAA_2_Audio_Processing
AIAA_4_Machine_Learning
AIAA_5_Deep_Learning
For installation of the Jupyter Notebooks please compare the instructions here.
Please, use the follownig yml-file as project-specific Python environment: aiaa.yml.

More helpful materials:
Python - Einführung
AIAA_1_Python
AIAA_6_Research_Project_Useful_Hints, html-Ansicht

Automatische Erkennung von Vogelgesang von Sophie Krüger.
Automatische Erkennung von Musikinstrumenten von Ronja Hoffmann.