Audio Processing for the Internet of Things (AIoT)2.5 ECTS
(englische Bezeichnung: Audio Processing for the Internet of Things)

Lehrveranstaltungen:

• • Audio Processing for the Internet of Things
    (Vorlesung, 2 SWS, Nils Peters, Di, 14:15 - 15:45, Zoom-Meeting; bis zum 19.7.2022)

Empfohlene Voraussetzungen:

Es wird empfohlen, folgende Module zu absolvieren, bevor dieses Modul belegt wird:

Signale und Systeme I (WS 2021/2022)
Digitale Signalverarbeitung (WS 2021/2022)
Machine Learning in Signal Processing (WS 2021/2022)
Signale und Systeme II (SS 2021)

Inhalt:

The course focuses on audio and speech processing algorithms within the context of the Internet of Things (IoT).

• Foundation (history, components, current challenges)

• Overview of relevant wireless protocols (bandwidth, range, latency, spectrum)

• Audio device synchronization (NTP, PTP, device orchestration, acoustic wireless sensor networks, asynchronous and event-driven audio sampling)

• Acoustic Sensing for Voice User Interfaces (keyword spotting, speech recognition, speaker verification, anti-spoofing)

• Acoustic Scene Detection (event detection, scene classification, anomaly detection, sound tagging, blind reverb estimation)

• Sound Creation (text-to-speech, sound generative networks)

• Data-over-sound (sound-beacon, watermarking, acoustic fingerprint)

• Privacy in IoT (edge vs. cloud processing, secure signal processing, federated learning, differential privacy, audio encryption)
  

Lernziele und Kompetenzen:

The students will be able to

• understand the principles, key components, and current in IoT

• know the differences between various wireless transmission protocols and can give recommendations based on the IoT use case

• understand the differences of edge- and cloud-based audio signal processing

• understand algorithmic strategies to enhance privacy in IoT use cases

• understand the algorithmic components in a voice user interface

• understand state-of-the art methods for detection and classification of acoustic scenes and events

• learn and apply algorithms to transmit data via acoustic signals

• quantify the impact of latency in audio networks and apply strategies for acoustic device synchronization
  

Literatur:

Recommendations for each topic are given during the lectures

Organisatorisches:

In this course, we require a good knowledge of deep learning techniques, machine learning, and pattern recognition as well as a strong mathematical background. Furthermore, we require a solid background in general digital signal processing and some experience with audio, image, or video processing.

It is recommended to finish the following modules (or having equivalent knowledge) before starting this module:

• Lecture Deep Learning

• Digitale Signalverarbeitung

• Statistische Signalverarbeitung

• Sprach- und Audiosignalverarbeitung
  

Weitere Informationen:

Verwendbarkeit des Moduls / Einpassung in den Musterstudienplan:
Das Modul ist im Kontext der folgenden Studienfächer/Vertiefungsrichtungen verwendbar:

1. Advanced Signal Processing & Communications Engineering (Master of Science)
   (Po-Vers. 2016w | TechFak | Communications Engineering (Master of Science) | Gesamtkonto | Wahlmodule | Technical Electives | Audio Processing for the Internet of Things)
2. Advanced Signal Processing & Communications Engineering (Master of Science)
   (Po-Vers. 2020w | TechFak | Communications Engineering (Master of Science) | Gesamtkonto | Technical Electives | Audio Processing for the Internet of Things)
3. Advanced Signal Processing & Communications Engineering (Master of Science)
   (Po-Vers. 2021w | TechFak | Communications Engineering (Master of Science) | Gesamtkonto | Technical Electives | Audio Processing for the Internet of Things)
4. Communications and Multimedia Engineering (Master of Science)
   (Po-Vers. 2011 | TechFak | Communications and Multimedia Engineering (Master of Science) | Gesamtkonto | Wahlmodule | Technische Wahlmodule | Audio Processing for the Internet of Things)
5. Information and Communication Technology (Master of Science)
   (Po-Vers. 2019s | TechFak | Information and Communication Technology (Master of Science) | Gesamtkonto | Wahlmodule | Wahlmodule aus dem Angebot von EEI und Informatik | Audio Processing for the Internet of Things)
6. Information and Communication Technology (Master of Science)
   (Po-Vers. 2019s | TechFak | Information and Communication Technology (Master of Science) | Gesamtkonto | Wahlmodule | Wahlmodule aus dem Angebot der Technischen Fakultät oder der Naturwissenschaftlichen Fakultät | Audio Processing for the Internet of Things)

Studien-/Prüfungsleistungen:

Audio Processing for the Internet of Things (Prüfungsnummer: 45221)

Prüfungsleistung, mündliche Prüfung, Dauer (in Minuten): 30, benotet, 2.5 ECTS

Anteil an der Berechnung der Modulnote: 100.0 %

Prüfungssprache: Englisch

Erstablegung: SS 2022, 1. Wdh.: WS 2022/2023

1. Prüfer:

Nils Peters