Deep Learning (DL)5 ECTS
(englische Bezeichnung: Deep Learning)
(Prüfungsordnungsmodul: Deep Learning)

Lehrveranstaltungen:

• • Deep Learning
    (Vorlesung, 2 SWS, Andreas Maier et al., Mo, 14:15 - 15:45, H4)
  • Deep Learning Exercises
    (Übung, 2 SWS, Katharina Breininger et al.)

Empfohlene Voraussetzungen:

Es wird empfohlen, folgende Module zu absolvieren, bevor dieses Modul belegt wird:

Introduction to Pattern Recognition (WS 2019/2020)

Inhalt:

Deep Learning (DL) has attracted much interest in a wide range of applications such as image recognition, speech recognition and artificial intelligence, both from academia and industry. This lecture introduces the core elements of neural networks and deep learning, it comprises:

• (multilayer) perceptron, backpropagation, fully connected neural networks

• loss functions and optimization strategies

• convolutional neural networks (CNNs)

• activation functions

• regularization strategies

• common practices for training and evaluating neural networks

• visualization of networks and results

• common architectures, such as LeNet, Alexnet, VGG, GoogleNet

• recurrent neural networks (RNN, TBPTT, LSTM, GRU)

• deep reinforcement learning

• unsupervised learning (autoencoder, RBM, DBM, VAE)

• generative adversarial networks (GANs)

• weakly supervised learning

• applications of deep learning (segmentation, object detection, speech recognition, ...)
  

The accompanying exercises will provide a deeper understanding of the workings and architecture of neural networks.

Lernziele und Kompetenzen:

The students

• explain the different neural network components,

• compare and analyze methods for optimization and regularization of neural networks,

• compare and analyze different CNN architectures,

• explain deep learning techniques for unsupervised / semi-supervised and weakly supervised learning,

• explain deep reinforcement learning,

• explain different deep learning applications,

• implement the presented methods in Python,

• autonomously design deep learning techniques and prototypically implement them,

• effectively investigate raw data, intermediate results and results of Deep Learning techniques on a computer,

• autonomously supplement the mathematical foundations of the presented methods by self-guided study of the literature,

• discuss the social impact of applications of deep learning applications.
  

Literatur:

• Ian Goodfellow, Yoshua Bengio, Aaron Courville: Deep Learning. MIT Press, 2016.

• Christopher Bishop: Pattern Recognition and Machine Learning, Springer Verlag, Heidelberg, 2006

• Yann LeCun, Yoshua Bengio, Geoffrey Hinton: Deep learning. Nature 521, 436–444 (28 May 2015)

Weitere Informationen:

Verwendbarkeit des Moduls / Einpassung in den Musterstudienplan:

1. Communications and Multimedia Engineering (Master of Science)
   (Po-Vers. 2011 | TechFak | Communications and Multimedia Engineering (Master of Science) | Gesamtkonto | Wahlmodule | Technische Wahlmodule | Deep Learning)

Studien-/Prüfungsleistungen:

Deep Learning (Prüfungsnummer: 901895)

(englischer Titel: Deep Learning)

Prüfungsleistung, mündliche Prüfung, Dauer (in Minuten): 30, benotet

Anteil an der Berechnung der Modulnote: 100.0 %

weitere Erläuterungen:
30-minütige mündliche Prüfung über den Stoff der Vorlesung und der Übungen. Voraussetzung ist die erfolgreiche Bearbeitung der Übungsaufgaben. Die Übung besteht aus fünf Übungsblättern, welche innerhalb von je zwei bis drei Wochen bearbeitet werden müssen. 30 minute oral exam about the lecture and the exercises. It is required to successfully complete the exercises. The exercises consist of five exercise sheets that have to be completed within two to three weeks each.

Prüfungssprache: Deutsch und Englisch

Erstablegung: SS 2020, 1. Wdh.: WS 2020/2021

1. Prüfer:

Andreas Maier

Termin: 24.03.2021, 11:00 Uhr, Ort: BASPH
Termin: 26.07.2021, 17:00 Uhr, Ort: BASPH
Termin: 06.04.2022, 15:15 Uhr, Ort: s. Aushang