Deep Learning and Modeling: Taking the Best out of Both Worlds

Gitta Kutyniok
Technische Universität Berlin
Program in Applied and Computational Mathematics

Pure model-based approaches are today often insufficient for solving complex inverse problems in imaging. At the same time, we witness the tremendous success of data based methodologies, in particular, deep neural networks for such problems. However, at the same time, pure deep learning approaches often neglect known and valuable information from the modeling world.

In this talk, we will provide an introduction into this problem complex and then focus on the inverse problem of (limited-angle) computed tomography. We will develop a conceptual approach by combining the model-based method of sparse regularization by shearlets with the data-driven method of deep learning. Our solvers are guided by a microlocal analysis viewpoint to pay particular attention to the singularity structures of the data. Finally, we will show that our algorithm significantly outperforms previous methodologies, including methods entirely based on deep learning.

Presentation (PDF File)

Back to Deep Learning and Medical Applications