5th HLF – Lecture: Alexei Efros
Alexei Efros: “Self-Supervised Visual Learning and Synthesis” Computer vision has made impressive gains through the use of deep learning models, trained with large-scale labeled data. However, labels require expertise and curation and are expensive to collect. Can one discover useful visual representations without the use of explicitly curated labels? In this talk, I will present several case studies exploring the paradigm of self-supervised learning – using raw data as its own supervision. Several ways of defining objective functions in high-dimensional spaces will be discussed, including the use of General Adversarial Networks (GANs) to learn the objective function directly from the data. Applications in image synthesis will be shown, including automatic colorization, paired and unpaired image-to-image translation (aka pix2pix and cycleGAN), and, terrifyingly, #edges2cats. This video is also available on another stream: http://hitsmediaweb.h-its.org/Mediasite/Play/0cc2dfeff52741b39f7a29c8d2058cb81d?autoStart=false&popout=true The opinions expressed in this video do not necessarily reflect the views of the Heidelberg Laureate Forum Foundation or any other person or associated institution involved in the making and distribution of the video. More information to the Heidelberg Laureate Forum: Website: http://www.heidelberg-laureate-forum.org/ Facebook: https://www.facebook.com/HeidelbergLaureateForum Twitter: https://twitter.com/hlforum Flickr: https://www.flickr.com/hlforum More videos from the HLF: https://www.youtube.com/user/LaureateForum Blog: https://scilogs.spektrum.de/hlf/
Alexei Efros: “Self-Supervised Visual Learning and Synthesis” Computer vision has made impressive gains through the use of deep learning models, trained with large-scale labeled data. However, labels require expertise and curation and are expensive to collect. Can one discover useful visual representations without the use of explicitly curated labels? In this talk, I will present several case studies exploring the paradigm of self-supervised learning – using raw data as its own supervision. Several ways of defining objective functions in high-dimensional spaces will be discussed, including the use of General Adversarial Networks (GANs) to learn the objective function directly from the data. Applications in image synthesis will be shown, including automatic colorization, paired and unpaired image-to-image translation (aka pix2pix and cycleGAN), and, terrifyingly, #edges2cats. This video is also available on another stream: http://hitsmediaweb.h-its.org/Mediasite/Play/0cc2dfeff52741b39f7a29c8d2058cb81d?autoStart=false&popout=true The opinions expressed in this video do not necessarily reflect the views of the Heidelberg Laureate Forum Foundation or any other person or associated institution involved in the making and distribution of the video. More information to the Heidelberg Laureate Forum: Website: http://www.heidelberg-laureate-forum.org/ Facebook: https://www.facebook.com/HeidelbergLaureateForum Twitter: https://twitter.com/hlforum Flickr: https://www.flickr.com/hlforum More videos from the HLF: https://www.youtube.com/user/LaureateForum Blog: https://scilogs.spektrum.de/hlf/