Normalizing Flows Explained | Flow Matching Part-1 | Generative AI

ExplainingAI · Beginner ·📄 Research Papers Explained ·8mo ago
In this tutorial video, we dive deep into Normalizing Flows - both explanation and implementation. We’ll begin with why normalizing flows are important when we already have VAEs and GANs in generative modeling. Once we have understood the motivation, we will get into what normalizing flows are, starting with the foundation behind flow-based models which is - Change of Variables Theorem for probability densities. As part of understanding change of variables theorem for multi dimensional cases, we’ll explore the role of the Jacobian in normalizing flows. At this point we would have the understanding that normalizing flows are just modelling single transformations and now from modelling a single function, we move to using normalizing flows to model compositions of invertible functions, enabling us to convert simple distributions to complex ones with decent success. As an example of a deep generative model using the normalizing flow technique, we will cover Real NVP paper but focusing mainly on affine coupling layers rather than entire paper. Finally, we’ll walk through a step-by-step PyTorch implementation of a RealNVP-like model on the MNIST dataset and look at the results we get. ⏱️ Timestamps 00:00 Introduction 00:25 Why Normalizing Flows 02:22 Change of Variables Theorem Explained 11:46 Role of Jacobian in Normalizing Flows 15:30 Composition of invertible functions 19:32 Design Constraints of a Normalizing Flows model 21:09 Real NVP and Affine Coupling Layers 29:18 PyTorch implementation of a Normalizing Flows model(RealNVP like) 39:58 Results 📖 Resources Github Implementation Link(to be uploaded soon) - https://github.com/explainingai-code/Normalizing-Flow 🔔 Subscribe: https://tinyurl.com/exai-channel-link Email - explainingai.official@gmail.com
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Related AI Lessons

The ABCs of reading medical research and review papers these days
Learn to critically evaluate medical research papers by accepting nothing at face value, believing no one blindly, and checking everything
Medium · LLM
#1 DevLog Meta-research: I Got Tired of Tab Chaos While Reading Research Papers.
Learn to manage research paper tabs efficiently and apply meta-research techniques to improve productivity
Dev.to AI
How to Set Up a Karpathy-Style Wiki for Your Research Field
Learn to set up a Karpathy-style wiki for your research field to organize and share knowledge effectively
Medium · AI
The Non-Optimality of Scientific Knowledge: Path Dependence, Lock-In, and The Local Minimum Trap
Scientific knowledge may be stuck in a local minimum, hindering optimal progress, and understanding this concept is crucial for advancing research
ArXiv cs.AI

Chapters (9)

Introduction
0:25 Why Normalizing Flows
2:22 Change of Variables Theorem Explained
11:46 Role of Jacobian in Normalizing Flows
15:30 Composition of invertible functions
19:32 Design Constraints of a Normalizing Flows model
21:09 Real NVP and Affine Coupling Layers
29:18 PyTorch implementation of a Normalizing Flows model(RealNVP like)
39:58 Results
Up next
Microsoft Research Forum | Season 2, Episode 4
Microsoft Research
Watch →