📰 Lilian Weng's Blog

[Updated on 2020-02-03: mentioning PCG in the &ldquo;Task-Specific Curriculum&rdquo; section. <spa

[Updated on 2020-01-09: add a new section on Contrastive Predictive Coding ]. [Updated on 2020-04-13: add a &ldquo;Momentum Contra

Stochastic gradient descent is a universal choice for optimizing deep learning models. However, it is not the only option. With bl

In my earlier post on meta-learning , the problem is mainly defined in the context of few-shot classificati

In Robotics, one of the hardest problems is how to make your model transfer to the real world. Due to the sample inefficiency of deep RL algorithms and the cost

[Updated on 2019-05-27: add the section on Lottery Ticket Hypothesis.] If you are like me, entering into the field of deep learning with experience in tradition

[Updated on 2019-02-14: add ULMFiT and GPT-2 .] [Updated on 2020-02-29: add ALBERT .] <span class="updat

In Part 3 , we have reviewed models in the R-CNN family. All of them are region-based object detection algorithms. They can achieve hig

[Updated on 2019-10-01: thanks to Tianhao, we have

So far, I&rsquo;ve written about two types of generative models, GAN and VAE . Neither of them explicitly learns the probability density function of real da

[Updated on 2019-07-18: add a section on VQ-VAE & VQ-VAE-2 .] [Updat

[Updated on 2018-10-28: Add Pointer Network and the link to my implementation of Transformer.] <span class

The full implementation is available in lilianweng/deep-reinforcement-learning-gym In the previous two posts, I have introduced the algorithms of many deep rein

[Updated on 2018-06-30: add two new policy gradient methods, SAC and D4PG .] [Updated on 2018-09-30: ad

[Updated on 2020-09-03: Updated the algorithm of SARSA and Q-learning so that the diffe

The algorithms are implemented for Bernoulli bandit in lilianweng/multi-armed-bandit . Exploitation vs Exploration The exploration vs exploitation dilemma exist

[Updated on 2018-12-20: Remove YOLO here. Part 4 will cover multiple fast object detection algorithms, including YOLO.] [Updated on 2018-12-27: Add bbox regress

Part 1 of the &ldquo;Object Detection for Dummies&rdquo; series introduced: (1) the concept of image gradient vector and how HOG algorithm summarizes the inform

I&rsquo;ve never worked in the field of

Human vocabulary comes in free text. In ord

Professor Naftali Tishby passed away in 2021. Hope the post can introduce his cool idea of information bottleneck to more people. Recently I watched the talk &l

[Updated on 2018-09-30: thanks to Yoonju, we have this post translated in Korean !] [

The machine learning models have started penetrating into critical areas like health care, justice systems, and financial industry. Thus to figure out how the m

In the Part 2 tutorial, I would like to continue the topic on stock price prediction and to endow the recurrent neural network that I have built in <a href="htt