Gradient descent with momentum #gradientdescent #machinelearning #deeplearning #optimization #math

Neural Black Magic · Advanced ·🔢 Mathematical Foundations ·2y ago

About this lesson

In this video, we visualize and compare the performance of vanilla gradient descent and gradient descent with momentum on achieving a minimum on the contours of a pretty complicated function, the 2-dimensional "Ackley" function, which has lot's of local minimums.

Original Description

In this video, we visualize and compare the performance of vanilla gradient descent and gradient descent with momentum on achieving a minimum on the contours of a pretty complicated function, the 2-dimensional "Ackley" function, which has lot's of local minimums.

Watch on YouTube ↗ (saves to browser)

Sign in to unlock AI tutor explanation · ⚡30

Related Reads

SAT Conditional Probability Photo Solver

Learn to solve SAT conditional probability problems with a photo solver tool, improving your math skills for the SAT exam

Ten Metres That Should Mean Nothing

Discover how adding 10 meters to a rope around Earth only raises it by 1.59 meters, revealing insights into scale and reality

Why the 3×3 Magic Square Is Unique

Discover the uniqueness of the 3×3 magic square and its mathematical significance

Medium · Programming

Chess Mathematics

Explore how chess can enhance mathematics education with real-world applications

Solve Any Math Problem Step by Step — Free (Type or Snap a Photo)