Optimisation

After this skill you can…

• Implement gradient descent from scratch
• Explain SGD, Adam, and RMSProp
• Identify local vs global minima in loss surfaces

Prerequisites

Learn this skill (10 videos)

Avoiding Local Minima Traps ⚠️ - Deep Learning Beginner 👶 - Topic 101 #ai #ml

deeplizard · beginner

Loss Landscape in Neural Networks 🏞️ - Deep Learning Beginner 👶 - Topic 100 #ai

deeplizard · beginner

Stanford CS231N | Spring 2025 | Lecture 3: Regularization and Optimization

Stanford Online · beginner

Lagrange Multipliers : Data Science Basics

ritvikmath · beginner

Saving cost on your machine learning training and inference on AWS

AWS Developers · intermediate

Optimizing Neural Network Structures with Keras-Tuner

sentdex · beginner

TensorFlow Developer Professional Certificate

DeepLearningAI · intermediate

Neural Networks from Scratch - P.7 Calculating Loss with Categorical Cross-Entropy

sentdex · advanced

Pytorch Quick Tip: Using a Learning Rate Scheduler

Aladdin Persson · beginner

Linear Regression Gradient Descent From Scratch in Python

Aladdin Persson · beginner