Skills › Mathematical Foundations

Optimisation

Understand gradient descent, convex optimisation, and loss landscapes.

0%
Confidence · no data yet
Sign in to track

After this skill you can…

  • Implement gradient descent from scratch
  • Explain SGD, Adam, and RMSProp
  • Identify local vs global minima in loss surfaces

Prerequisites

Watch (10 videos)

Advanced Modeling for Discrete Optimization
Coursera · advanced hands-on
→ Apply discrete optimization to real-world problems→ Model complex systems for decision making→ Analyze optimization results for resource allocation
Stanford AA222 I Engineering Design Optimization | Spring 2025 | Disciplined Convex Programming
Stanford Online · advanced hands-on
→ Solve optimization problems using convex programming→ Apply disciplined convex programming to engineering design
Solving Optimization Problems with Python Linear Programming
Nicholas Renotte · beginner hands-on
→ Learn optimization techniques→ Apply mathematical optimization to ML problems
Stanford EE364A Convex Optimization I Stephen Boyd I 2023 I Lecture 10
Stanford Online · beginner hands-on
→ Apply convex optimization techniques→ Solve optimization problems
Stanford EE364A Convex Optimization I Stephen Boyd I 2023 I Lecture 5
Stanford Online · beginner hands-on
→ Solve linear programs with MATLAB→ Model quadratic programs with CVX
Stanford AA222 I Engineering Design Optimization | Spring 2025 | Multiobjective Optimization
Stanford Online · advanced hands-on
→ Apply multiobjective optimization techniques to engineering design problems→ Solve optimization problems using Stanford's AA222 course materials
Optimization School with Dr. Mike - #545
The TWIML AI Podcast with Sam Charrington · advanced hands-on
→ Apply optimization techniques→ Solve complex optimization problems→ Improve model performance
Improving the Security of United States Elections with Robust Optimization
Microsoft Research · intermediate hands-on
→ Solve optimization problems using robust methods
What is the ADAM Optimizer❓- Deep Learning Beginner 👶 - Topic 106 #ai #ml
deeplizard · beginner hands-on
→ Optimize loss functions→ Use momentum terms→ Avoid local minimums
Stanford EE364A Convex Optimization I Stephen Boyd I 2023 I Lecture 2
Stanford Online · beginner
→ Model and solve optimization problems→ Analyze and optimize machine learning algorithms

Read (2 articles)

📄
Optimization Theory and Applications
Medium · Machine Learning · 2026-04-22
📄
Lagrange Multipliers
Dev.to · Sajjad Rahman · 2026-04-20