PCA Is Just Eigenvectors

DataMListic · Beginner ·📐 ML Fundamentals ·4w ago

Key Takeaways

Explains PCA as eigenvectors of the covariance matrix

Original Description

A cloud of 2-D points stretches along one diagonal far more than any other, and that direction of maximum spread is the first principal component. The surprise is where it comes from: it isn't found by guessing and checking — it's exactly the top eigenvector of the covariance matrix, the little matrix that records how your features vary together. Solve Σu = λu and the principal components just fall out, each paired with an eigenvalue that tells you how much variance lives along its direction. Rank them, keep the few with big eigenvalues, throw the rest away — which is why, in so many real datasets, most of your data really is useless. #shorts *Follow Me* ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ 🐦 X: @datamlistic https://x.com/datamlistic 📸 Instagram: @datamlistic https://www.instagram.com/datamlistic 📱 TikTok: @datamlistic https://www.tiktok.com/@datamlistic 👔 Linkedin: https://www.linkedin.com/company/datamlistic *Channel Support* ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ The best way to support the channel is to share the content. ;) If you'd like to also support the channel financially, donating the price of a coffee is always warmly welcomed! (completely optional and voluntary) ► Patreon: https://www.patreon.com/datamlistic ► Bitcoin (BTC): 3C6Pkzyb5CjAUYrJxmpCaaNPVRgRVxxyTq ► Ethereum (ETH): 0x9Ac4eB94386C3e02b96599C05B7a8C71773c9281 ► Cardano (ADA): addr1v95rfxlslfzkvd8sr3exkh7st4qmgj4ywf5zcaxgqgdyunsj5juw5 ► Tether (USDT): 0xeC261d9b2EE4B6997a6a424067af165BAA4afE1a #shorts #pca #machinelearning
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Related Reads

📰
I Taught an AI to Recognize the Shadows of Four-Dimensional Objects
Learn how a neural network was taught to recognize the shadows of four-dimensional objects, expanding our understanding of high-dimensional geometry
Medium · AI
📰
SVD y PCA: cómo el álgebra lineal comprime miles de dimensiones
Aprende a reducir dimensiones con SVD y PCA, técnicas de álgebra lineal que sostienen el machine learning moderno
Dev.to AI
📰
The Baseline I Actually Picked for My Kaggle Pokémon Agent, and Why
Learn how to approach building a Kaggle Pokémon agent by understanding the baseline model selection process and its importance in competitive machine learning challenges
Medium · Machine Learning
📰
From Data to Decisions: A Beginners Guide to Understanding Machine Learning
Learn the basics of machine learning to make informed decisions from data
Medium · Machine Learning
Up next
QR Decomposition is Just Gram-Schmidt with Receipts
DataMListic
Watch →