Foundations

ML Fundamentals

Neural networks, backpropagation, gradient descent — the maths behind AI

12,007
lessons
Skills in this topic
View full skill map →
ML Maths Basics
beginner
Manipulate vectors and matrices
Supervised Learning
beginner
Train decision trees, random forests, and neural nets
Unsupervised Learning
intermediate
Apply k-means and DBSCAN clustering
ML Pipelines
intermediate
Engineer features and handle missing data

Showing 1,234 reads from curated sources

Optimization in Machine Learning — How Models Learn Parameters and What Actually Improves Training
Dev.to · shangkyu shin 📐 ML Fundamentals ⚡ AI Lesson 1mo ago
Optimization in Machine Learning — How Models Learn Parameters and What Actually Improves Training
Learn how optimization in machine learning works, from parameter learning and loss minimization to...
Optimization vs Regularization — The Real Reason Your Model Overfits (and How to Fix It)
Dev.to · shangkyu shin 📐 ML Fundamentals ⚡ AI Lesson 1mo ago
Optimization vs Regularization — The Real Reason Your Model Overfits (and How to Fix It)
Most deep learning problems are not architecture problems. They are training...
Logistic Regression on MNIST (0 vs 1) in PHP: A Simple Example
Dev.to · Samuel Akopyan 📐 ML Fundamentals ⚡ AI Lesson 1mo ago
Logistic Regression on MNIST (0 vs 1) in PHP: A Simple Example
Want to get a real feel for machine learning in practice? Here’s a simple but powerful exercise:...
Theoretical Foundations of Deep Learning (Why Neural Networks Actually Work)
Dev.to · shangkyu shin 📐 ML Fundamentals ⚡ AI Lesson 1mo ago
Theoretical Foundations of Deep Learning (Why Neural Networks Actually Work)
Deep learning and neural networks work because of entropy, KL divergence, probability distributions,...
Fundamentals of Neural Networks: How Simple Math Scales into Modern AI
Dev.to · shangkyu shin 📐 ML Fundamentals ⚡ AI Lesson 1mo ago
Fundamentals of Neural Networks: How Simple Math Scales into Modern AI
Neural networks power modern AI—from image recognition to large language models. This guide breaks...
Linear Models in Machine Learning: Why They Still Matter (Regression, Classification, Logistic Regression)
Dev.to · shangkyu shin 📐 ML Fundamentals ⚡ AI Lesson 1mo ago
Linear Models in Machine Learning: Why They Still Matter (Regression, Classification, Logistic Regression)
Linear models in machine learning are the foundation of regression, classification, and logistic...
Model Complexity and Generalization: How to Actually Fix Overfitting
Dev.to · shangkyu shin 📐 ML Fundamentals ⚡ AI Lesson 1mo ago
Model Complexity and Generalization: How to Actually Fix Overfitting
If you've ever trained a model that looked perfect during training but failed in production, you've...
Machine Learning Tasks and Evaluation: How to Choose the Right Metrics and Avoid Common Pitfalls
Dev.to · shangkyu shin 📐 ML Fundamentals ⚡ AI Lesson 1mo ago
Machine Learning Tasks and Evaluation: How to Choose the Right Metrics and Avoid Common Pitfalls
Understand how different machine learning tasks require different evaluation strategies. Learn how to...
What Machine Learning Really Means: From Rules to Data-Driven Systems
Dev.to · shangkyu shin 📐 ML Fundamentals ⚡ AI Lesson 1mo ago
What Machine Learning Really Means: From Rules to Data-Driven Systems
Machine learning is the foundation of modern AI systems. Learn how models improve from data, optimize...
Why are efficient algorithms the true energy of the future?
Dev.to · ROBERTO ALEMAN 📐 ML Fundamentals ⚡ AI Lesson 1mo ago
Why are efficient algorithms the true energy of the future?
In the age of modern computing, we have fallen into a dangerous trap of abundance. Hardware power has...
Integrating Model Context Protocol (MCP) into Nautilus
Dev.to · chunxiaoxx 📐 ML Fundamentals ⚡ AI Lesson 1mo ago
Integrating Model Context Protocol (MCP) into Nautilus
The Future of MCP on Nautilus The Model Context Protocol (MCP) is rapidly becoming the...
Traditional Machine Learning in Practice: Learning Paradigms, Algorithm Families, and Evaluation Perspectives
Dev.to · shangkyu shin 📐 ML Fundamentals ⚡ AI Lesson 1mo ago
Traditional Machine Learning in Practice: Learning Paradigms, Algorithm Families, and Evaluation Perspectives
Traditional machine learning is more than just algorithms. This guide explains how learning...
I built a free LeetCode visualizer. Here's what I learned making 207 problems animate line by line.
Dev.to · Rajan shukla 📐 ML Fundamentals ⚡ AI Lesson 1mo ago
I built a free LeetCode visualizer. Here's what I learned making 207 problems animate line by line.
I spent months grinding LeetCode. I could read solutions. I could even explain them out loud. But the...
Tavsiye Iste Uygulamaları - Detaylı Teknik Analiz Rehberi 2026
Dev.to · FORUM WEB 📐 ML Fundamentals ⚡ AI Lesson 1mo ago
Tavsiye Iste Uygulamaları - Detaylı Teknik Analiz Rehberi 2026
Tavsiye İste Uygulamaları: Tarihçe ve Gelişim Tavsiye iste uygulamaları, kullanıcıların ihtiyaç ve...
Your Pipeline Is 28.6h Behind: Catching Machine Learning Sentiment Leads with Pulsebit
Dev.to · Pulsebit News Sentiment API 📐 ML Fundamentals ⚡ AI Lesson 1mo ago
Your Pipeline Is 28.6h Behind: Catching Machine Learning Sentiment Leads with Pulsebit
Your pipeline has just missed a crucial 24h momentum spike of -0.175 in the sentiment around machine...
Improving Variational Auto-Encoders using Householder Flow
Dev.to · Paperium 📐 ML Fundamentals ⚡ AI Lesson 1mo ago
Improving Variational Auto-Encoders using Householder Flow
Neural Network Learning Systems and Deep Learning: From Perceptrons to Representation Learning
Dev.to · shangkyu shin 📐 ML Fundamentals ⚡ AI Lesson 1mo ago
Neural Network Learning Systems and Deep Learning: From Perceptrons to Representation Learning
Deep learning did not appear out of nowhere. It grew from a simple question: can a machine learn...
Dev.to AI 📐 ML Fundamentals ⚡ AI Lesson 1mo ago
Weights & Biases — Deep Dive
Daily deep dive into Weights & Biases — covering W&B, ML experiment tracking, Model registry, Prompts, Weave. Latest News & Announcements CoreWeave
Dev.to AI 📐 ML Fundamentals ⚡ AI Lesson 1mo ago
8 Things to Check Before You Hire MERN Stack Developers
Projects get over-budgeted, late and code that requires rewriting in a year is developed with a portfolio examination and a bid evaluation. The data that in fac
Dev.to AI 📐 ML Fundamentals ⚡ AI Lesson 1mo ago
Word Embeddings — Deep Dive + Problem: Information Gain
A daily deep dive into ml topics, coding problems, and platform features from PixelBank . Topic Deep Dive: Word Embeddings From the NLP Fundamentals chapter Int
AWS Machine Learning 📐 ML Fundamentals ⚡ AI Lesson 1mo ago
Reinforcement fine-tuning on Amazon Bedrock: Best practices
In this post, we explore where RFT is most effective, using the GSM8K mathematical reasoning dataset as a concrete example. We then walk through best practices
5 Useful Python Scripts to Automate Boring Excel Tasks
KDnuggets 📐 ML Fundamentals ⚡ AI Lesson 1mo ago
5 Useful Python Scripts to Automate Boring Excel Tasks
Merging spreadsheets, cleaning exports, and splitting reports are necessary-but-boring tasks. These Python scripts handle the repetitive parts so you can focus
Building ML in the Dark: A Survival Guide for the Solo Practitioner
Towards AI 📐 ML Fundamentals ⚡ AI Lesson 1mo ago
Building ML in the Dark: A Survival Guide for the Solo Practitioner
Author(s): Yuval Mehta Originally published on Towards AI. Photo by Boitumelo on Unsplash No GPU cluster. No data team. No ML platform. Here’s what actually shi
ArXiv cs.AI 📐 ML Fundamentals 📄 Paper ⚡ AI Lesson 1mo ago
EAGLE: Edge-Aware Graph Learning for Proactive Delivery Delay Prediction in Smart Logistics Networks
arXiv:2604.05254v1 Announce Type: new Abstract: Modern logistics networks generate rich operational data streams at every warehouse node and transportation lane
ArXiv cs.AI 📐 ML Fundamentals 📄 Paper ⚡ AI Lesson 1mo ago
TFRBench: A Reasoning Benchmark for Evaluating Forecasting Systems
arXiv:2604.05364v1 Announce Type: new Abstract: We introduce TFRBench, the first benchmark designed to evaluate the reasoning capabilities of forecasting system
ArXiv cs.AI 📐 ML Fundamentals 📄 Paper ⚡ AI Lesson 1mo ago
Prune-Quantize-Distill: An Ordered Pipeline for Efficient Neural Network Compression
arXiv:2604.04988v1 Announce Type: cross Abstract: Modern deployment often requires trading accuracy for efficiency under tight CPU and memory constraints, yet c
ArXiv cs.AI 📐 ML Fundamentals 📄 Paper ⚡ AI Lesson 1mo ago
PRIME: Prototype-Driven Multimodal Pretraining for Cancer Prognosis with Missing Modalities
arXiv:2604.04999v1 Announce Type: cross Abstract: Multimodal self-supervised pretraining offers a promising route to cancer prognosis by integrating histopathol
ArXiv cs.AI 📐 ML Fundamentals 📄 Paper ⚡ AI Lesson 1mo ago
Learning Stable Predictors from Weak Supervision under Distribution Shift
arXiv:2604.05002v1 Announce Type: cross Abstract: Learning from weak or proxy supervision is common when ground-truth labels are unavailable, yet robustness und
ArXiv cs.AI 📐 ML Fundamentals 📄 Paper ⚡ AI Lesson 1mo ago
YMIR: A new Benchmark Dataset and Model for Arabic Yemeni Music Genre Classification Using Convolutional Neural Networks
arXiv:2604.05011v1 Announce Type: cross Abstract: Automatic music genre classification is a major task in music information retrieval; however, most current ben
ArXiv cs.AI 📐 ML Fundamentals 📄 Paper ⚡ AI Lesson 1mo ago
PCA-Driven Adaptive Sensor Triage for Edge AI Inference
arXiv:2604.05045v1 Announce Type: cross Abstract: Multi-channel sensor networks in industrial IoT often exceed available bandwidth. We propose PCA-Triage, a str
ArXiv cs.AI 📐 ML Fundamentals 📄 Paper ⚡ AI Lesson 1mo ago
Dynamic Linear Coregionalization for Realistic Synthetic Multivariate Time Series
arXiv:2604.05064v1 Announce Type: cross Abstract: Synthetic data is essential for training foundation models for time series (FMTS), but most generators assume
ArXiv cs.AI 📐 ML Fundamentals 📄 Paper ⚡ AI Lesson 1mo ago
CRAB: Codebook Rebalancing for Bias Mitigation in Generative Recommendation
arXiv:2604.05113v1 Announce Type: cross Abstract: Generative recommendation (GeneRec) has introduced a new paradigm that represents items as discrete semantic t
ArXiv cs.AI 📐 ML Fundamentals 📄 Paper ⚡ AI Lesson 1mo ago
What Makes a Good Response? An Empirical Analysis of Quality in Qualitative Interviews
arXiv:2604.05163v1 Announce Type: cross Abstract: Qualitative interviews provide essential insights into human experiences when they elicit high-quality respons
ArXiv cs.AI 📐 ML Fundamentals 📄 Paper ⚡ AI Lesson 1mo ago
Modality-Aware and Anatomical Vector-Quantized Autoencoding for Multimodal Brain MRI
arXiv:2604.05171v1 Announce Type: cross Abstract: Learning a robust Variational Autoencoder (VAE) is a fundamental step for many deep learning applications in m
ArXiv cs.AI 📐 ML Fundamentals 📄 Paper 1mo ago
Curvature-Aware Optimization for High-Accuracy Physics-Informed Neural Networks
arXiv:2604.05230v1 Announce Type: cross Abstract: Efficient and robust optimization is essential for neural networks, enabling scientific machine learning model
ArXiv cs.AI 📐 ML Fundamentals 📄 Paper ⚡ AI Lesson 1mo ago
VarDrop: Enhancing Training Efficiency by Reducing Variate Redundancy in Periodic Time Series Forecasting
arXiv:2501.14183v3 Announce Type: replace-cross Abstract: Variate tokenization, which independently embeds each variate as separate tokens, has achieved remarka
ArXiv cs.AI 📐 ML Fundamentals 📄 Paper ⚡ AI Lesson 1mo ago
The Polar Express: Optimal Matrix Sign Methods and Their Application to the Muon Algorithm
arXiv:2505.16932v4 Announce Type: replace-cross Abstract: Computing the polar decomposition and the related matrix sign function has been a well-studied problem
ArXiv cs.AI 📐 ML Fundamentals 📄 Paper ⚡ AI Lesson 1mo ago
StateX: Enhancing RNN Recall via Post-training State Expansion
arXiv:2509.22630v2 Announce Type: replace-cross Abstract: Recurrent neural networks (RNNs), such as linear attention and state-space models, have gained popular
ArXiv cs.AI 📐 ML Fundamentals 📄 Paper ⚡ AI Lesson 1mo ago
Eigen-Value: Efficient Domain-Robust Data Valuation via Eigenvalue-Based Approach
arXiv:2510.23409v3 Announce Type: replace-cross Abstract: Data valuation has become central in the era of data-centric AI. It drives efficient training pipeline
ArXiv cs.AI 📐 ML Fundamentals 📄 Paper ⚡ AI Lesson 1mo ago
ReaMIL: Reasoning- and Evidence-Aware Multiple Instance Learning for Whole-Slide Histopathology
arXiv:2601.10073v2 Announce Type: replace-cross Abstract: We introduce ReaMIL (Reasoning- and Evidence-Aware MIL), a multiple instance learning approach for who
ArXiv cs.AI 📐 ML Fundamentals 📄 Paper ⚡ AI Lesson 1mo ago
Incident-Guided Spatiotemporal Traffic Forecasting
arXiv:2602.02528v2 Announce Type: replace-cross Abstract: Recent years have witnessed the rapid development of deep-learning-based, graph-neural-network-based f
Supabase vs Firebase: Which Backend Is Right for Your Next App?
KDnuggets 📐 ML Fundamentals ⚡ AI Lesson 1mo ago
Supabase vs Firebase: Which Backend Is Right for Your Next App?
Compare SQL and NoSQL backend services. Find out which BaaS is right for your next app in this neutral guide.
InfoQ AI/ML 📐 ML Fundamentals 1mo ago
Article: Bloom Filters: Theory, Engineering Trade‑offs, and Implementation in Go
This article walks you through the Go implementation of Bloom filters to optimize the performance of a recommender. It cover the architectural view, Bloom filte
ArXiv cs.AI 📐 ML Fundamentals 📄 Paper 1mo ago
On the "Causality" Step in Policy Gradient Derivations: A Pedagogical Reconciliation of Full Return and Reward-to-Go
arXiv:2604.04686v1 Announce Type: new Abstract: In introductory presentations of policy gradients, one often derives the REINFORCE estimator using the full traj
ArXiv cs.AI 📐 ML Fundamentals 📄 Paper ⚡ AI Lesson 1mo ago
Fine-tuning DeepSeek-OCR-2 for Molecular Structure Recognition
arXiv:2604.03476v1 Announce Type: cross Abstract: Optical Chemical Structure Recognition (OCSR) is critical for converting 2D molecular diagrams from printed li
ArXiv cs.AI 📐 ML Fundamentals 📄 Paper ⚡ AI Lesson 1mo ago
RDEx-CMOP: Feasibility-Aware Indicator-Guided Differential Evolution for Fixed-Budget Constrained Multiobjective Optimization
arXiv:2604.03708v1 Announce Type: cross Abstract: Constrained multiobjective optimisation requires fast feasibility attainment together with stable convergence
ArXiv cs.AI 📐 ML Fundamentals 📄 Paper ⚡ AI Lesson 1mo ago
An Improved Last-Iterate Convergence Rate for Anchored Gradient Descent Ascent
arXiv:2604.03782v1 Announce Type: cross Abstract: We analyze the last-iterate convergence of the Anchored Gradient Descent Ascent algorithm for smooth convex-co
ArXiv cs.AI 📐 ML Fundamentals 📄 Paper ⚡ AI Lesson 1mo ago
Supervised Dimensionality Reduction Revisited: Why LDA on Frozen CNN Features Deserves a Second Look
arXiv:2604.03928v1 Announce Type: cross Abstract: Effective ride-hailing dispatch requires anticipating demand patterns that vary substantially across time-of-d