The extra validation set is useless: cross-validation can pick both your model and your number of…

📰 Medium · Data Science

Learn why a separate validation set may not be necessary for early stopping and how cross-validation can be used instead

intermediate Published 20 Jul 2026
Action Steps
  1. Read the original Medium post to understand the heretical claim
  2. Apply cross-validation to pick both your model and the number of parameters
  3. Configure your model development workflow to use cross-validation for early stopping
  4. Test the performance of your model using cross-validation
  5. Compare the results with and without a separate validation set
Who Needs to Know This

Data scientists and machine learning engineers can benefit from this insight to optimize their model development workflow

Key Insight

💡 Cross-validation can be used for early stopping, eliminating the need for a separate validation set

Share This
💡 Cross-validation can pick both your model and number of parameters, making a separate validation set unnecessary #MachineLearning #DataScience

Key Takeaways

Learn why a separate validation set may not be necessary for early stopping and how cross-validation can be used instead

Full Article

A few years ago I wrote a short Medium post with a slightly heretical claim: you don’t need a separate held-out set for early stopping (to… Continue reading on Medium »
Read full article → ← Back to Reads

Related Videos

The Adam Optimizer is Just Momentum + RMSProp
The Adam Optimizer is Just Momentum + RMSProp
DataMListic
How to start learning AI | Complete AI Learning Path | Roadmap For Beginners (With No Background)
How to start learning AI | Complete AI Learning Path | Roadmap For Beginners (With No Background)
Career Talk
The Real AI Frontier Isn't Smarter Machines (with Catherine Williams)
The Real AI Frontier Isn't Smarter Machines (with Catherine Williams)
Super Data Science: ML & AI Podcast with Jon Krohn
SQLite3 Tutorial - Learn SQL for Python in 17 Minutes
SQLite3 Tutorial - Learn SQL for Python in 17 Minutes
Thomas Janssen
How to Train AI to Play Games ? How AI Learns to Play ? Several Methods EXPLAINED
How to Train AI to Play Games ? How AI Learns to Play ? Several Methods EXPLAINED
MaxonShire
Introduction to Machine Learning: Lesson 05
Introduction to Machine Learning: Lesson 05
Stephen Blum