Fireside Chat #7: How to Build an Enterprise Machine Learning Platform from Scratch
Russell Brooks is Principal Machine Learning Engineer at Realtor.com and has worked extensively as a software engineer, data scientist, platform engineer, and machine learning manager.
In this fireside chat, Russell joins Hugo Bowne-Anderson, Outerbounds’ Head of Developer Relations, to discuss what building an enterprise ML platform from scratch looks like in practice, including the journeys he experienced at both OpCity and Realtor.com, where he took both organizations from a bus factor of 1 to reproducible and automated ML-powered software.
After attending, you’ll know about
- The ins and outs of what building an enterprise ML platform from scratch looks like in practice;
What questions are key to answer when building an enterprise ML platform from scratch;
- How to demonstrate the impact of the data and machine learning functions in organizations when doing so;
- The most impactful ways of collaborating for SWEs, data scientists, platform engineers, and ML engineers,
And much more! The fireside chat will be followed by an AMA with Russell and Hugo at slack.outerbounds.co.
Find out more about how we think about MLOps, OSS, and human-centric data science tools here: https://outerbounds.com/
00:00 Prelude
04:27 The fireside chat begins!
06:48 The path to data science and machine learning engineering
10:10 The value of ML in real estate and beyond
13:30 Demonstrating the value and impact of data science and ML in your organization
15:55 Building an entire ML platform from scratch
20:12 What is Metaflow and how does it help your ML function?
23:26 What exactly is production machine learning?
35:41 Staying on top of all the ML tooling: how?!
42:56 The moving parts of full stack machine learning
47:25 Data scientists, ML engineers, and platform engineers: how they work together (and how they don't)
49:25 Software engineering skills for data scientists
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
Playlist
Playlist UU5h8Ji6Lm1RyAZopnCpDq7Q · Outerbounds · 23 of 60
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
▶
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
Metaflow GUI for monitoring machine learning workflows
Outerbounds
Metaflow Cards [no sound]
Outerbounds
Fireside chat #1: How to Produce Sustainable Business Value with Machine Learning
Outerbounds
Fireside chat #2: MadeWithML.com -- Teaching Practical Machine Learning
Outerbounds
Metaflow on Kubernetes and Argo Workflows [no sound]
Outerbounds
Fireside chat #3: Reasonable Scale Machine Learning -- You're not Google and it's totally OK
Outerbounds
Metaflow Tags: Programmatic Tagging
Outerbounds
Metaflow Tags: Basic Tagging
Outerbounds
Metaflow Tags: Tags in CI/CD
Outerbounds
Metaflow Tags: Tags and Namespaces
Outerbounds
Metaflow Tags: Tags and Continuous Training
Outerbounds
Fireside chat #4: Machine Learning and User Experience -- Building ML Products for People
Outerbounds
Fireside Chat #5: Machine Learning + Infrastructure for Humans
Outerbounds
Metaflow Sandbox Demo: Free Data Science Infrastructure In the Browser
Outerbounds
Metaflow on Azure
Outerbounds
Fireside Chat #6: Operationalizing ML -- Patterns and Pain Points from MLOps Practitioners
Outerbounds
ML engineering vs traditional software engineering: similarities and differences
Outerbounds
Why data scientists love and hate notebooks: velocity and validation
Outerbounds
What even is a 10x ML engineer?
Outerbounds
The 4 main tasks in the production ML lifecycle
Outerbounds
Is the premise of data-centric AI flawed?
Outerbounds
The 3 factors that Determine the success of ML projects
Outerbounds
Fireside Chat #7: How to Build an Enterprise Machine Learning Platform from Scratch
Outerbounds
Run Metaflow on any cloud: Google Cloud, Azure, or AWS [no sound]
Outerbounds
Metaflow on GCP
Outerbounds
Fireside Chat #8: Navigating the Full Stack of Machine Learning
Outerbounds
How to Build a Full-Stack Recommender System
Outerbounds
Modernize your Airflow deployments with Metaflow - zero-cost migration [no sound]
Outerbounds
Easy Airflow DAGs for ML and data science with Metaflow [no sound]
Outerbounds
Fireside chat #9: Language Processing: From Prototype to Production
Outerbounds
How to build end-to-end recommender systems at reasonable scale
Outerbounds
Full-Stack Machine Learning with Metaflow on CoRise
Outerbounds
Natural Language Processing meets MLOps
Outerbounds
Fireside Chat #10: Large Language Models: Beyond Proofs of Concept
Outerbounds
What even are Large Language Models?
Outerbounds
How to get started with LLMs today
Outerbounds
LLMs in production
Outerbounds
Accessing secrets securely in Metaflow [no audio]
Outerbounds
Fireside Chat #11: The Open-Source Modern Data Stack
Outerbounds
Fireside chat #12: Kubernetes for Data Scientists
Outerbounds
Behind the Screen: How Amazon Prime Video ships RecSys models 4x faster
Outerbounds
Fireside chat #13: Supply Chain Security in Machine Learning
Outerbounds
Quick Delivery, Quicker ML: DeliveryHero's Metaflow Story
Outerbounds
Crafting General Intelligence: LLM Fine-tuning with Metaflow at Adept.ai
Outerbounds
Fuelling Decisions: How DTN Powers Gas Pricing and Data Science Collaboration
Outerbounds
From Kitchen to Doorstep: Optimizing Data Science Velocity at Deliveroo
Outerbounds
Building a GenAI Ready ML Platform with Metaflow at Autodesk
Outerbounds
Media Transcoding for 10 Million users and beyond with Metaflow at Epignosis
Outerbounds
Telematics with Metaflow: How Nirvana Insurance built a large-scale Risk Estimation platform
Outerbounds
Fireside chat #14: Generative AI and Machine Learning for Film, TV, and Gaming
Outerbounds
The Past, Present, and Future of Generative AI
Outerbounds
Building Production Systems with Generative AI, Machine Learning, and Data
Outerbounds
A Custom Fine-Tuned LLM in Action (LLMs, RAG, and Fine-Tuning: An Interactive Guided Tour Part 5)
Outerbounds
Building Live Production Systems with RAG (LLMs & RAG: An Interactive Guided Tour Part 4)
Outerbounds
Better Relevancy with RAG (LLMs, RAG, and Fine-Tuning: An Interactive Guided Tour Part 3)
Outerbounds
Working with OSS LLMs (LLMs, RAG, and Fine-Tuning: An Interactive Guided Tour Part 2)
Outerbounds
Hitting OpenAI and Other Vendor APIs (LLMs, RAG, and Fine-Tuning: An Interactive Guided Tour Part 1)
Outerbounds
Production Systems with Generative AI (LLMs, RAG, & Fine-Tuning: An Interactive Guided Tour Part 0)
Outerbounds
LLMs in Practice: A Guide to Recent Trends and Techniques
Outerbounds
Metaflow for distributed high-performance computing and large-scale AI training
Outerbounds
More on: ML Pipelines
View skill →Related AI Lessons
⚡
⚡
⚡
⚡
The Threshold Is a Business Decision, Not a Statistical One
Medium · Machine Learning
Can Your Stress Level Predict How Much You Sleep?
Medium · Machine Learning
Role of Model Architecture In Inference — Inference Series
Medium · Machine Learning
Role of Model Architecture In Inference — Inference Series
Medium · Deep Learning
Chapters (12)
Prelude
4:27
The fireside chat begins!
6:48
The path to data science and machine learning engineering
10:10
The value of ML in real estate and beyond
13:30
Demonstrating the value and impact of data science and ML in your organization
15:55
Building an entire ML platform from scratch
20:12
What is Metaflow and how does it help your ML function?
23:26
What exactly is production machine learning?
35:41
Staying on top of all the ML tooling: how?!
42:56
The moving parts of full stack machine learning
47:25
Data scientists, ML engineers, and platform engineers: how they work together (a
49:25
Software engineering skills for data scientists
🎓
Tutor Explanation
DeepCamp AI