The State of AI with Stanford Researcher Yifan Mai [Podcast #149]
On this week's episode of the podcast, freeCodeCamp founder Quincy Larson interviews Yifan Mai, a Senior Software Engineer on Google's TensorFlow team who left the private sector to go do AI research at Stanford. He's the lead maintainer of the open source HELM project, where he benchmarks the performance of Large Language Models.
We talk about:
- Open Source VS Open Weights in LLMs
- The Ragged Frontier of LLM use cases
- AI impact on jobs and our predictions
- What to learn so you can stay above the waterline
Can you guess what song I'm playing in the intro?
Also, I want to thank the 10,9…
Watch on YouTube ↗
(saves to browser)
Chapters (21)
Introduction to Yifan Mai and His Journey
3:53
Transitioning from Industry to Academia
7:03
The Role of a Research Engineer
10:18
Bridging the Gap: Engineering Practices in Research
13:15
The Importance of Software Quality in Research
16:02
Understanding Research Incentives
19:06
Overview of the HELM Project
22:11
Benchmarking Language Models
25:00
Open Weights vs. Closed Weights in AI Models
27:57
The Impact of Open Models on Research
31:04
Ethics and Legalities in AI Training Data
34:02
Evaluating Model Performance and Win Rates
40:31
The Scalability of AI and Human Alignment
42:55
Synthetic Data and Model Biases
44:40
The Role of Human Feedback in AI Training
47:46
Quality vs. Quantity in Training Data
50:25
The Limits of Current Data Sources
53:58
Challenges in Evaluating AI Performance
57:57
The Ragged Frontier of AI Capabilities
1:02:51
Programming as a Tool for Logical Thinking
1:08:07
Impre
Playlist
Uploads from freeCodeCamp.org · freeCodeCamp.org · 0 of 60
← Previous
Next →
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
![Python Automation Tutorial – How to Automate Tasks for Beginners [Full Course]](https://i.ytimg.com/vi/s8XjEuplx_U/mqdefault.jpg)
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
Deploy 12 apps to AWS, Azure, & Google Cloud
freeCodeCamp.org
Reinforcement Learning Course: Intro to Advanced Actor Critic Methods
freeCodeCamp.org
How does the internet work? (Full Course)
freeCodeCamp.org
Code a Dictionary with React and Material UI - Tutorial
freeCodeCamp.org
Graph Algorithms for Technical Interviews - Full Course
freeCodeCamp.org
HTML Tutorial - Website Crash Course for Beginners
freeCodeCamp.org
Google Cloud Digital Leader Certification Course - Pass the Exam!
freeCodeCamp.org
Advanced OpenGL - Crash Course
freeCodeCamp.org
FastAPI Course for Beginners
freeCodeCamp.org
Google Sheets - Full Course
freeCodeCamp.org
Python Django and Google APIs - Project Tutorial
freeCodeCamp.org
Java Native Interface (28-Hour Course)
freeCodeCamp.org
Learn How to Code - Programming for Beginners Tutorial with Python and C#
freeCodeCamp.org
Android Programming Course - Kotlin, Jetpack Compose UI, Graph Data Structures & Algorithms
freeCodeCamp.org
Code a Discord Chat Bot That Talks Like Your Favorite Character - Tutorial
freeCodeCamp.org
Machine Learning Course for Beginners
freeCodeCamp.org
Selenium Course for Beginners - Web Scraping Bots, Browser Automation, Testing (Tutorial)
freeCodeCamp.org
Figma Course - Web Design Tutorial for Beginners
freeCodeCamp.org
Vue.js Course for Beginners
freeCodeCamp.org
Data Structures and Algorithms in Python - Full Course for Beginners
freeCodeCamp.org
Solidity, Blockchain, and Smart Contract Course – Beginner to Expert Python Tutorial
freeCodeCamp.org
Linux Essentials for Ethical Hackers - Full InfoSec Course
freeCodeCamp.org
Gatsby Static Site Generator Tutorial
freeCodeCamp.org
Django For Everybody - Full Python University Course
freeCodeCamp.org
Python Automation Tutorial – How to Automate Tasks for Beginners [Full Course]
freeCodeCamp.org
R Shiny for Data Science Tutorial – Build Interactive Data-Driven Web Apps
freeCodeCamp.org
Natural Language Processing with spaCy & Python - Course for Beginners
freeCodeCamp.org
HTML & CSS Project Tutorial - Build a Recipes Website
freeCodeCamp.org
Git for Professionals Tutorial - Tools & Concepts for Mastering Version Control with Git
freeCodeCamp.org
TensorFlow for Computer Vision Course - Full Python Tutorial for Beginners
freeCodeCamp.org
HashiCorp Terraform Associate Certification Course - Pass the Exam!
freeCodeCamp.org
AWS VPC Beginner to Pro - Virtual Private Cloud Tutorial
freeCodeCamp.org
Object Oriented Programming with Python - Full Course for Beginners
freeCodeCamp.org
Node.js / Express Course - Build 4 Projects
freeCodeCamp.org
Binary Tree Algorithms for Technical Interviews - Full Course
freeCodeCamp.org
TensorFlow Lite for Edge Devices - Tutorial
freeCodeCamp.org
Angular Tutorial for Beginners - Web Framework with Typescript Course
freeCodeCamp.org
Unreal Engine & C++ Tutorial - Endless Runner Game 🏃🏽♀️
freeCodeCamp.org
Android App Development Tutorial for Beginners - Your First App
freeCodeCamp.org
Django Tutorial - Create a Digital Resume with a Python Backend
freeCodeCamp.org
Learn React by Building an eCommerce Site - Tutorial
freeCodeCamp.org
JavaScript Tutorial - PuzzleCam Game
freeCodeCamp.org
Python API Development - Comprehensive Course for Beginners
freeCodeCamp.org
The 50 Most Popular Linux & Terminal Commands - Full Course for Beginners
freeCodeCamp.org
Web Applications for Everybody Course - Dr. Chuck Teaches HTML, PHP, SQL, CSS, JavaScript, and more!
freeCodeCamp.org
Code a Squid Game JavaScript Game Using Three.js - Tutorial for Beginners
freeCodeCamp.org
Micro-Frontends Course - Beginner to Expert
freeCodeCamp.org
Unreal Engine & C++ Tutorial - 1st Person Shooter Game
freeCodeCamp.org
C++ Programming Tutorial - Build a 3-Band Compressor Audio Plugin (w/ JUCE Framework)
freeCodeCamp.org
Infrastructure as Code - Crash Course
freeCodeCamp.org
AWS Certified Cloud Practitioner Certification Course (CLF-C01) - Pass the Exam!
freeCodeCamp.org
Advanced Git Tutorial - Interactive Rebase, Cherry-Picking, Reflog, Submodules and more
freeCodeCamp.org
Learn ASP.NET Core MVC (.NET 6) - Full Course
freeCodeCamp.org
Feature Toggles - Why and How to Add to Your Software
freeCodeCamp.org
Data Analysis with Python for Excel Users - Full Course
freeCodeCamp.org
NoSQL Database Tutorial – Full Course for Beginners
freeCodeCamp.org
Rust Programming Course for Beginners - Tutorial
freeCodeCamp.org
Razor Pages for ASP.NET Core - Full Course (.NET 6)
freeCodeCamp.org
The Business of Building Apps - App Product Management Course for Developers
freeCodeCamp.org
Bootstrap CSS Framework - Full Course for Beginners
freeCodeCamp.org
DeepCamp AI