Making Deep Learning Human with Prof. Gilbert Strang (S1:E3)

MIT OpenCourseWare · Beginner ·📐 ML Fundamentals ·6y ago

Key Takeaways

Talks about humanizing the teaching and learning process in linear algebra and matrix methods

Full Transcript

Typically, the first few days of class, these guys ask, you know, "What's the class average going to be? How are we going to be graded?" I don't have any answers for that stuff. So, I say what is totally true, that I don't feel my main job is to grade them. My job is to teach them or learn with them. That's what I continue to do, and gradually they begin to believe. Today on the podcast, we're talking with teaching legend Professor Gil Strang. Maybe the key point is to make it human. You know, you're you're you're a person, like the student is a person. The book isn't quite a person, but it was written by a person. Welcome to Chalk Radio, a podcast about inspired teaching at MIT. I'm your host, Sarah Hansen, from MIT Open Courseware. One of OCW's most popular courses is Professor Strang's 18.06 Linear Algebra, a key foundation for his new course on machine learning, in which he's teaching students to teach computers. Professor Strang is known for inspiring students through his teaching. One YouTube commenter sums it up well. Quote, "This is not lecture. This is art." We wanted to talk with Professor Strang to see how he's been able to make complex math concepts engaging and accessible. We'll pick up our conversation with his explanation of what his new course, 18.065 Matrix Methods and Data Analysis, Signal Processing, and Machine Learning, is all about. So, this this is my adventure into the subject of deep learning. For example, recognizing an image, recognizing a zip code, a bunch of numbers, translating languages, or playing chess. So, that's what the course is about. How How does the machine learn? Essentially, the idea is say take an image then the the the deep learning system leads the machine to look at examples. We all learn from examples, the machine learns from examples. And by from from many examples or many chess games or many pages of of Chinese, you learn what's happening. And and what the the math part is is that the machine ultimately tries to assign a certain weight to a certain number big or small to each part of the image. So, perhaps if you're drawing a three, uh the image the computer recognizes a three, of course, by the curves and and gives less weight or zero weight sometimes to the empty space around the three, but picks out that three. So, that's the idea of deep learning. Traditionally, math courses have been defined by testing, which honestly makes sense. There's typically a right and a wrong answer in math. If you know the operation, if you do it right, you should get the answer. Tests can be a great vehicle for strengthening and measuring student skills, but Professor Strang's approach is different. So, I ask everybody to do a project. There is no final exam. Actually, there's no exam at all. I shouldn't like say this, but uh that's really what the subject is is having an idea of how Okay, I'll use deep learning for some thing. Like the recent proposed project was uh can you identify what makes a an image or or a picture attractive? Mhm. So, somebody has to say, you know, these pictures are attractive, these are not. We have to tell the computer something. What did that feel like to try something new pedagogically? Oh, it's fun. You know, I I like teaching and this is a subject where students just come from everywhere cuz they know it's stuff to learn and they've heard about it and they some of them know more than me but and then they those students write even better projects. Yeah, it's just so I do the lectures for the first three quarters of the course and then I try to get them to present. Which is a great experience for them so it takes a little urging to get them but yeah, yeah, it's really just wonderful. What insights have you gained about um having more of a student-led course and a project-based course? Any anything that other You realize slowly but finally that that's how people learn by by doing there that you couldn't give them a better way to learn than than create a project and usually it's on some topic they know about or they they're interested in like how do you find a criminal in a bunch of people? Yeah, it's just it's a very effective way to learn and something it's something that gets remembered where taking uh doing exam questions that I might make up sort of mathy questions. I don't know if that's remembered 10 years later but I think people's projects are. Along with this new approach comes a new paradigm for measuring student learning. Projects involve more than right and wrong answers. Projects are subjective and bringing the subjectivity into a math course comes with some initial skepticism especially from students who are so used to the typical learn the subject, perform on the test way of doing things. One of the things that makes Professor Strang and his courses so special is that he's not attached to these paradigms. In 18.065, in one of the videos, um you talk about grading students' work. And and you tell them that although this is important to grade their work, it's not your main concern. Your main concern is actually learning with them. Right. Um could you talk a little bit about that? So, typically the first few days of class, these guys ask, you know, "What's the class average going to be? How are we going to be graded?" I don't have any answers for that stuff. So, I say what is totally true, that I'm not I don't feel my main job is to grade them. My job is to teach them or learn with them. And uh that's what I continue to do, and gradually they begin to believe, you know, at at the beginning it's uh they still think, "Okay, but he's got to give me a B or a C or an A." Uh but uh really that's not what 18.065 is about, uh a grade. It's just not. Math is a subject you do, you don't just read, you you have to do it, you have to think about it. The way to learn math is to get into it and and uh Mhm. work on a thing which takes some thought. You can It's not You don't see it immediately, but you see it eventually. One of my favorite takeaways from Professor Strang's approach is that he centers his lessons around the humans in his class. For him, it's about engaging with the students in his course as people, and the learning is done by everyone. Well, first I'd like students and I want to help. And maybe the key point is to think with them, not to just say okay, here it is, listen. Listen up. I think through the the question all over again as they do. And and and you have to give time. You can't zip through a proof because class has to be sort of thinking with you and it happens that I lose the thread or I come up to a dead end where I don't know what I'm supposed to do next, but well, that's okay cuz students are going to hit dead ends, so it's seems to me it's okay for me to get stuck too and then give they see, oh, okay, maybe this this is the way to get out of that corner. I suppose I try to think it through once again and that then you sort of automatically see the word you you recognize what words you need to use and and what step what the steps are. Yeah, if you if you don't if you're not thinking it yourself, then you're probably going too fast and not connecting with the the thinking of the class. Of course, you don't know what everybody's thinking in that class. But uh overall, if if you stay sort of conscious of the class conscious of where they are, that's I think the thing for any speaker. Mhm. Is to be conscious of the audience and it's it's maybe the key point is to make it human. You know, you're you're you're a person like the student is a person. The book isn't quite a person, but it was written by a person. And to see that it's just like a natural thing to do. Mhm. Yeah. So essentially I think the thing is I like students. I like math and putting them together is just the best job in the world. Professor Strang shares additional thoughts on teaching linear algebra and matrix methods in data analysis, signal processing and machine learning in videos within the instructor insight sections of his OCW courses. You can find them at ocw.mit.edu. While you're there, download the teaching resources from his courses and watch his lecture videos. Discover the magic of his teaching for yourself. We're so happy to bring you conversations with MIT faculty who are passionate about impacting the world in positive ways. Write to us to share your story of how you're using OCW materials to shape your world or those of others. Until next time, I'm Sarah Hanson from MIT OpenCourseWare.

Original Description

MIT Chalk Radio, Season 1 Speakers: Gilbert Strang, Sarah Hansen Subscribe here → https://chalk-radio.simplecast.com/ YouTube Playlist: https://www.youtube.com/playlist?list=PLUl4u3cNGP63YwKIMA9K08FFvdeBEl6Lo *Description* In this episode, we talk with Professor Gilbert Strang about humanizing the teaching and learning process in his courses about linear algebra and matrix methods in data analysis, signal processing, and machine learning. *Episode Notes* Mathematics Professor Gilbert Strang is one of MIT’s most revered instructors; his courses, especially the perennially popular linear algebra course 18.06, have received millions of visits on OpenCourseWare, and his lecture videos have won him a devoted following on YouTube as well. (A sample YouTube comment on one of his lectures: “This is not lecture, this is art.”) A few years ago, Professor Strang began teaching a new course (18.065) focusing on the application of mathematical matrices to deep learning and AI. This new course is very unlike a typical undergraduate math course. For one thing, there’s no final exam—in fact, there are no exams at all! Instead, Professor Strang asks each student to spend the semester developing a project that applies the techniques they’re studying to some topic or problem they personally find interesting. In this episode, we hear from Professor Strang about his efforts to humanize math teaching, the value of thinking through problems in real time during lectures—even if it means getting stuck and having to backtrack!—and the importance of staying continually conscious of your students. Relevant Resources: MIT OpenCourseWare http://ocw.mit.edu/ The OCW Educator Portal http://ocw.mit.edu/educator 18.065 on OCW https://ocw.mit.edu/courses/mathematics/18-065-matrix-methods-in-data-analysis-signal-processing-and-machine-learning-spring-2018/ 18.06 on OCW https://ocw.mit.edu/courses/mathematics/18-06-linear-algebra-spring-2010/ 18.06 Scholar Course on OCW https://ocw.mit.e
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from MIT OpenCourseWare · MIT OpenCourseWare · 10 of 60

1 21. Post Trade Clearing, Settlement & Processing
21. Post Trade Clearing, Settlement & Processing
MIT OpenCourseWare
2 10. Financial System Challenges & Opportunities
10. Financial System Challenges & Opportunities
MIT OpenCourseWare
3 7. Technical Challenges
7. Technical Challenges
MIT OpenCourseWare
4 3. Blockchain Basics & Cryptography
3. Blockchain Basics & Cryptography
MIT OpenCourseWare
5 19. Primary Markets, ICOs & Venture Capital, Part 1
19. Primary Markets, ICOs & Venture Capital, Part 1
MIT OpenCourseWare
6 1. Introduction for 15.S12 Blockchain and Money, Fall 2018
1. Introduction for 15.S12 Blockchain and Money, Fall 2018
MIT OpenCourseWare
7 Chalk Radio, A Podcast about Inspired Teaching at MIT (Teaser)
Chalk Radio, A Podcast about Inspired Teaching at MIT (Teaser)
MIT OpenCourseWare
8 Nuclear Gets Personal with Prof. Michael Short (S1:E1)
Nuclear Gets Personal with Prof. Michael Short (S1:E1)
MIT OpenCourseWare
9 How Africa Has Been Made to Mean with Prof. Amah Edoh (S1:E2)
How Africa Has Been Made to Mean with Prof. Amah Edoh (S1:E2)
MIT OpenCourseWare
Making Deep Learning Human with Prof. Gilbert Strang (S1:E3)
Making Deep Learning Human with Prof. Gilbert Strang (S1:E3)
MIT OpenCourseWare
11 Social Impact at Scale, One Project at a Time with Dr. Anjali Sastry (S1:E4)
Social Impact at Scale, One Project at a Time with Dr. Anjali Sastry (S1:E4)
MIT OpenCourseWare
12 Film is for Everyone with Prof. David Thorburn (S1:E5)
Film is for Everyone with Prof. David Thorburn (S1:E5)
MIT OpenCourseWare
13 Lecture 12: Aircraft Performance
Lecture 12: Aircraft Performance
MIT OpenCourseWare
14 Lecture 3: Learning to Fly
Lecture 3: Learning to Fly
MIT OpenCourseWare
15 Lecture 13:  Interpreting Weather Data
Lecture 13: Interpreting Weather Data
MIT OpenCourseWare
16 Lecture 21: Weather Minimums and Final Tips
Lecture 21: Weather Minimums and Final Tips
MIT OpenCourseWare
17 Hand-on, Minds On with Dr. Christopher Terman (S1:E6)
Hand-on, Minds On with Dr. Christopher Terman (S1:E6)
MIT OpenCourseWare
18 Part 4: Eigenvalues and Eigenvectors
Part 4: Eigenvalues and Eigenvectors
MIT OpenCourseWare
19 Part 5: Singular Values and Singular Vectors
Part 5: Singular Values and Singular Vectors
MIT OpenCourseWare
20 Part 3: Orthogonal Vectors
Part 3: Orthogonal Vectors
MIT OpenCourseWare
21 Part 2: The Big Picture of Linear Algebra
Part 2: The Big Picture of Linear Algebra
MIT OpenCourseWare
22 Part 1: The Column Space of a Matrix
Part 1: The Column Space of a Matrix
MIT OpenCourseWare
23 Intro: A New Way to Start Linear Algebra
Intro: A New Way to Start Linear Algebra
MIT OpenCourseWare
24 9. Chromatin Remodeling and Splicing
9. Chromatin Remodeling and Splicing
MIT OpenCourseWare
25 28. Visualizing Life - Fluorescent Proteins
28. Visualizing Life - Fluorescent Proteins
MIT OpenCourseWare
26 20. Roth's theorem III: polynomial method and arithmetic regularity
20. Roth's theorem III: polynomial method and arithmetic regularity
MIT OpenCourseWare
27 8. Szemerédi's graph regularity lemma III: further applications
8. Szemerédi's graph regularity lemma III: further applications
MIT OpenCourseWare
28 19. Roth's theorem II: Fourier analytic proof in the integers
19. Roth's theorem II: Fourier analytic proof in the integers
MIT OpenCourseWare
29 12. Pseudorandom graphs II: second eigenvalue
12. Pseudorandom graphs II: second eigenvalue
MIT OpenCourseWare
30 1. A bridge between graph theory and additive combinatorics
1. A bridge between graph theory and additive combinatorics
MIT OpenCourseWare
31 Special Episode: Teaching Remotely During Covid-19 with Prof. Justin Reich
Special Episode: Teaching Remotely During Covid-19 with Prof. Justin Reich
MIT OpenCourseWare
32 Spring 2020 Update from Dean Rajagopal
Spring 2020 Update from Dean Rajagopal
MIT OpenCourseWare
33 S1E7: Unpacking Misconceptions about Language & Identities with Prof. Michel DeGraff
S1E7: Unpacking Misconceptions about Language & Identities with Prof. Michel DeGraff
MIT OpenCourseWare
34 Climate 101 Live
Climate 101 Live
MIT OpenCourseWare
35 Welcome for Volunteers (for EarthDNA's Climate 101)
Welcome for Volunteers (for EarthDNA's Climate 101)
MIT OpenCourseWare
36 Learning to Fly with Drs. Philip Greenspun & Tina Srivastava (S1:E8)
Learning to Fly with Drs. Philip Greenspun & Tina Srivastava (S1:E8)
MIT OpenCourseWare
37 Thinking Like an Economist with Prof. Jonathan Gruber (S1:E9)
Thinking Like an Economist with Prof. Jonathan Gruber (S1:E9)
MIT OpenCourseWare
38 2. Cyber Network Data Processing; AI Data Architecture
2. Cyber Network Data Processing; AI Data Architecture
MIT OpenCourseWare
39 1. Artificial Intelligence and Machine Learning
1. Artificial Intelligence and Machine Learning
MIT OpenCourseWare
40 2: Resistor Capacitor Circuit and Nernst Potential - Intro to Neural Computation
2: Resistor Capacitor Circuit and Nernst Potential - Intro to Neural Computation
MIT OpenCourseWare
41 14: Rate Models and Perceptrons - Intro to Neural Computation
14: Rate Models and Perceptrons - Intro to Neural Computation
MIT OpenCourseWare
42 4: Hodgkin-Huxley Model Part 1 - Intro to Neural Computation
4: Hodgkin-Huxley Model Part 1 - Intro to Neural Computation
MIT OpenCourseWare
43 18: Recurrent Networks - Intro to Neural Computation
18: Recurrent Networks - Intro to Neural Computation
MIT OpenCourseWare
44 3: Resistor Capacitor Neuron Model - Intro to Neural Computation
3: Resistor Capacitor Neuron Model - Intro to Neural Computation
MIT OpenCourseWare
45 15: Matrix Operations - Intro to Neural Computation
15: Matrix Operations - Intro to Neural Computation
MIT OpenCourseWare
46 13: Spectral Analysis Part 3 - Intro to Neural Computation
13: Spectral Analysis Part 3 - Intro to Neural Computation
MIT OpenCourseWare
47 16: Basis Sets - Intro to Neural Computation
16: Basis Sets - Intro to Neural Computation
MIT OpenCourseWare
48 20: Hopfield Networks - Intro to Neural Computation
20: Hopfield Networks - Intro to Neural Computation
MIT OpenCourseWare
49 8: Spike Trains - Intro to Neural Computation
8: Spike Trains - Intro to Neural Computation
MIT OpenCourseWare
50 7: Synapses - Intro to Neural Computation
7: Synapses - Intro to Neural Computation
MIT OpenCourseWare
51 19: Neural Integrators - Intro to Neural Computation
19: Neural Integrators - Intro to Neural Computation
MIT OpenCourseWare
52 5: Hodgkin-Huxley Model Part 2 - Intro to Neural Computation
5: Hodgkin-Huxley Model Part 2 - Intro to Neural Computation
MIT OpenCourseWare
53 6: Dendrites - Intro to Neural Computation
6: Dendrites - Intro to Neural Computation
MIT OpenCourseWare
54 17: Principal Components Analysis_ - Intro to Neural Computation
17: Principal Components Analysis_ - Intro to Neural Computation
MIT OpenCourseWare
55 12: Spectral Analysis Part 2 - Intro to Neural Computation
12: Spectral Analysis Part 2 - Intro to Neural Computation
MIT OpenCourseWare
56 11: Spectral Analysis Part 1 - Intro to Neural Computation
11: Spectral Analysis Part 1 - Intro to Neural Computation
MIT OpenCourseWare
57 9: Receptive Fields - Intro to Neural Computation
9: Receptive Fields - Intro to Neural Computation
MIT OpenCourseWare
58 10: Time Series - Intro to Neural Computation
10: Time Series - Intro to Neural Computation
MIT OpenCourseWare
59 1: Course Overview and Ionic Currents - Intro to Neural Computation
1: Course Overview and Ionic Currents - Intro to Neural Computation
MIT OpenCourseWare
60 The Power of OER with Profs. Mary Rowe and Elizabeth Siler (S1:E10)
The Power of OER with Profs. Mary Rowe and Elizabeth Siler (S1:E10)
MIT OpenCourseWare

Related Reads

📰
I Taught an AI to Recognize the Shadows of Four-Dimensional Objects
Learn how a neural network was taught to recognize the shadows of four-dimensional objects, expanding our understanding of high-dimensional geometry
Medium · AI
📰
Java Stream API — Beyond Java 8 Part 1
Learn Java Stream API beyond Java 8 and improve your coding skills
Medium · Programming
📰
SVD y PCA: cómo el álgebra lineal comprime miles de dimensiones
Aprende a reducir dimensiones con SVD y PCA, técnicas de álgebra lineal que sostienen el machine learning moderno
Dev.to AI
📰
The Baseline I Actually Picked for My Kaggle Pokémon Agent, and Why
Learn how to approach building a Kaggle Pokémon agent by understanding the baseline model selection process and its importance in competitive machine learning challenges
Medium · Machine Learning
Up next
QR Decomposition is Just Gram-Schmidt with Receipts
DataMListic
Watch →