George Hotz | Programming | hand optimizing a resnet 50 in tinygrad | tinygrad.org | Part 1

Date of the stream 29 Sep 2023. from $1250 buy https://comma.ai/shop/comma-3x & best ADAS system in the world https://openpilot.comma.ai Live-stream chat added as Subtitles/CC - English (Twitch Chat) - at the bottom - Show Transcript Sources: - https://github.com/geohot/tinygrad - http://www.incompleteideas.net/IncIdeas/BitterLesson.html Follow for notifications: - https://twitch.tv/georgehotz Support George: - https://twitch.tv/subs/georgehotz Pre-order tinybox: - https://buy.stripe.com/5kAaGL6lk9uX9nW144 (https://tinygrad.org/) Chapters: 00:00:00 muted intro 00:00:40 un-muted intro 00:00:50 taiwan and india 00:01:50 how free is taiwan, china, check in hotel 00:03:20 free internet in taiwan 00:04:00 wechat in china 00:05:55 story time, iceland 00:07:00 safe singapur 00:09:20 brazil, south africa 00:11:10 George trying not be controversial 00:12:10 grants, fixing the empire 00:13:45 dismantling our late-stage capitalist society 00:14:40 George stating his political preference 00:15:30 Elon Musk the next Caesar, bike trip 00:17:00 Ukraine gdp per capita, taiwan gdp per capita 00:17:50 progressive, can't make everyone happy in politics 00:18:20 sarcasm 00:19:00 eastern europe bike trip, andrew tate 00:20:10 countries to avoid 00:23:05 shipping for non-US citizens for tinybox 00:23:45 sweden, dubai 00:28:25 direction of tinygrad 00:30:30 building a wall 00:31:00 declining empires 00:32:50 china spending power, kenya poor 00:35:00 favorite countries in europe, dubai 00:36:15 libertarian india 00:36:50 hand coding resnet 50 00:40:10 kernels in resnet 00:43:05 operations for the resnet, the power of the new tinygrad abstractions 00:46:10 simple abstractions in tinygrad = fast 00:46:20 init does lots of adds 00:47:25 renderer, kernel code 00:48:55 cleanest abstractions anywhere nn 00:49:20 not optmized kernel, optimization 00:49:50 benchmarking 00:58:40 kind of wrong, some kernels bad 01:01:35 how nice is tinygrad 01:08:40 love for python 01:09:30 faster 01:11:20 MadDog