George Hotz | Programming | hand optimizing a resnet 50 in tinygrad | tinygrad.org | Part 1
Date of the stream 29 Sep 2023.
from $1250 buy https://comma.ai/shop/comma-3x & best ADAS system in the world https://openpilot.comma.ai
Live-stream chat added as Subtitles/CC - English (Twitch Chat) - at the bottom - Show Transcript
Sources:
- https://github.com/geohot/tinygrad
- http://www.incompleteideas.net/IncIdeas/BitterLesson.html
Follow for notifications:
- https://twitch.tv/georgehotz
Support George:
- https://twitch.tv/subs/georgehotz
Pre-order tinybox:
- https://buy.stripe.com/5kAaGL6lk9uX9nW144 (https://tinygrad.org/)
Chapters:
00:00:00 muted intro
00:00:40 un-muted intro
00:00:5…
Watch on YouTube ↗
(saves to browser)
Chapters (41)
muted intro
0:40
un-muted intro
0:50
taiwan and india
1:50
how free is taiwan, china, check in hotel
3:20
free internet in taiwan
4:00
wechat in china
5:55
story time, iceland
7:00
safe singapur
9:20
brazil, south africa
11:10
George trying not be controversial
12:10
grants, fixing the empire
13:45
dismantling our late-stage capitalist society
14:40
George stating his political preference
15:30
Elon Musk the next Caesar, bike trip
17:00
Ukraine gdp per capita, taiwan gdp per capita
17:50
progressive, can't make everyone happy in politics
18:20
sarcasm
19:00
eastern europe bike trip, andrew tate
20:10
countries to avoid
23:05
shipping for non-US citizens for tinybox
23:45
sweden, dubai
28:25
direction of tinygrad
30:30
building a wall
31:00
declining empires
32:50
china spending power, kenya poor
35:00
favorite countries in europe, dubai
36:15
libertarian india
36:50
hand coding resnet 50
40:10
kernels in resnet
43:05
operations for the resnet, the power of the new tinygrad abstractions
46:10
simple abstractions in tinygrad = fast
46:20
init does lots of adds
47:25
renderer, kernel code
48:55
cleanest abstractions anywhere nn
49:20
not optmized kernel, optimization
49:50
benchmarking
58:40
kind of wrong, some kernels bad
1:01:35
how nice is tinygrad
1:08:40
love for python
1:09:30
faster
1:11:20
MadDog
Playlist
Uploads from george hotz archive · george hotz archive · 0 of 60
← Previous
Next →
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
comma ai Driving to self racing cars with openpilot
george hotz archive
comma ai Still driving
george hotz archive
comma ai was live
george hotz archive
comma ai Going home
george hotz archive
comma ai We go to the airport
george hotz archive
comma ai Reversing Prius with cabana + panda telethon!
george hotz archive
comma ai panda manufacturing!
george hotz archive
comma ai Self driving to Best Buy
george hotz archive
comma ai shilling for giraffe!
george hotz archive
comma ai Toyota Prius Driving!!!
george hotz archive
comma ai Late night civic driving
george hotz archive
comma ai Toyota giraffe shilling
george hotz archive
comma ai Live car hacking with panda this time or bust!
george hotz archive
comma ai Product launch question time
george hotz archive
comma ai Driving with the RAV4, launching Tuesday!
george hotz archive
comma ai giraffe ship o' clock
george hotz archive
comma ai openpilot 0.3.9
george hotz archive
comma ai EON assembly!
george hotz archive
comma ai Going through the GM investor deck
george hotz archive
comma ai I love my EON
george hotz archive
comma ai RAV4 driving
george hotz archive
comma ai Shilling at the holiday party
george hotz archive
comma ai EON shipping party
george hotz archive
comma ai EON unboxing!
george hotz archive
comma ai The very straight roads of Nevada
george hotz archive
comma ai Starting our trip with openpilot 0.4
george hotz archive
comma ai Little EON on the prairie
george hotz archive
comma ai The urban sprawl of Colorado
george hotz archive
comma ai Onward to Omaha
george hotz archive
comma ai nothing, nowhere
george hotz archive
comma ai shop.comma.ai Buy things!!!
george hotz archive
comma ai The youth are woke
george hotz archive
comma ai Photo shoot!
george hotz archive
comma ai Product announcements are LIT!
george hotz archive
comma ai Breaking down hype of CES
george hotz archive
comma ai Salt Lakes Everywhere!
george hotz archive
comma ai This is the last one
george hotz archive
comma ai Corolla port o’clock!
george hotz archive
comma ai Presentation where it’s like you are in Omaha with us
george hotz archive
comma ai Asking the scopies the banned question
george hotz archive
comma ai Driving in the Corolla!
george hotz archive
comma ai We got new products! shop.comma.ai
george hotz archive
comma ai Sunday w scopies!
george hotz archive
comma ai Our first Lexus, the Lexus RX!
george hotz archive
comma ai Scopie saturday!
george hotz archive
comma ai Panda!
george hotz archive
comma ai Scopie Sunday! *NOT CLICKBAIT*
george hotz archive
comma ai comma Tree!
george hotz archive
comma ai Scopie Saturday
george hotz archive
comma ai Ok scopie Friday
george hotz archive
comma ai comma pedal!
george hotz archive
comma ai okay this time comma pedal!
george hotz archive
comma ai Why aren’t car companies good
george hotz archive
comma ai How can driving be better
george hotz archive
comma ai Scopie Sunday
george hotz archive
comma ai comma got a new car!
george hotz archive
comma ai Mapping Sunday!
george hotz archive
comma ai Let’s go buy a car
george hotz archive
comma ai Ok I take back all the bad things I said about Ford
george hotz archive
comma ai comma smays are in stock!
george hotz archive
DeepCamp AI