George Hotz | Programming | tinygrad: monday afternoon at the tiny corp making things fast
Date of stream 8 Nov 2022.
Live-stream chat added as Subtitles/CC - English (Twitch Chat) - three-dot menu icon - Show transcript
Source files:
- https://github.com/geohot/tinygrad/tree/chonker
- https://github.com/geohot/tinygrad
Follow for notifications:
- https://twitch.tv/georgehotz
Support George:
- https://twitch.tv/subs/georgehotz
Programming playlist:
- https://www.youtube.com/playlist?list=PLzFUMGbVxlQs5s-LNAyKgcq5SL28ZLLKC
Chapters:
00:00:00 intro
00:00:25 not voting
00:03:00 overview of work (tests)
00:03:39 whiteboard
00:03:00 running tests
00:05:35 what makes things fast, slow
0…
Watch on YouTube ↗
(saves to browser)
Chapters (51)
intro
0:25
not voting
3:00
overview of work (tests)
3:39
whiteboard
3:00
running tests
5:35
what makes things fast, slow
8:10
review of pull requests
9:26
chonker
11:00
bug 1, 50$, 15 min phone call
12:20
bug 2, test_max
13:10
price only if solved live
14:25
full time at tiny corp
14:59
call llvm.maximum
19:30
current results
20:30
amx coprocessor
24:40
stable diffusion 3x faster on M1
25:20
don't want to talk about chess
26:45
checkers
27:10
stability founding
27:40
working with tiny corp
28:20
dumb questions, andrew tate
29:00
cache coherency, order of computation
30:15
no more edge tpu
30:40
messy first clean later
35:00
cache aware, order
35:30
theoretical maximum
37:15
Auto-Vectorization in LLVM, doing by hand
42:35
50$ for max or fma
42:53
llvmlite
46:00
llvm unsafe-fp-math
52:10
enable-unsafe-fp-math llvmlite
59:40
not voting
1:01:18
llvmlite create_module_pass_manager
1:02:13
add_instruction_combining_pass
1:03:40
llvm 11 download
1:07:00
InstructionMix llvm
1:07:25
somewhere in there
1:09:00
llvm 14
1:11:30
ffp-contract clang argument
1:15:25
auto vectorising
1:17:05
raining outside in San Diego, crazy emails from people
1:18:25
tbaa llvm
1:23:16
not ir problem
1:34:10
brew install llvm 11
1:34:57
aarch-64-use-aa
1:35:59
llvm 11 configuration not correct
1:36:50
don't like llvmlite
1:37:30
polyhedral loop optimizer
1:41:05
debug only
1:44:02
not a debug build
1:52:25
numba output llvm bytec
Playlist
Uploads from george hotz archive · george hotz archive · 0 of 60
← Previous
Next →
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
comma ai Driving to self racing cars with openpilot
george hotz archive
comma ai Still driving
george hotz archive
comma ai was live
george hotz archive
comma ai Going home
george hotz archive
comma ai We go to the airport
george hotz archive
comma ai Reversing Prius with cabana + panda telethon!
george hotz archive
comma ai panda manufacturing!
george hotz archive
comma ai Self driving to Best Buy
george hotz archive
comma ai shilling for giraffe!
george hotz archive
comma ai Toyota Prius Driving!!!
george hotz archive
comma ai Late night civic driving
george hotz archive
comma ai Toyota giraffe shilling
george hotz archive
comma ai Live car hacking with panda this time or bust!
george hotz archive
comma ai Product launch question time
george hotz archive
comma ai Driving with the RAV4, launching Tuesday!
george hotz archive
comma ai giraffe ship o' clock
george hotz archive
comma ai openpilot 0.3.9
george hotz archive
comma ai EON assembly!
george hotz archive
comma ai Going through the GM investor deck
george hotz archive
comma ai I love my EON
george hotz archive
comma ai RAV4 driving
george hotz archive
comma ai Shilling at the holiday party
george hotz archive
comma ai EON shipping party
george hotz archive
comma ai EON unboxing!
george hotz archive
comma ai The very straight roads of Nevada
george hotz archive
comma ai Starting our trip with openpilot 0.4
george hotz archive
comma ai Little EON on the prairie
george hotz archive
comma ai The urban sprawl of Colorado
george hotz archive
comma ai Onward to Omaha
george hotz archive
comma ai nothing, nowhere
george hotz archive
comma ai shop.comma.ai Buy things!!!
george hotz archive
comma ai The youth are woke
george hotz archive
comma ai Photo shoot!
george hotz archive
comma ai Product announcements are LIT!
george hotz archive
comma ai Breaking down hype of CES
george hotz archive
comma ai Salt Lakes Everywhere!
george hotz archive
comma ai This is the last one
george hotz archive
comma ai Corolla port o’clock!
george hotz archive
comma ai Presentation where it’s like you are in Omaha with us
george hotz archive
comma ai Asking the scopies the banned question
george hotz archive
comma ai Driving in the Corolla!
george hotz archive
comma ai We got new products! shop.comma.ai
george hotz archive
comma ai Sunday w scopies!
george hotz archive
comma ai Our first Lexus, the Lexus RX!
george hotz archive
comma ai Scopie saturday!
george hotz archive
comma ai Panda!
george hotz archive
comma ai Scopie Sunday! *NOT CLICKBAIT*
george hotz archive
comma ai comma Tree!
george hotz archive
comma ai Scopie Saturday
george hotz archive
comma ai Ok scopie Friday
george hotz archive
comma ai comma pedal!
george hotz archive
comma ai okay this time comma pedal!
george hotz archive
comma ai Why aren’t car companies good
george hotz archive
comma ai How can driving be better
george hotz archive
comma ai Scopie Sunday
george hotz archive
comma ai comma got a new car!
george hotz archive
comma ai Mapping Sunday!
george hotz archive
comma ai Let’s go buy a car
george hotz archive
comma ai Ok I take back all the bad things I said about Ford
george hotz archive
comma ai comma smays are in stock!
george hotz archive
DeepCamp AI