George Hotz | Programming | can you multiply a matrix? (noob lesson) | geohot/tinygrad/tree/gemm
Date of stream 25 Jun 2022.
Live-stream chat added as Subtitles/CC - English (Twitch Chat).
Stream title: can you multiply a matrix? (noob lesson)
Source files:
- https://github.com/geohot/tinygrad/tree/gemm
Follow for notifications:
- https://twitch.tv/georgehotz
Support George:
- https://twitch.tv/subs/georgehotz
Programming playlist:
- https://www.youtube.com/playlist?list=PLzFUMGbVxlQs5s-LNAyKgcq5SL28ZLLKC
Compute computer
- Ubuntu 20.04.4 LTS
- AMD Ryzen 9 5950X
- 64GB RAM
- AMD Radeon RX 6900 XT
Streaming computer
- Apple MacBook M1
- LG UltraFine 5K
- Blue Yeti
- Apple Magic Keyboard
-…
Watch on YouTube ↗
(saves to browser)
Chapters (40)
intro
1:10
quiet computer
2:10
no adderall joke
3:00
noob day
4:00
how to multiply a matrix
6:00
big matrix
7:10
j_blow raid George
7:45
how much compute is matrix multiplication
8:25
how to do matrix multiplication
9:50
FLOPS, time.monotonic
11:50
SI prefixes
14:00
hype titles, freedom units
15:00
CPU TFLOP/S, threadripper, ryzen
17:55
AMD Radeon RX 6900 XT
18:35
SGEMM, DGEMM, MADDNESS
20:10
github.com/dblalock/bolt
21:50
Theoretical GFLOPS
23:30
Same performance in C
26:30
multiply a matrix in C
28:05
timer in C
33:45
python,C performance, tiling
35:00
today's lesson (cache aware algorithm)
35:50
order of for loops
37:30
still slow
44:55
avx2 instructions c
49:30
FMA3, VFMADD
50:50
don't use strassen, cpu instructions, FMA
56:00
avx2 only about integers, we need FMA, thank you @paranon1
57:40
real
59:00
segmentation fault, align(64)
1:04:00
is that wrong?
1:09:00
still slow, threads
1:11:10
1 thread speed
1:14:30
visualizing what is it doing
1:15:20
_m256 init to 0, _mm256_fmadd_ps
1:23:04
time for printf's
1:26:00
short break, should we play wonderwall on a guitar
1:27:20
tweet about downsizing apartments
1:27:50
gdb
1:29:00
this is ille
Playlist
Uploads from george hotz archive · george hotz archive · 0 of 60
← Previous
Next →
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
comma ai Driving to self racing cars with openpilot
george hotz archive
comma ai Still driving
george hotz archive
comma ai was live
george hotz archive
comma ai Going home
george hotz archive
comma ai We go to the airport
george hotz archive
comma ai Reversing Prius with cabana + panda telethon!
george hotz archive
comma ai panda manufacturing!
george hotz archive
comma ai Self driving to Best Buy
george hotz archive
comma ai shilling for giraffe!
george hotz archive
comma ai Toyota Prius Driving!!!
george hotz archive
comma ai Late night civic driving
george hotz archive
comma ai Toyota giraffe shilling
george hotz archive
comma ai Live car hacking with panda this time or bust!
george hotz archive
comma ai Product launch question time
george hotz archive
comma ai Driving with the RAV4, launching Tuesday!
george hotz archive
comma ai giraffe ship o' clock
george hotz archive
comma ai openpilot 0.3.9
george hotz archive
comma ai EON assembly!
george hotz archive
comma ai Going through the GM investor deck
george hotz archive
comma ai I love my EON
george hotz archive
comma ai RAV4 driving
george hotz archive
comma ai Shilling at the holiday party
george hotz archive
comma ai EON shipping party
george hotz archive
comma ai EON unboxing!
george hotz archive
comma ai The very straight roads of Nevada
george hotz archive
comma ai Starting our trip with openpilot 0.4
george hotz archive
comma ai Little EON on the prairie
george hotz archive
comma ai The urban sprawl of Colorado
george hotz archive
comma ai Onward to Omaha
george hotz archive
comma ai nothing, nowhere
george hotz archive
comma ai shop.comma.ai Buy things!!!
george hotz archive
comma ai The youth are woke
george hotz archive
comma ai Photo shoot!
george hotz archive
comma ai Product announcements are LIT!
george hotz archive
comma ai Breaking down hype of CES
george hotz archive
comma ai Salt Lakes Everywhere!
george hotz archive
comma ai This is the last one
george hotz archive
comma ai Corolla port o’clock!
george hotz archive
comma ai Presentation where it’s like you are in Omaha with us
george hotz archive
comma ai Asking the scopies the banned question
george hotz archive
comma ai Driving in the Corolla!
george hotz archive
comma ai We got new products! shop.comma.ai
george hotz archive
comma ai Sunday w scopies!
george hotz archive
comma ai Our first Lexus, the Lexus RX!
george hotz archive
comma ai Scopie saturday!
george hotz archive
comma ai Panda!
george hotz archive
comma ai Scopie Sunday! *NOT CLICKBAIT*
george hotz archive
comma ai comma Tree!
george hotz archive
comma ai Scopie Saturday
george hotz archive
comma ai Ok scopie Friday
george hotz archive
comma ai comma pedal!
george hotz archive
comma ai okay this time comma pedal!
george hotz archive
comma ai Why aren’t car companies good
george hotz archive
comma ai How can driving be better
george hotz archive
comma ai Scopie Sunday
george hotz archive
comma ai comma got a new car!
george hotz archive
comma ai Mapping Sunday!
george hotz archive
comma ai Let’s go buy a car
george hotz archive
comma ai Ok I take back all the bad things I said about Ford
george hotz archive
comma ai comma smays are in stock!
george hotz archive
DeepCamp AI