George Hotz | Programming | can tinygrad run the openpilot model FAST? | github.com/geohot/tinygrad

Name: George Hotz | Programming | can tinygrad run the openpilot model FAST? | github.com/geohot/tinygrad
Uploaded: 2022-06-19T15:45:43Z
Channel: george hotz archive
Description: Date of stream 18 Jun 2022. Live-stream chat added as Subtitles/CC - English (Twitch Chat). Stream title: can tinygrad run the openpilot model FAST? Sou...

george hotz archive · Beginner ·3y ago

Date of stream 18 Jun 2022. Live-stream chat added as Subtitles/CC - English (Twitch Chat). Stream title: can tinygrad run the openpilot model FAST? Source files: - https://github.com/geohot/tinygrad/tree/lazy Follow for notifications: - https://twitch.tv/georgehotz Support George: - https://twitch.tv/subs/georgehotz Programming playlist: - https://www.youtube.com/playlist?list=PLzFUMGbVxlQs5s-LNAyKgcq5SL28ZLLKC Chapters: 00:00:00 intro Charron vs. Pat Stay - Battle Rap 00:01:00 reading youtube comments 00:02:13 convolution 00:04:10 new place, openpilot model, ops, data flow 00:05:18 shapetr…

Watch on YouTube ↗ (saves to browser)

Chapters (36)

intro Charron vs. Pat Stay - Battle Rap

1:00 reading youtube comments

2:13 convolution

4:10 new place, openpilot model, ops, data flow

5:18 shapetracker

6:33 ops_lazy, explaining the graph, nodes

8:30 idea, power of tinygrad, reducing the nodes

11:20 SHUFFLE_MOVMENT_OPS

12:10 REMOVE_MOVMENT_NOPS

12:55 MERGE_ELEMENTWISE_INTO_CONV_OUTPUT

15:20 plan for today

16:30 python typing using class type inside class

17:50 real op

21:00 thinking, writing the right thing

25:25 love types, python the best language

26:05 LazyBuffer object has no attribute arg

26:30 NoneType object has no attribute name

28:00 long variable names, bad behavior editor

28:45 why is that wrong, we got that all right on the first try

31:15 running in 799.61 ms, what is slow

33:25 moving self realize out of toCPU

34:39 it should be a lot faster, running in 464 ms

35:30 optimization back on and see what breaks, bad investment gbtc

36:28 MERGE_MOVMENT_OPS breaking

43:40 lazy branch of tinygrad

44:20 SHUFFLE_MOVMENT_OPS slow, REMOVE_MOVMENT_NOPS wrong

46:20 can anyone fix this bug

46:40 mind thinking in currently working projects

47:40 optimization without changing the graph

52:00 if you have a binary op, can't have larger text

56:35 this isn't acually right

1:01:30 python double slash, respect shapetracker slower

1:02:00 fixing bugs

1:09:00 379 ms with shapetracked kernels

1:10:00 unary op shapetracked

1:17:20 tricky, the big gray combiner hard to write code, graph breaking, go

Playlist

Uploads from george hotz archive · george hotz archive · 0 of 60

← Previous Next →