George Hotz | Programming | tinygrad: writing tutorials for noobs | the tiny corp raised $5.1M

Name: George Hotz | Programming | tinygrad: writing tutorials for noobs | the tiny corp raised $5.1M
Uploaded: 2023-05-27T23:52:20Z
Channel: george hotz archive
Description: Date of stream 27 May 2023. from $1499 buy https://comma.ai/shop/comma-three Live-stream chat added as Subtitles/CC - English (Twitch Chat) - three-dot ...

george hotz archive · Beginner ·🧠 Large Language Models ·2y ago

Date of stream 27 May 2023. from $1499 buy https://comma.ai/shop/comma-three Live-stream chat added as Subtitles/CC - English (Twitch Chat) - three-dot menu icon - Show transcript Source files: - https://github.com/geohot/tinygrad Follow for notifications: - https://twitch.tv/georgehotz Support George: - https://twitch.tv/subs/georgehotz Chapters: 00:00:00 intro 00:00:45 tiny corp raised money, tinybox 00:01:40 goals, developer experience 00:02:15 tiny corp programming challenge 00:03:00 don't waste George's time 00:04:15 tinybox almost 100 preorders 00:04:45 $100 preorder, $15,000 total pri…

Watch on YouTube ↗ (saves to browser)

Chapters (40)

intro

0:45 tiny corp raised money, tinybox

1:40 goals, developer experience

2:15 tiny corp programming challenge

3:00 don't waste George's time

4:15 tinybox almost 100 preorders

4:45 $100 preorder, $15,000 total price

5:25 tutorial.ipynb

8:40 set_debug does not work, python import global variable

16:30 lazy by default, should not lazy forever, enqueue

17:00 debug problem, global variable python

17:45 class debug, magic methods

26:05 inherit from int python

28:50 1000 lines guideline

29:15 class debug

31:30 new debug behavior, clean clode

34:00 logging modules

34:15 contiguous

35:15 matrices, Tensor.eye

36:45 llama.py, debug on llama.py

38:15 quantization support, contribute

38:42 Conv2d, stable diffusion

39:25 $10000 bounty for sd on M1 faster

40:35 a cat in a hat

40:47 bounty taxes

41:00 stable_diffusion.py and llama.py code

41:20 unit tests, ONNX tests

41:54 TORCH=1, external_text_onnx_backend.py, pytest

42:40 great way to good started

43:20 complexity, self driving people dumb

43:46 revenue company, waymo and cruise, growth, investment, referral

47:25 smart pytorch people, not managing complexity

48:45 implement every op, conv_transpose2d

49:50 conv, reshape, sum

50:10 competing against smart people, developer experience

50:50 jit.py, $500 bounty LLaMA python code without jit under 100ms

51:50 triton tutorials, conv2d example

56:55 mojo, einops-style API, $200 bounty Zero dim Tensor support

57:25 zero dimension tensors

57:50 haters on HN, uncountable infinities, cardinality

Playlist

Uploads from george hotz archive · george hotz archive · 0 of 60

← Previous Next →

George Hotz | Programming | tinygrad: writing tutorials for noobs | the tiny corp raised $5.1M

Chapters (40)

Playlist

Lesson complete!