George Hotz | Programming | training imagenet with tinygrad! | $1499 buy comma.ai/shop/comma-three

Name: George Hotz | Programming | training imagenet with tinygrad! | $1499 buy comma.ai/shop/comma-three
Uploaded: 2023-01-31T16:57:17Z
Channel: george hotz archive
Description: Date of stream 30 Jan 2023. from $1499 buy https://comma.ai/shop/comma-three Live-stream chat added as Subtitles/CC - English (Twitch Chat) - three-dot ...

george hotz archive · Intermediate ·🧠 Large Language Models ·3y ago

Date of stream 30 Jan 2023. from $1499 buy https://comma.ai/shop/comma-three Live-stream chat added as Subtitles/CC - English (Twitch Chat) - three-dot menu icon - Show transcript Source files: - https://github.com/geohot/tinygrad - https://myrtle.ai/learn/how-to-train-your-resnet-8-bag-of-tricks/ Follow for notifications: - https://twitch.tv/georgehotz Support George: - https://twitch.tv/subs/georgehotz Programming playlist: - https://www.youtube.com/playlist?list=PLzFUMGbVxlQs5s-LNAyKgcq5SL28ZLLKC Chapters: 00:00:00 intro 00:02:00 n02018795 imagenet categories 00:05:30 staying on topic, ti…

Watch on YouTube ↗ (saves to browser)

Chapters (43)

intro

2:00 n02018795 imagenet categories

5:30 staying on topic, tinygrad discord

6:00 rap battle

7:25 benchmark_train_efficientnet.py

10:05 what net to use

11:00 how to contribute to tinygrad

12:55 state of the art for training imagenet

13:10 tinygrad discord, CLCACHE

14:00 pull requests

15:00 no nix, rust, llvmlite, cuda

16:30 what paper to implement

18:40 resnet paper

23:10 CIFAR-10

25:20 1080 ti

25:30 torchvision installing issue

26:30 nix does not solve this

27:55 xkcd standards

29:30 net ema

30:44 maxpool2d

36:30 19s runtime in pytorch

38:20 tinygrad discord strict rules

38:38 hackernews people, maslow's hierarchy of argument, conversation

39:10 life after degree, ideas, honest conversations

41:10 compassion will hold you back

42:55 elon's rules, rule 0 surface complexity, building hardware, vertical integration

43:55 no reason for this to be a class

51:40 pytorch unsqueeze

52:45 beautiful implementation

55:35 ResNet whitening

59:20 shorter, better than pytorch

1:01:25 dumbest question

1:03:25 fire tweet, ai safety, old people text

1:04:15 fate of the world, twitter saga, internet get things wrong

1:05:40 jai beta

1:07:00 creating an optimizer

1:09:00 broken hoodie

1:09:30 batchsize 512

1:10:40 642 vs 53 lines

1:13:50 make_pair and first attempt at hlb_cifar10

1:15:00 DEBUG=2

1:17:50 more readable code

1:19:00 TEST_AST=1, unable to allocate

Playlist

Uploads from george hotz archive · george hotz archive · 0 of 60

← Previous Next →

George Hotz | Programming | training imagenet with tinygrad! | $1499 buy comma.ai/shop/comma-three

Chapters (43)

Playlist

Lesson complete!