George Hotz | Programming | tinygrad: LLVM backend | github.com/geohot/tinygrad/tree/llvm | llvmlite

Name: George Hotz | Programming | tinygrad: LLVM backend | github.com/geohot/tinygrad/tree/llvm | llvmlite
Uploaded: 2022-10-16T10:31:54Z
Channel: george hotz archive
Description: Date of stream 15 Oct 2022. Live-stream chat added as Subtitles/CC - English (Twitch Chat). Stream title: tinygrad: LLVM backend Source files: - https:/...

george hotz archive · Beginner ·📰 AI News & Updates ·3y ago

Date of stream 15 Oct 2022. Live-stream chat added as Subtitles/CC - English (Twitch Chat). Stream title: tinygrad: LLVM backend Source files: - https://github.com/geohot/tinygrad/tree/llvm - https://github.com/numba/llvmlite Follow for notifications: - https://twitch.tv/georgehotz Support George: - https://twitch.tv/subs/georgehotz Programming playlist: - https://www.youtube.com/playlist?list=PLzFUMGbVxlQs5s-LNAyKgcq5SL28ZLLKC Chapters: 00:00:00 intro 00:01:00 LLVM=1, no ShapeTracker yet, ethernet wire 00:02:30 defcon sux 00:03:28 llvmlite, event's to replace defcon, Chaos Computer Club (CC…

Watch on YouTube ↗ (saves to browser)

Chapters (37)

intro

1:00 LLVM=1, no ShapeTracker yet, ethernet wire

2:30 defcon sux

3:28 llvmlite, event's to replace defcon, Chaos Computer Club (CCC)

4:05 code for implementing llvm backend, LLVM buffer, processing_op

5:15 tinygrad low level operations

7:14 add and sub could be the same op, could merge some

8:15 4 core ops of tinygrad, matrix multiply, matmul, derivative of convolution

9:36 why isn't tinygrad fast? memory access patterns

10:10 ShapeTracker, segfault

11:25 writing test_add_forward

12:00 LLVM, memory, single thread system

12:25 why it's not working, null pointer

14:00 object has no attribute address

18:26 segfault, cfunctype m1 ctypes

22:18 checking llvmlite version

23:13 cfunctiontype calling

25:20 as_array requires a shape argument

25:38 stupid argtypes

27:45 doing an ADD, a MUL and an NOOP

28:40 the first argument is the return type

29:30 nejintejag get's VIP

30:17 MUL should be OK, this NOOP doesn't work

31:20 shapetracked objects, shape, stride, offset

31:56 test_mul fails, strides 0's

32:08 what to implement today, memory might not be contiguous

32:53 break, more coffee

34:40 ShapeTracker object has not attribute shape_strides

35:08 question about Shape tracker

35:40 working on idx

37:40 rewriting expr, expr junk code

38:14 idx_to_llvm, idx_deref

41:58 don't use print statements for debugging

45:24 llvmlite fadd fmul, fneg

46:55 easy implement sub op

48:19 RELU not implemented

48:30 segfault

Playlist

Uploads from george hotz archive · george hotz archive · 0 of 60

← Previous Next →

George Hotz | Programming | tinygrad: LLVM backend | github.com/geohot/tinygrad/tree/llvm | llvmlite

Chapters (37)

Playlist

Lesson complete!