George Hotz | Programming | Decision Transformer Reinforcement Learning (RL) | LunarLander | Part 1

Date of the stream 6 Jan 2024. from $1250 buy https://comma.ai/shop/comma-3x & best ADAS system in the world https://openpilot.comma.ai Original stream title: - tinygrad: rewriting the scheduler Sources: - https://arxiv.org/pdf/2106.01345.pdf - https://huggingface.co/blog/decision-transformers -https://medium.com/@jscriptcoder/demystifying-upside-down-reinforcement-learning-a-k-a-ꓤ-b7bd4214b33f - https://youtu.be/xc0jGZYFQLQ tinygrad bounties: - https://docs.google.com/spreadsheets/d/1WKHbT-7KOgjEawq5h5Ic1qUWzpfAzuD_J06N1JwOCGs/ Follow for notifications: - https://twitch.tv/georgehotz Support George: - https://twitch.tv/subs/georgehotz Pre-order tinybox: - https://buy.stripe.com/5kAaGL6lk9uX9nW144 (https://tinygrad.org/) Chapters: 00:00:00 lunarlander_transformer.py 00:04:25 twitch substance warning 00:06:00 perplexity decision transformer 00:12:00 assert not x.requires_grad 00:15:00 192 % start_pos 00:21:45 food 00:24:25 fixes needed in tinygrad 00:41:00 gpt2 works 00:46:40 contraction not explained 00:55:00 rant 01:00:25 Ron Paul 01:04:40 usa population pyramid 01:05:30 jit 01:08:55 africa documentaries 01:13:15 cross 01:19:00 not supported 768 % 01:23:20 do things team 01:24:50 tinygrad intern phone call 01:28:50 postmodernism 01:36:40 assert t.grad is not None 01:38:30 advice, schedule 01:43:20 decision transformer paper 01:53:00 not balancing 02:05:00 K=20 02:10:00 plt.show() 02:15:30 clip 50 02:19:00 lunarlander fails 02:20:00 uber eats scam 02:27:00 decision transformers on Hugging Fac 02:31:30 logits 02:45:00 temperature 02:54:00 should never output 2 03:11:40 so many bugs 03:12:40 good idea from chat 03:15:00 lunarlander is not landing 03:16:30 128 clip 03:17:00 highest_reward bug 03:18:50 lunar lander rewards 03:24:30 let's make it work 03:29:00 unknown change 03:31:40 piano 03:34:20 reinforcement learning is impossible 03:37:25 write gym environment 03:50:00 stupid decision transformer 03:57:20 98% 03:58:50 that is what we get for smoking weed 04:02:10