How PMs use the Codex app
Key Takeaways
The video demonstrates how a Product Manager uses the Codex app to make a small product change, diagnose a Buildkite failure, and improve the skills for future use, utilizing skills such as Buildkite logs and token installation.
Full Transcript
As PM on the team, I don't code that often. So, I like rarely understand the code that's being edited like and the code around the code that's being edited. So, I kind of want to read up on that before I look stupid in front of the team. I actually want to be kind of careful like when you decide to tag any engineer or even when you want to file a ticket. In this case, I saw, you know, there was this button and it was kind of confusing as to what it did. So, my gut my immediate thing is to say, okay, what does this button even do? I'm just asking a question. So, then I pinged the team and I was like, hey, this this is a strange behavior to me. I just confirmed that we don't need this button. You know, I don't want to go around deleting people's buttons for no reason. So, like, ah, we don't need it. Okay, great. So, I told it to delete it. Um, and actually, I got distracted and I was working on some other stuff. Um, saw the change. We went back and forth. So, I created PR and I saw that my PR got approved, but there was a test failure. M you know I have become so lazy like the moment I'm like oh I got to go into like build kite and like look at the test logs you know it's like ah you know but uh the app has all these great skills and so I could just click into the skills tab and I just be like build kite okay sick someone is like already figured this out for me so I'd be like okay let's go back to this thing and just be like build kite fetch logs why failing and and it told me okay you need to install the build kite tokens so I did that so I was like okay I I ran the command to get the token now fix my PR. So what I immediately did is I went to our main the top level folder in the repo which is where all the skills are and I just asked it to fix this problem. I had to ask you how to set the build token. I I don't want you to have to do that next time. So you know read the roll out reflect on what might fix it and like update the skill. I probably could have just said update the skill, but I feel like kind of helping it like know how to think through it results in higher quality, especially because I'm often using codecs on low, which I think is like an under underrated technique. Um, and so basically, uh, we, you know, we went had a bit of a back and forth, but ultimately made an update to the thing that is in a PR somewhere. Just to summarize, like we went through this inductive journey where I was looking at user feedback and I saw a thing, I asked a question, realized this probably needed to be changed. Yeah. >> Uh so then I like made the change in and then in making the change I had a PR failure. So so I used a skill to fix the PR failure but in the mean then improved two skills kind of as I went. And so over time Codex just gets like better and better in working on a codebase which is pretty fun.
Original Description
Alexander Embiricos (a Product Manager on the Codex team) shows how he uses Codex skills to make a small product change, diagnose a Buildkite failure, and improve the skills so the next PR goes faster.
Takeaways:
- Skills are a shortcut for repeated workflows like Buildkite logs.
- When a skill fails, fix the root cause and update the skill.
- The real win is compounding: the codebase gets easier over time.
This is the loop: ship the fix, then teach the workflow.
Chapters:
00:00 PM context: careful before tagging engineers
00:16 A confusing button and a quick team check
00:32 Delete the button, then hit a PR failure
00:46 Use the Buildkite skill instead of digging through logs
01:09 Install the Buildkite token
01:20 Update the skill so it works next time
01:53 Inductive loop: feedback - fix - improve the skill
02:06 Compounding payoff: Codex gets better over time
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
Playlist
Uploads from OpenAI · OpenAI · 0 of 60
← Previous
Next →
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
Robots that Learn
OpenAI
Emergence of Grounded Compositional Language in Multi-Agent Populations
OpenAI
OpenAI + Dota 2
OpenAI
Dendi vs. OpenAI at The International 2017
OpenAI
Competitive Self-Play
OpenAI
Learning a Hierarchy
OpenAI
Physical Spam Detection
OpenAI
Ingredients for Robotics Research
OpenAI
OpenAI Five
OpenAI
OpenAI Five: Dota Gameplay
OpenAI
Learning Dexterity
OpenAI
Learning Dexterity: Uncut
OpenAI
OpenAI Five Benchmark: Post-Game Analysis
OpenAI
Investigating Model Based RL for Continuous Control | Alex Botev | 2018 Summer Intern Open House
OpenAI
Generative Modelling | Sadhika Malladi | 2018 Summer Intern Open House
OpenAI
A pathway to more efficient generative models | Will Grathwohl | 2018 Summer Intern Open House
OpenAI
Learning Dexterity | Alex Ray | 2018 Summer Intern Open House
OpenAI
Robust Vision-Based State Estimation | Hsiao-Yu 'Fish' Tung | 2018 Summer Intern Open House
OpenAI
Using Semantic Trees In Place of Sentences | Munashe Shumba | OpenAI Scholars Demo Day 2018
OpenAI
Reinforcement Learning with Prediction-Based Rewards
OpenAI
OpenAI Spinning Up in Deep RL Workshop
OpenAI
Arena Announcement and Closing | OpenAI Five Finals (6/6)
OpenAI
Co-Op Match | OpenAI Five Finals (5/6)
OpenAI
OpenAI Five vs. OG, Game 2 | OpenAI Five Finals (4/6)
OpenAI
OpenAI Five vs. OG, Game 1 | OpenAI Five Finals (3/6)
OpenAI
Pre-Match Panel Discussion | OpenAI Five Finals (2/6)
OpenAI
Opening Keynote | OpenAI Five Finals (1/6)
OpenAI
OpenAI Robotics Symposium 2019
OpenAI
OpenAI Scholars Demo Day 2019
OpenAI
Multi-Agent Hide and Seek
OpenAI
Solving Rubik’s Cube with a Robot Hand: Uncut
OpenAI
Solving Rubik’s Cube with a Robot Hand: Perturbations
OpenAI
Solving Rubik’s Cube with a Robot Hand
OpenAI
Music Generation | Christine Payne | OpenAI Scholars Demo Day 2018
OpenAI
Deephypebot | Nadja Rhodes | OpenAI Scholars Demo Day 2018
OpenAI
Physics Net | Ifu Aniemeka | OpenAI Scholars Demo Day 2018
OpenAI
Art Composition Attributes + CycleGAN | Holly Grimm | OpenAI Scholars Demo Day 2018
OpenAI
Generating Emotional Landscapes | Hannah Davis | OpenAI Scholars Demo Day 2018
OpenAI
Looking For Grammar In All The Right Places | Alethea Power | OpenAI Scholars Demo Day 2020
OpenAI
Semantic Parsing English to GraphQL | Andre Carerra | OpenAI Scholars Demo Day 2020
OpenAI
Long term credit assignment with temporal reward transp… | Cathy Yeh | OpenAI Scholars Demo Day 2020
OpenAI
Social learning in independent multi-agent reinfor… | Kamal N’dousse | OpenAI Scholars Demo Day 2020
OpenAI
Quantifying Interpretability of Models Trained on Coi… | Jorge Orbay | OpenAI Scholars Demo Day 2020
OpenAI
Towards Epileptic Seizure Prediction with Deep Network | Kata Slama | OpenAI Scholars Demo Day 2020
OpenAI
Universal Adversarial Perturbations and Language M… | Pamela Mishkin | OpenAI Scholars Demo Day 2020
OpenAI
Introductions by Sam Altman & Greg Brockman | OpenAI Scholars Demo Day 2020
OpenAI
Introduction by Sam Altman | OpenAI Scholars Demo Day 2021
OpenAI
Breaking Contrastive Models with the SET Card Game | Legg Yeung | OpenAI Scholars Demo Day 2021
OpenAI
Large Scale Reward Modeling | Jonathan Ward | OpenAI Scholars Demo Day 2021
OpenAI
Words to Bytes: Exploring Language Tokenizations | Sam Gbafa | OpenAI Scholars Demo Day 2021
OpenAI
Learning Multiple Modes of Behavior in a Continuous… | Tyna Eloundou | OpenAI Scholars Demo Day 2021
OpenAI
Scaling Laws for Language Transfer Learning | Christina Kim | OpenAI Scholars Demo Day 2021
OpenAI
Contrastive Language Encoding | Ellie Kitanidis | OpenAI Scholars Demo Day 2021
OpenAI
Characterizing Test Time Compute on Graph Structur… | Kudzo Ahegbebu | OpenAI Scholars Demo Day 2021
OpenAI
Studying Scaling Laws for Transformer Architecture … | Shola Oyedele | OpenAI Scholars Demo Day 2021
OpenAI
Feedback Loops in Opinion Modeling | Danielle Ensign | OpenAI Scholars Demo Day 2021
OpenAI
Creating a Space Game with OpenAI Codex
OpenAI
“Hello World” with OpenAI Codex
OpenAI
Talking to Your Computer with OpenAI Codex
OpenAI
Data Science with OpenAI Codex
OpenAI
More on: LLM Foundations
View skill →Related Reads
📰
📰
📰
📰
Building Production-Grade LLM Evaluation Pipelines: From Vibes to Metrics
Dev.to AI
Demystifying LLM Tokenizers: Building a Client-Side Token and API Cost Calculator
Dev.to AI
When the Google Recap and the Juejin Picking Roundup Disagree on What Counts as AI
Dev.to AI
Build, Observe, Fix: A LangChain Agent Walkthrough
Medium · Python
Chapters (8)
PM context: careful before tagging engineers
0:16
A confusing button and a quick team check
0:32
Delete the button, then hit a PR failure
0:46
Use the Buildkite skill instead of digging through logs
1:09
Install the Buildkite token
1:20
Update the skill so it works next time
1:53
Inductive loop: feedback - fix - improve the skill
2:06
Compounding payoff: Codex gets better over time
🎓
Tutor Explanation
DeepCamp AI