OpenAI Needs YOU!!
Skills:
LLM Foundations80%
Key Takeaways
OpenAI is seeking feedback on their new open-weights LLM model and Sam Witteveen is encouraging viewers to provide input on what they want to see in the model, including the type of model, its capabilities, and its potential uses.
Full Transcript
okay so a few weeks ago samman basically put up a tweet asking people if open AI was to do a open- source project would it be more useful for it to be an 03 mini kind of model or a phone siiz model and you can see the votes that came out of this were pretty split with 03 mini basically winning out slightly now you can certainly see when you look at the comments here people especially companies have a very vested interest in here so you've got Aaron Levy who's the founder and CEO of box basically saying that don't trust the votes people don't know what they're talking about that people don't want local models that they want really big models that people want basically the best open-source model possible and you could imagine that his company probably has not a huge amount of problem running a 70b model or even a 400b model but looking at some of the other replies to this people seem to be landing the way that I would why don't you do both Jimmy apples obviously is someone on Twitter who's released a bunch of leaks about open Ai and then we've got other people that are well known on Twitter also chiming in to ask for both now this leads us up to earlier to today and this is what this video is all about is that I know that many of you want to basically use open models and perhaps run them on your computer or run them somewhere locally where you don't have to put your data into the cloud you don't have to share things you can basically make the model uncensored do all these kinds of things and I feel like now here's the chance to actually let open AI know this so Sam opin tweeted out that we're excited to release a powerful new open weight model with reasoning in the coming months and we want to talk to devs about how to make it maximally useful so after that we basically get them acknowledging that they haven't released an open weight llm since gpt2 now I know for most of you watching the video you probably don't even remember gpt2 gpt2 was way back in February 2019 and even then open aai basically declared that the model was so dangerous at 1.5 billion parameters for the biggest one that they were going to do a structured release so they released the smallest version which I think was a few hundred million parameters basically working up to something like a 700 million parameter 1 long before they released the full 1.5 billion parameter 1 and actually they were kind of forced into that because Richard soer and his team at Salesforce at the time released a really cool model called control which was probably deliberately 1.6 billion parameters just to show that okay maybe these models weren't as dangerous as open AI had tried to make out and in hindsight it certainly looks back at that time where they were clearly wrong and perhaps it was a marketing move and a move to help them raise funds as much as it was anything about any real danger so fast forward to today they're basically saying that okay they're going to release this model they've still got some decisions to make and they want to hold these developer events so while I'm somewhat suspicious about this and I really wonder okay and how is this actually going to go down how much are they going to listen to people when people say they want the best model at a certain size or something like that I do think that now is the opportunity for us as a community to be really vocal and talk about okay if open AI is saying they're going to do this and that they're really genuine about doing this let's let them know about what we want in the model for me personally I think the kind of model that I would love to see them do is an omni model last week I did a video about the quen 2.5 Omni model in there and that thing is fantastic that can basically do both text in and out audio in and out and then video in for processing either as text out or audio out that would be something that would be truly impressive for open AI to release now my guess is that they're probably not going to do that because they're probably going to decide that's too close to what they've already got with perhaps the 40 models or something like that but I really think that now is the time for us to basically put the pressure on them Tweet back of exactly what it is that we want go along to these sessions and if you want to sign up for the sessions you can basically come to their website sign up let them know what it is is that you want what models you've used in the past what are your areas of expertise Etc and I would say even if you know that they're not going to come to your hometown it's still worth putting in there about what it is that you want for example if you also like me want an omn model let's try and push them to do that like I said I think there's a small chance of that but I do think this is going to be a huge deal as to whether they listen to the community and actually give the community what they want and then they're going to come out looking really good or they just go off and make something that's like a dumb down reasoning model that perhaps is not that much better than anything that we've already got out there and then there's going to be a backlash so really is up to open AI now to either sort of put up or shut up in regards to open source it's very interesting that you we see with their new voice ASR stuff that it's seeming to be a lot better than the whisper models that released and yet it seems that they're clearly not going to make that stuff open source anytime soon so the other thing that you can always do is actually tweet at the people involved here you've got Kevin the product manager from openai you've got Greg Brockman one of the co-founders of open AI let them know what it is that you want to see in this open llm and I would say don't be afraid to specify that we would like a base model we would like something that's fine-tuned perhaps to do reasoning something that can clearly do function calling and some of the other bells and whistles that are out there because I'm very confident if the community response isn't overwhelming then they're probably not going to go ahead by making the best model that is out there Etc so looking at Sam multan's most recent post he's saying that they will not do anything silly like saying that you can't use the model if you have more than 700 million active users personally I couldn't care less about that clearly that's a jab at are basically trying to stop Tik Tok from using their models trying to stop Google from using their models there are not many companies in the world that have over 700 million active users and I would much prefer that they put out the best model that they could make and then limit it to who can actually use it that only startups or companies below 100 million users can actually use it then basically put out something that everyone can use but it's clearly not the best thing that they could have done anyway I've put the links for you to do the feedback in the description I do think this is something worth all of our time to basically let open AI know what it actually is that we would like to see from an open model or even a family of open models I would not be surprised if they go on to release multiple open models with perhaps a mobile version and a reasonably small version anyway as I said all the links are in the description please let me know what you think in the comments Etc and I will talk to you in the the next video bye for now
Original Description
In this video, I go through how OpenAI is looking for feedback on their new open-weights LLM model.
Feedback wanted : https://openai.com/open-model-feedback/
For more tutorials on using LLMs and building agents, check out my Patreon
Patreon: https://www.patreon.com/SamWitteveen
Twitter: https://x.com/Sam_Witteveen
🕵️ Interested in building LLM Agents? Fill out the form below
Building LLM Agents Form: https://drp.li/dIMes
👨💻Github:
https://github.com/samwit/llm-tutorials
⏱️Time Stamps:
00:00 Intro
01:10 Sam Altman's Recent X Post
01:56 GPT-2 Release
02:54 CTRL
03:43 Qwen-2.5 Omni
04:24 OpenAI Feedback Form
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
Playlist
Uploads from Sam Witteveen · Sam Witteveen · 0 of 60
← Previous
Next →
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
LangChain Basics Tutorial #1 - LLMs & PromptTemplates with Colab
Sam Witteveen
LangChain Basics Tutorial #2 Tools and Chains
Sam Witteveen
ChatGPT API Announcement & Code Walkthrough with LangChain
Sam Witteveen
Trying Out Flan 20B with UL2 - Working in Colab with 8Bit Inference
Sam Witteveen
LangChain - Conversations with Memory (explanation & code walkthrough)
Sam Witteveen
LangChain Chat with Flan20B
Sam Witteveen
LangChain - Using Hugging Face Models locally (code walkthrough)
Sam Witteveen
PAL : Program-aided Language Models with LangChain code
Sam Witteveen
Building a Summarization System with LangChain and GPT-3 - Part 1
Sam Witteveen
Building a Summarization System with LangChain and GPT-3 - Part 2
Sam Witteveen
Microsoft's Visual ChatGPT using LangChain
Sam Witteveen
Building a Summarization System with LangChain - Part 3 Using ChatGPT Turbo
Sam Witteveen
LangChain Agents - Joining Tools and Chains with Decisions
Sam Witteveen
Investigating Alpaca 7B - Finetuned LLaMa LLM
Sam Witteveen
Comparing LLMs with LangChain
Sam Witteveen
Running Alpaca7B in Colab
Sam Witteveen
How to finetune your own Alpaca 7B
Sam Witteveen
How to make a custom dataset like Alpaca7B
Sam Witteveen
Understanding Constitutional AI - the paper and key concepts
Sam Witteveen
Using Constitutional AI in LangChain
Sam Witteveen
Talking to Alpaca with LangChain - Creating an Alpaca Chatbot
Sam Witteveen
Text-to-video-synthesis with Diffusers and Colab
Sam Witteveen
Meet Dolly the new Alpaca model
Sam Witteveen
Checking out the Cerebras-GPT family of models
Sam Witteveen
A Step-by-Step Guide to Fine-Tuning Your Dolly Model (tutorial)
Sam Witteveen
Is GPT4All your new personal ChatGPT?
Sam Witteveen
Raven - RWKV-7B RNN's LLM Strikes Back
Sam Witteveen
Talk to your CSV & Excel with LangChain
Sam Witteveen
Vicuna - 90% of ChatGPT quality by using a new dataset?
Sam Witteveen
Koala Revealed: The ChatGPT Alternative You Need to Know! 🔍
Sam Witteveen
Running Koala for free in Colab. Your own personal ChatGPT? (tutorial)
Sam Witteveen
BabyAGI: Discover the Power of Task-Driven Autonomous Agents!
Sam Witteveen
Auto-GPT - How to Automate a Task Based AI with GPT-4
Sam Witteveen
Improve your BabyAGI with LangChain
Sam Witteveen
Generative Agents - Deep Dive and GPT-4 Recreation
Sam Witteveen
GPT4ALLv2: The Improvements and Drawbacks You Need to Know!
Sam Witteveen
Dolly 2.0 by Databricks: Open for Business but is it Ready to Impress!
Sam Witteveen
Red Pajama - Operation: Freeing LLaMA
Sam Witteveen
Investigating Open Assistant - Models, Datasets and Addons
Sam Witteveen
Investigating MiniGPT-4 - The Secret behind GPT-V?
Sam Witteveen
Stable LM 3B - The new tiny kid on the block.
Sam Witteveen
Bard can now code and put that code in Colab for you.
Sam Witteveen
Checking out Bark: a Text to Speech system by Suno AI
Sam Witteveen
Fine-tuning LLMs with PEFT and LoRA
Sam Witteveen
Master PDF Chat with LangChain - Your essential guide to queries on documents
Sam Witteveen
Using LangChain with DuckDuckGO Wikipedia & PythonREPL Tools
Sam Witteveen
Building Custom Tools and Agents with LangChain (gpt-3.5-turbo)
Sam Witteveen
StableVicuna: The New King of Open ChatGPTs?
Sam Witteveen
WizardLM: Evolving Instruction Datasets to Create a Better Model
Sam Witteveen
LaMini-LM - Mini Models Maxi Data!
Sam Witteveen
Finding the Best Free ChatGPT
Sam Witteveen
MPT-7B - The First Commercially Usable Fully Trained LLaMA Style Model
Sam Witteveen
LangChain Retrieval QA Over Multiple Files with ChromaDB
Sam Witteveen
LangChain Retrieval QA with Instructor Embeddings & ChromaDB for PDFs
Sam Witteveen
LangChain + Retrieval Local LLMs for Retrieval QA - No OpenAI!!!
Sam Witteveen
Transformers Agent - Is this Hugging Face's LangChain Competitor?
Sam Witteveen
StarCoder - The LLM to make you a coding star?
Sam Witteveen
Testing Starcoder for Reasoning with PAL
Sam Witteveen
The New Wizards - Unfiltered & Unaligned
Sam Witteveen
Camel + LangChain for Synthetic Data & Market Research
Sam Witteveen
More on: LLM Foundations
View skill →Related Reads
📰
📰
📰
📰
Building an AI Study Buddy with Persistent Memory Using Cognee
Medium · LLM
GPU Survivors: Can You Survive a 1T Parameter Inference Run?
Dev.to AI
Plan-and-Solve: make the model plan the steps before it computes any of them
Dev.to AI
Fine-Tuning Vision-Language Models for Production Invoice Extraction
Medium · Machine Learning
Chapters (6)
Intro
1:10
Sam Altman's Recent X Post
1:56
GPT-2 Release
2:54
CTRL
3:43
Qwen-2.5 Omni
4:24
OpenAI Feedback Form
🎓
Tutor Explanation
DeepCamp AI