OpenAI Needs YOU!!

Sam Witteveen · Beginner ·🧠 Large Language Models ·1y ago

Key Takeaways

OpenAI is seeking feedback on their new open-weights LLM model and Sam Witteveen is encouraging viewers to provide input on what they want to see in the model, including the type of model, its capabilities, and its potential uses.

Full Transcript

okay so a few weeks ago samman basically put up a tweet asking people if open AI was to do a open- source project would it be more useful for it to be an 03 mini kind of model or a phone siiz model and you can see the votes that came out of this were pretty split with 03 mini basically winning out slightly now you can certainly see when you look at the comments here people especially companies have a very vested interest in here so you've got Aaron Levy who's the founder and CEO of box basically saying that don't trust the votes people don't know what they're talking about that people don't want local models that they want really big models that people want basically the best open-source model possible and you could imagine that his company probably has not a huge amount of problem running a 70b model or even a 400b model but looking at some of the other replies to this people seem to be landing the way that I would why don't you do both Jimmy apples obviously is someone on Twitter who's released a bunch of leaks about open Ai and then we've got other people that are well known on Twitter also chiming in to ask for both now this leads us up to earlier to today and this is what this video is all about is that I know that many of you want to basically use open models and perhaps run them on your computer or run them somewhere locally where you don't have to put your data into the cloud you don't have to share things you can basically make the model uncensored do all these kinds of things and I feel like now here's the chance to actually let open AI know this so Sam opin tweeted out that we're excited to release a powerful new open weight model with reasoning in the coming months and we want to talk to devs about how to make it maximally useful so after that we basically get them acknowledging that they haven't released an open weight llm since gpt2 now I know for most of you watching the video you probably don't even remember gpt2 gpt2 was way back in February 2019 and even then open aai basically declared that the model was so dangerous at 1.5 billion parameters for the biggest one that they were going to do a structured release so they released the smallest version which I think was a few hundred million parameters basically working up to something like a 700 million parameter 1 long before they released the full 1.5 billion parameter 1 and actually they were kind of forced into that because Richard soer and his team at Salesforce at the time released a really cool model called control which was probably deliberately 1.6 billion parameters just to show that okay maybe these models weren't as dangerous as open AI had tried to make out and in hindsight it certainly looks back at that time where they were clearly wrong and perhaps it was a marketing move and a move to help them raise funds as much as it was anything about any real danger so fast forward to today they're basically saying that okay they're going to release this model they've still got some decisions to make and they want to hold these developer events so while I'm somewhat suspicious about this and I really wonder okay and how is this actually going to go down how much are they going to listen to people when people say they want the best model at a certain size or something like that I do think that now is the opportunity for us as a community to be really vocal and talk about okay if open AI is saying they're going to do this and that they're really genuine about doing this let's let them know about what we want in the model for me personally I think the kind of model that I would love to see them do is an omni model last week I did a video about the quen 2.5 Omni model in there and that thing is fantastic that can basically do both text in and out audio in and out and then video in for processing either as text out or audio out that would be something that would be truly impressive for open AI to release now my guess is that they're probably not going to do that because they're probably going to decide that's too close to what they've already got with perhaps the 40 models or something like that but I really think that now is the time for us to basically put the pressure on them Tweet back of exactly what it is that we want go along to these sessions and if you want to sign up for the sessions you can basically come to their website sign up let them know what it is is that you want what models you've used in the past what are your areas of expertise Etc and I would say even if you know that they're not going to come to your hometown it's still worth putting in there about what it is that you want for example if you also like me want an omn model let's try and push them to do that like I said I think there's a small chance of that but I do think this is going to be a huge deal as to whether they listen to the community and actually give the community what they want and then they're going to come out looking really good or they just go off and make something that's like a dumb down reasoning model that perhaps is not that much better than anything that we've already got out there and then there's going to be a backlash so really is up to open AI now to either sort of put up or shut up in regards to open source it's very interesting that you we see with their new voice ASR stuff that it's seeming to be a lot better than the whisper models that released and yet it seems that they're clearly not going to make that stuff open source anytime soon so the other thing that you can always do is actually tweet at the people involved here you've got Kevin the product manager from openai you've got Greg Brockman one of the co-founders of open AI let them know what it is that you want to see in this open llm and I would say don't be afraid to specify that we would like a base model we would like something that's fine-tuned perhaps to do reasoning something that can clearly do function calling and some of the other bells and whistles that are out there because I'm very confident if the community response isn't overwhelming then they're probably not going to go ahead by making the best model that is out there Etc so looking at Sam multan's most recent post he's saying that they will not do anything silly like saying that you can't use the model if you have more than 700 million active users personally I couldn't care less about that clearly that's a jab at are basically trying to stop Tik Tok from using their models trying to stop Google from using their models there are not many companies in the world that have over 700 million active users and I would much prefer that they put out the best model that they could make and then limit it to who can actually use it that only startups or companies below 100 million users can actually use it then basically put out something that everyone can use but it's clearly not the best thing that they could have done anyway I've put the links for you to do the feedback in the description I do think this is something worth all of our time to basically let open AI know what it actually is that we would like to see from an open model or even a family of open models I would not be surprised if they go on to release multiple open models with perhaps a mobile version and a reasonably small version anyway as I said all the links are in the description please let me know what you think in the comments Etc and I will talk to you in the the next video bye for now

Original Description

In this video, I go through how OpenAI is looking for feedback on their new open-weights LLM model. Feedback wanted : https://openai.com/open-model-feedback/ For more tutorials on using LLMs and building agents, check out my Patreon Patreon: https://www.patreon.com/SamWitteveen Twitter: https://x.com/Sam_Witteveen 🕵️ Interested in building LLM Agents? Fill out the form below Building LLM Agents Form: https://drp.li/dIMes 👨‍💻Github: https://github.com/samwit/llm-tutorials ⏱️Time Stamps: 00:00 Intro 01:10 Sam Altman's Recent X Post 01:56 GPT-2 Release 02:54 CTRL 03:43 Qwen-2.5 Omni 04:24 OpenAI Feedback Form
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from Sam Witteveen · Sam Witteveen · 0 of 60

← Previous Next →
1 LangChain Basics Tutorial #1 - LLMs & PromptTemplates with Colab
LangChain Basics Tutorial #1 - LLMs & PromptTemplates with Colab
Sam Witteveen
2 LangChain Basics Tutorial #2 Tools and Chains
LangChain Basics Tutorial #2 Tools and Chains
Sam Witteveen
3 ChatGPT API Announcement & Code Walkthrough with LangChain
ChatGPT API Announcement & Code Walkthrough with LangChain
Sam Witteveen
4 Trying Out Flan 20B with UL2 - Working in Colab with 8Bit Inference
Trying Out Flan 20B with UL2 - Working in Colab with 8Bit Inference
Sam Witteveen
5 LangChain - Conversations with Memory (explanation & code walkthrough)
LangChain - Conversations with Memory (explanation & code walkthrough)
Sam Witteveen
6 LangChain Chat with Flan20B
LangChain Chat with Flan20B
Sam Witteveen
7 LangChain - Using Hugging Face Models locally (code walkthrough)
LangChain - Using Hugging Face Models locally (code walkthrough)
Sam Witteveen
8 PAL : Program-aided Language Models with LangChain code
PAL : Program-aided Language Models with LangChain code
Sam Witteveen
9 Building a Summarization System with LangChain and GPT-3 - Part 1
Building a Summarization System with LangChain and GPT-3 - Part 1
Sam Witteveen
10 Building a Summarization System with LangChain and GPT-3 - Part 2
Building a Summarization System with LangChain and GPT-3 - Part 2
Sam Witteveen
11 Microsoft's Visual ChatGPT using LangChain
Microsoft's Visual ChatGPT using LangChain
Sam Witteveen
12 Building a Summarization System with LangChain - Part 3 Using ChatGPT Turbo
Building a Summarization System with LangChain - Part 3 Using ChatGPT Turbo
Sam Witteveen
13 LangChain Agents - Joining Tools and Chains with Decisions
LangChain Agents - Joining Tools and Chains with Decisions
Sam Witteveen
14 Investigating Alpaca 7B - Finetuned LLaMa LLM
Investigating Alpaca 7B - Finetuned LLaMa LLM
Sam Witteveen
15 Comparing LLMs with LangChain
Comparing LLMs with LangChain
Sam Witteveen
16 Running Alpaca7B in Colab
Running Alpaca7B in Colab
Sam Witteveen
17 How to finetune your own Alpaca 7B
How to finetune your own Alpaca 7B
Sam Witteveen
18 How to make a custom dataset like Alpaca7B
How to make a custom dataset like Alpaca7B
Sam Witteveen
19 Understanding Constitutional AI - the paper and key concepts
Understanding Constitutional AI - the paper and key concepts
Sam Witteveen
20 Using Constitutional AI in LangChain
Using Constitutional AI in LangChain
Sam Witteveen
21 Talking to Alpaca with LangChain - Creating an Alpaca Chatbot
Talking to Alpaca with LangChain - Creating an Alpaca Chatbot
Sam Witteveen
22 Text-to-video-synthesis with Diffusers and Colab
Text-to-video-synthesis with Diffusers and Colab
Sam Witteveen
23 Meet Dolly the new Alpaca model
Meet Dolly the new Alpaca model
Sam Witteveen
24 Checking out the Cerebras-GPT family of models
Checking out the Cerebras-GPT family of models
Sam Witteveen
25 A Step-by-Step Guide to Fine-Tuning Your Dolly Model (tutorial)
A Step-by-Step Guide to Fine-Tuning Your Dolly Model (tutorial)
Sam Witteveen
26 Is GPT4All your new personal ChatGPT?
Is GPT4All your new personal ChatGPT?
Sam Witteveen
27 Raven - RWKV-7B RNN's LLM Strikes Back
Raven - RWKV-7B RNN's LLM Strikes Back
Sam Witteveen
28 Talk to your CSV & Excel with LangChain
Talk to your CSV & Excel with LangChain
Sam Witteveen
29 Vicuna - 90% of ChatGPT quality by using a new dataset?
Vicuna - 90% of ChatGPT quality by using a new dataset?
Sam Witteveen
30 Koala Revealed: The ChatGPT Alternative You Need to Know! 🔍
Koala Revealed: The ChatGPT Alternative You Need to Know! 🔍
Sam Witteveen
31 Running Koala for free in Colab. Your own personal ChatGPT? (tutorial)
Running Koala for free in Colab. Your own personal ChatGPT? (tutorial)
Sam Witteveen
32 BabyAGI: Discover the Power of Task-Driven Autonomous Agents!
BabyAGI: Discover the Power of Task-Driven Autonomous Agents!
Sam Witteveen
33 Auto-GPT - How to Automate a Task Based AI with GPT-4
Auto-GPT - How to Automate a Task Based AI with GPT-4
Sam Witteveen
34 Improve your BabyAGI with LangChain
Improve your BabyAGI with LangChain
Sam Witteveen
35 Generative Agents - Deep Dive and GPT-4 Recreation
Generative Agents - Deep Dive and GPT-4 Recreation
Sam Witteveen
36 GPT4ALLv2: The Improvements and Drawbacks You Need to Know!
GPT4ALLv2: The Improvements and Drawbacks You Need to Know!
Sam Witteveen
37 Dolly 2.0 by Databricks: Open for Business but is it  Ready to Impress!
Dolly 2.0 by Databricks: Open for Business but is it Ready to Impress!
Sam Witteveen
38 Red Pajama - Operation: Freeing LLaMA
Red Pajama - Operation: Freeing LLaMA
Sam Witteveen
39 Investigating Open Assistant - Models, Datasets and Addons
Investigating Open Assistant - Models, Datasets and Addons
Sam Witteveen
40 Investigating MiniGPT-4 - The Secret behind GPT-V?
Investigating MiniGPT-4 - The Secret behind GPT-V?
Sam Witteveen
41 Stable LM 3B - The new tiny kid on the block.
Stable LM 3B - The new tiny kid on the block.
Sam Witteveen
42 Bard can now code and put that code in Colab for you.
Bard can now code and put that code in Colab for you.
Sam Witteveen
43 Checking out Bark: a Text to Speech system by Suno AI
Checking out Bark: a Text to Speech system by Suno AI
Sam Witteveen
44 Fine-tuning LLMs with PEFT and LoRA
Fine-tuning LLMs with PEFT and LoRA
Sam Witteveen
45 Master PDF Chat with LangChain - Your essential guide to queries on documents
Master PDF Chat with LangChain - Your essential guide to queries on documents
Sam Witteveen
46 Using LangChain with DuckDuckGO Wikipedia & PythonREPL Tools
Using LangChain with DuckDuckGO Wikipedia & PythonREPL Tools
Sam Witteveen
47 Building Custom Tools and Agents with LangChain (gpt-3.5-turbo)
Building Custom Tools and Agents with LangChain (gpt-3.5-turbo)
Sam Witteveen
48 StableVicuna: The New King of Open ChatGPTs?
StableVicuna: The New King of Open ChatGPTs?
Sam Witteveen
49 WizardLM: Evolving Instruction Datasets to Create a Better Model
WizardLM: Evolving Instruction Datasets to Create a Better Model
Sam Witteveen
50 LaMini-LM - Mini Models Maxi Data!
LaMini-LM - Mini Models Maxi Data!
Sam Witteveen
51 Finding the Best Free ChatGPT
Finding the Best Free ChatGPT
Sam Witteveen
52 MPT-7B - The First Commercially Usable Fully Trained LLaMA Style Model
MPT-7B - The First Commercially Usable Fully Trained LLaMA Style Model
Sam Witteveen
53 LangChain Retrieval QA Over Multiple Files with ChromaDB
LangChain Retrieval QA Over Multiple Files with ChromaDB
Sam Witteveen
54 LangChain Retrieval QA with Instructor Embeddings & ChromaDB for PDFs
LangChain Retrieval QA with Instructor Embeddings & ChromaDB for PDFs
Sam Witteveen
55 LangChain + Retrieval Local LLMs for Retrieval QA - No OpenAI!!!
LangChain + Retrieval Local LLMs for Retrieval QA - No OpenAI!!!
Sam Witteveen
56 Transformers Agent - Is this Hugging Face's LangChain Competitor?
Transformers Agent - Is this Hugging Face's LangChain Competitor?
Sam Witteveen
57 StarCoder - The LLM to make you a coding star?
StarCoder - The LLM to make you a coding star?
Sam Witteveen
58 Testing Starcoder for Reasoning with PAL
Testing Starcoder for Reasoning with PAL
Sam Witteveen
59 The New Wizards - Unfiltered & Unaligned
The New Wizards - Unfiltered & Unaligned
Sam Witteveen
60 Camel + LangChain for Synthetic Data & Market Research
Camel + LangChain for Synthetic Data & Market Research
Sam Witteveen

OpenAI is seeking feedback on their new open-weights LLM model and viewers can provide input on what they want to see in the model by signing up for developer events or tweeting at OpenAI representatives. The model's capabilities, including text-in, text-out, audio-in, audio-out, and video-in, are discussed, as well as the potential for an omni model.

Key Takeaways
  1. Sign up for OpenAI's developer events
  2. Tweet at OpenAI representatives with feedback
  3. Specify desired model capabilities, such as reasoning and function calling
  4. Participate in discussions on LLM development and open-source models
💡 OpenAI is seeking community feedback on their new LLM model, providing an opportunity for viewers to shape the model's development and capabilities.

Related Reads

📰
Building an AI Study Buddy with Persistent Memory Using Cognee
Learn to build an AI study buddy with persistent memory using Cognee, enabling it to remember, recall, and improve knowledge over time.
Medium · LLM
📰
GPU Survivors: Can You Survive a 1T Parameter Inference Run?
Learn how GPUs handle massive language model inference runs and play an interactive game to understand LLMs under load
Dev.to AI
📰
Plan-and-Solve: make the model plan the steps before it computes any of them
Learn how to improve language models' performance on multi-step word problems using Plan-and-Solve prompting, which makes the model plan the steps before computing any of them.
Dev.to AI
📰
Fine-Tuning Vision-Language Models for Production Invoice Extraction
Learn to fine-tune vision-language models for production invoice extraction to automate processing of large volumes of invoices
Medium · Machine Learning

Chapters (6)

Intro
1:10 Sam Altman's Recent X Post
1:56 GPT-2 Release
2:54 CTRL
3:43 Qwen-2.5 Omni
4:24 OpenAI Feedback Form
Up next
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Dave Ebbelaar (LLM Eng)
Watch →