OpenAI GPT-4 Function Calling: *HUGE* Potential

Key Takeaways

so big news from openai today they've just announced that they're going to be allowing function calling within the Chad GPT system as well as similar API updates start coming this is kind of a big deal so let's take a look so here they're mentioning the new function calling ability and the chat completions API some updates to gbt4 and gpt4 3.5 turbo new 60k context version and some cost reductions as well but let's take a look at this function calling because I think this is going to be a huge deal so basically goal is to reliably connect gpt's capabilities of external tools and apis and these models have been fine-tuned to both detect what a function needs to be called depending on the user input so like if you're asking what's the weather it has no idea but it knows that means it can cause certain function called you know get the weather and then report it back to you for example you know things you can use it for is to create chat box that answer questions by calling external tools like various plugins you know if you want to say hey email this person she see if she wants to get coffee right so they're going to use a function like send mail to this person or what's the weather like it's get is going to call the function get current weather who are my top 10 customers this month they can go check the database pull those customers out and explain it to you or if you wanted to see every single person mentioned in a Wikipedia article it'll do that now this might not sound like a lot at first but it's important to understand that a lot of the signs of papers they've been coming out from Stanford Microsoft open AI itself a Google deepmind Etc they're all pointing to one thing is that the GPT model gpt4 already has a lot of power and when you start connecting various tools to it it gets much bigger much better the capabilities improve so a lot of it isn't necessarily about improving gpt4 to let's say GPT 5. it's more about how do we use this to the best of its ability so things like function calling like tools like plugins like different ways of prompting it really expands upon the power that error he has so allowing it to call functions is going to be huge for things like automation automating businesses automating your life so there's two sort of use cases that are really exciting to me in my own life one is having an AI assistant that can handle a lot of tasks plan out my calendar reach out to people remind me of things Etc something that's intelligent that knows me and like enable they can help me get through my day Etc and the second thing is this idea of like these fully autonomous businesses so I I ran an e-commerce store and I still do since 2011 so that 10 plus years I've been in e-commerce basically selling things online selling physical Goods through things like Shopify eBay Etsy Amazon Etc Shopify is when you have like your own store and the other ones are sort of third-party marketplaces and there's a lot of tools and software out there that can help you automate some of the stuff things like zapier and of course you know autoresponders they're things like 3pl's third-party Logistics where basically they'll ship the goods for you you just have to sort of make their 3pi their sort of Warehouse API talk to Shopify or whatever order take platform you're using there's only so far that it can go because at the end if you can't explicitly Define what you wanted to do it's not going to do it like it has to be very like perfectly defined what was always missing is just a little bit of intelligence a little bit of reasoning if you could just pour a little bit of reason on top of this automation that we already have everything changes so as soon as I saw what GPT 3.5 with gpt4 was capable of doing I realized that we have a lot of the infrastructure for automation already available to us we just need that glue that kind of is going to put it all together that's exactly what gpt4 provides so let me give you kind of an idea of what you're going to be able to do with this so first of all you're going to be able to interact with apis you can get the latest weather or stock market information that makes sense you can execute various programs so you can execute programming code you can have a code little scripts that you might need to help you run various things so let's say you know you go to a website that has like a million words on a page and you need to pull out certain things from that well you can you can say hey Chad gbt write me a quick script that's going to pull this things these things out it's going to write you that scripts put out a little program that you can do you execute you get gather that data oh within seconds all within your own kind of within your own AI agent that kind of knows how you prefer to work what kind of outputs you want that has certain memories about who you are which by the way is another thing that they announced recently open AI is each agent is going to have its own sort of long-term memory that you add to so that it knows some things that you like Etc next thing you do is things like database interactions so it can interact with databases you know pulling information out updating it manipulating data in there in response to your queries so for example in the past if I wanted to change a customer's email for example I would have to go into Shopify or you know if I'm using something like a MailChimp I would have to go in there and change their phone number or email or whatever in there we're not too far from where an AI agent can that knows all those places and how the API keys to connect to all those places you tell them hey this customer there they misspelled their email you know you know change the the first letter instead of an a to d or whatever right and it goes in there and starts doing it so it changes in Shopify it changes it in uh MailChimp all the other places where you've communicated with that person it's like your own personal smart AI assistant that knows everything about you about your business it can manage your email and calendar and can you do data analysis like a lot of these tools the data analysis tools are extremely expensive especially if you get to like the like the corporate level like the Enterprise level as long as you have access to the raw data and you're able to talk to Chad gbt a lot of this I feel like it's going to be able to do for you you know you're going to ask okay so what are what is the age group of my customers that spends the most money put that out in a in a chart for me by calling a few functions and having long-term memory about what you mean when you say my customers you can just ask the questions it's going to have access to all the databases it's going to pull that info and just spit it out for you with function calling you can also do things like music position let's say it knows that you know a couple times a week you need a two minute long segment about copyright music that's not copyrighted and you like a certain sound so every time you can just say hey I need a music like this I want a little bit more upbeat and let's have it fade out towards the end and boom a couple minutes later it creates an AI generated music for you and spits it out social media management how many people have you heard of that were social media managers as their career you know it's something that's very useful for Brands to be able to respond respond to customers to put content out there to promote stuff but you know what it takes time it takes effort you got to know the platform and you gotta be constant with it you got to upkeep it day to day to day so having a little agent that runs around it just kind of looks at the content that you're putting out there and puts it out to Twitter and Facebook and Instagram or whatever you're trying to get to that would really help automate that portion of it but not only that but it can also pull in the responses from your followers and actually analyze the sentiment this is something that I've been working with Chad GPT since it came out before it was gpt4 how well can it analyze the sentiment of what the person is saying so for example if I said how positive it is you know from one to ten first of all it's extremely good at that not only that but it can also sense sarcasm when it's present so in for example filter out the sarcastic responses right so if somebody's like you know your product broke as soon as I used it so great job as always it's not going to understand that to me you know 10 out of 10. good job it's going to be like oh this sounds bad because the person is sarcastic so when he's saying that that's great as usual that he doesn't mean that that's not a positive sentiment like it will pick up on that if you just sort of ask it correctly to to think through that so how I'm going to be trying to build this out how I'm going to be personally using this is number one to try to build my own AI assistant that's going to help me with the calendar that is going to help me with the email management Etc and number two I'm going to start applying this to trying to build fully autonomous businesses or maybe not fully but at least if I can automate you 90 of the tasks that I do you know that would be pretty exciting and I think all that's going to start with is by just creating an agent for each one of the sort of tasks that you're trying to do so for example one for social media management one for customer support you can create a specific one for data analysis I'm not sure if that's just going to be one sort of agent that you're looking at that's going to do all of this or you're going to have to separate them out each of its own specialized function but if you're following the channel we've already seen things like autonomous Minecraft agents that will learn how to run around the World of Warcraft create little scripts for themselves to continue exploring they continuously lower and improve and travel farther so there's really there's really no reason why you can't create something analogous something the same as that for the business world so pay attention attention to this because I feel like this is what a lot of people are missing so far it's the idea that we already have the power we we have the electricity the power plant so we don't need a better power plant we don't need gpt5 what we need is just to figure out how to get the most power this thing that we have already and function calling and long-term memory and all the stuff that openai is slowly releasing that's the thing that's really going to make it work more info coming soon my name is Russ Roth and thank you for watching