Buy Microsoft "Azure OpenAI Service" or buy from OpenAI its API for ChatGPT access & tuning?

Key Takeaways

hello Community a lot of you ask me hey next week uh chat chipity will be available on Asia up Mei should I buy now the API from Microsoft Azure uh should I go with open EI API so let's a lot of this so Microsoft Asia open AI service to start soon provides now a rest API access to open ei's powerful language models so at first you know we have here three names Microsoft Azure Cloud business and open AI is the name of a startup company so interesting to see now here in this service offering by Microsoft that now it is already Microsoft Azure open AI services and then you have the company open yard startup that has also an API platform and it offers their the latest model and guides for safety best practices so interesting do they have different models what is the price difference what uh what is the difference in general so let's have a look at this what are new models they offer up to the information I have today Microsoft tells us gpd3 base series and the new with a jet GPT so the GPT 3.5 Turbo some codecs and some embeddings and if you're gonna have to open EI here in the white area you see open AI has the latest models the jet or the GPT 3.5 Turbo it's a most capable tpd 3.5 model and optimized for jet at one tenth of the cost of the text DaVinci 003 will be updated with our latest model so this is it and you have a snapshot from March 1st 2023 and then you have your classical oops text DaVinci 003 so comparing the models you see we have here the GPT 3.5 turbo and we have here the gbd 3.5 turbo whatever happens with gbt4 we don't know yet beautiful now why and here I must say open AI is very clear go there and it says why did openmate I choose to release an API instead of open sourcing the models now in the startup company openai tells us yes first commercializing the technology help us pay for our ongoing efforts and you remember there was a heavy investment by Microsoft into the startup openai and I think they have a profit sharing agreement so very simple they have to pay back Microsoft second many of the models underlying the API are very large a very expensive to run this is true and of course they allow us to respond to the misuse of technology so they in my terms are able to respond very quickly and it's not happening outside and you can get sued now everything is running on their servers so they have a tighter control if somebody would like to misuse this technology makes sense they have to pay the bill they have to pay the rent they have to pay back their investor return on investment sounds logic Microsoft Azure open eyes service has no statement why it does not open source the model but I think the term service here commercial term service is everything you need to know now what does it cost openr very clear chat GPT models optimized for the dialogue the performance of GPT 3.5 turbo is on par with instruct DaVinci and the model usage for the tokens only remember this is only the tokens 1K token costs about dot zero zero to US dollars access to Microsoft Azure open UI is at the moment Limited as as they told us we navigate high demand they have now a list that you can inscribe that you yeah and say for now we are working with customer with an existing partnership with Microsoft so if you were a huge American company and you have years of cooperation with Microsoft you are one of the lucky yeah congratulations for the rest of us there is a waiting list you can in swept so if you want to work now now with this system I think I would recommend maybe have a look at the company open AI and evaluate the offer now I have to say if we now look to Azure to Microsoft Asia opening eyes Service pricing and they have here this information on the internet for us unfortunately only at the moment for Central us not for Western Europe and they tell us hey those are the models and you see here we have text DaVinci and we have code Da Vinci and for chat GPT the GPT 3.5 turbo version they have no prices as of today now I showed you here on the right side the TechCrunch has an article from yesterday where they say hey we expected also from 1K token for jet GPT it's about 0.002 dollars so this is more or less if you go back here they assume they will have the same price just based on the tokens I don't know so whenever you make your decision please go Azure Microsoft pricing cognitive Services openai Service pricing and then you see for your region in your currency what it would cost beautiful next up on the side of the company open AI they have an open AI API they have a very good informative instruction here start with the basics this is a screenshot from this exactly platform of my.com overview they have a quick start tutorial that show you very clearly very detailed how you can do this they have some beautiful examples you can just follow the example to really learn a lot of so this is up and operational on the side of Microsoft azure uh may I hear quote learn microsoft.com Asia cognitive Services overview in addition to applying for initial access you of course all solution using Azure open AI are required to go through a use case review before they can be released for production use more specific information is included in the application form yes you can download this application form you can fill in all your data everything from your company and then Microsoft will decide if you are legible to have access to Azure oakm AI API and Microsoft tells you hey we appreciate your patience so if you wanna use it now maybe there is this little startup company opening eye and they have some operational and I think good documentation here of course you can apply for this now fine-tuning the models this is something people ask me now remember fine-tuning the models means we have a pre-trained model and now you take your company data 100 000 of documents and you fine-tune the model this means you render complete models to a fine tuning process where all the weights in all the different Transformer blocks will be changed in all layers so this is a really really intensive process procedure and they tell you here hey for the training and for the usage this is just for the tokens now remember there is and I don't know this now for sure only the model Ada back at Curry and DaVinci and you say there's some models missing for fine tuning and I found the information fine tuning is not available yet for GPT 3.5 turbo our jet GPT and up until now there's no official announcement if it will be when it will be whatever so but keep in mind this is fine tuning now I told you that fine tuning is just one option that we have the other option is in context learning fuel shot prompting if you're one year old learning so there is for fine tuning and the other one is for ICL you can do now Microsoft I have to say is now you're very precise it gives you now three pieces of information this is what Microsoft azure open your API has now an information for the costs for fine tuning the models remember we change here all the weights in all the layers of the model so it tells us per 1000 token we have and now we just look at here the text DaVinci because they have of course node activity so text DaVinci costs about zero two dollars per thousand token and then Microsoft is so transparent to tell us hey the training per compute hour because we have to run this on it on either GPU or TPU cluster but text DaVinci is about 84. I've heard in Western Europe it should be around 100 euro Maybe please check whenever you want to make a decision and then of course you have the hosting per hour text DaVinci three dollars and now depending on your data set that your fine-tune your model on if you have a data set that is really I don't know 40 gigabytes you have of course additional cost but I think Microsoft will help you here to find your optimal pricing so in summary what do I know today if we compare Asia of Maya and openai there's also from Microsoft short documentation and this is it and they tell you if you now compare Asia of Mei and the openai from the let's say startup company open AI what is the difference and as you can see here regarding the content the model the apis Asia open AI co-develops the apis with openai so Microsoft and the startup open AI they co-develop after Microsoft invested I don't know 10 billion dollars 13 billion dollars I don't know if the exact amount so they have a code development ensuring compatibility and a smooth transition from one to the other so I think if regarding only the core technology of the models they should be really similar if you have a co-development now what are the other two points Microsoft now claims Azure oatmeal service gives customer Advanced language AI with gpt3 codecs the models with the security and Enterprise promise of azure so I would translate this if you are a customer from for your company and you you run I don't know Bank of America runs the services at Microsoft azure well of course then if you are a customer if you have your services already up and running at azure then why should you not take another service package from Microsoft Asia and maybe integrate this for marketing for sales effort whatever the third one that Microsoft tells us with Azure open AI customer get the security capabilities of Microsoft Azure while running the same models as opening AI so they tell us hey we have the same model as open EI but you have here let's say this additional security capabilities of Microsoft azure now they are now in the business quite for some years and if you are a customer of Microsoft Asia you know if you trust them you know what you think about it and you will make your decision based on your experience with Microsoft azure tell us Asian open UI office private networking Regional availability hopefully coming soon and responsible AI content filtering this indicates that they have additional filtering of AI content but for this point I have no information at the current time so I hope to give you some kind of information before next week you see here the availability of azure open AI if you are one of the lucky if you want to inscribe on their waiting list if you think about going to open AI API or going to Azure openai API I hope I provided some basic information for you so you can make your decision in the coming weeks and month which service you prefer I say thank you for listening and I hope I see you in my next video