Use Mistral AI Large Model Like This: Beginner Friendly

Key Takeaways

mral AI large model is 20% cheaper than gp4 and its performance is closely matches with gp4 model for most uses these slight differences in performance won't significantly impact their use cases but the cost does given the competitive pricing it seems likely that many developers will consider switching to mral AI some of the interesting features of mral AI is it has 32,000 tokens context window it is natively fluent in English French Spanish German and Italian strong abilities in reasoning knowledge mathematics and coding benchmarks it natively supports for function calling and Json mode it's available through Microsoft azour and Mr a platform let's create an APA key first you can go to m.ai then you can click build now so now you are in console. mist. aai here you can click the APA keys and create new key you can name your key and also you can set some expiration date this is quite helpful for hobby projects then you can click create key after creating an API key you can paste your API key in environment file which looks like this you can create a name mistore AP key and you can paste your key here then let's go to coding so we have stored our API key in environment file to access the AP key we can use environment library now let's do the installation of mral AA library to install we can use pip install mral AI you can see it's already installed now we can import mral AI client from mral a. client import mral client then we can import the chat message so we have imported the chat message from Mr a. models. chat completion we have imported this so now let's get the key key stored under the name melore apore key our key is stored here so now let's use the mral large latest model model is mistal large latest now let's create client so we have created the client so now what we are going to do is we are going to use chat completion model in chat completion model we can pause some messages and we will get some response so let's create a message so we can set some role and content so let's say top places to visit in Sydney and let's close the bracket this looks good so we have created the message now we can pass the message to client. chat chat client. chat takes two things one is model and messages so now we are displaying the message as chat response. choices and we are getting the first message message. content so here you can see the response took around 8 seconds now let's say you want to do streaming we can do that chat completion with streaming let's get the stream response as client. chat stream and here you can pass the model add messages now let's create a buffer then for each Chunk in stream response get the text you can get the text by taking the choices first index then Delta do content add it to the buffer then if text do ends with any of these we can print and we can reset the buffer then after the buffer let's print the last one if buffer print buffer okay let's run this you will see the response as it comes you can see it here it's loading this is quite good as you can see the response and streaming got it now let's look into Json mode so so let's say you want to find the tourist attractions just the name and you want to find the distance between each location from Oprah house so you want the response as a Json in the Json you will have some key and some value so let's use Json mode to get the response in more structured way so this is not super structured uh we can extract by name using some paring but if you use Json mode we can get some structured data from unstructured so let's get that and my messages is what are the top 10 tourist attractions in Sydney written the attraction name and distance from Oprah house in Json format now we are creating the client. chat here you can pass the model then messages and the most important thing is you have to set the type as Json object once it's done you will get the response as Json so here you can see the response this is Jason and this is very well structured you can see the attractions key and there is a list in the list we have a dictionary of name and distance from operah house so this is quite convenient in my next video we will learn about function calling in Mr API thanks for watching