ElevenLabs Voice Agents Are So Easy to Build (No Code!)

Key Takeaways

hey there I'm Archer what can I do for you hey Archer can you help me send an email of course I'd be delighted to help who's the email for and what's it about just give me the details and I'll get it sent out awesome yeah I just wanted to send one to Phil I wanted to ask about an update for the project that we discussed last week got it so you want to send an email to Phil asking about a project update no problem I'll handle that just hang tight while I send this off all done it's been sent to Phil he'll be getting that email any minute anything else I can help you with yeah could you actually go ahead and help me send another one of course I'm always happy to lend a hand or rather an email address who is this email for and what's it about just give me the details and I'll Whip It Up just another one to fill I forgot to mention that I wanted to see if he wants to get lunch tomorrow all right another email to Phil this time to ask about lunch tomorrow I'm on it just a sec gotcha the email is on its way to Phil he'll be sure to see your invitation for lunch tomorrow let me know if you need anything else no that's going to be it thanks Archer you're very welcome always happy to help especially when it comes to emails happy to handle any other messages you need to send in the future have a great day okay so that was a quick demo of the super cool conversational voice agent that we built using 11 labs and NN his name is Archer and he helps us send emails as you can tell he was very enthusiastic about sending emails so here's that first emo that we asked Archer to send to Phil hi Phil I hope this message finds you well I'm writing to inquire about the project update we discussed last week could you please share the latest development at your earliest convenience looking forward to your response best Nate and then we asked Archer to send another email just asking if he wants to get lunch tomorrow to fill so hi Phil I was wondering if you're available for lunch tomorrow let me know what works for you best Nate so now that we've seen a quick demo we heard the voice we've seen the emails actually come through we're going to hop back into NN and we're going to explain what's going on here so that you guys can get this sort of system up and running for yourselves okay so there are a few things that I want to break down here first of all just within nadn whenever you're building an AI agent as you guys should know there's going to be an input and then that input's going to be fed into the agent the agent's going to use its system prompt and its brain to understand what tools it needs to hit it's going to use those tools to take action and then there's going to be some sort of output so in the past when we've done tutorials on personal assistants email agents whatever it was rag agents usually that the input that we've been using has been something like telegram or Gmail or even just the nadn chat trigger pretty much all we're switching out here for the input and the output is 11 Labs so we're going to be getting a post request from 11 Labs which is going to send over the body parameters like who the email is going to um what the message is going to say stuff like that and then the agent once it actually does that it's going to respond using this respond to web hook node so we'll get into 11 labs and I'll show you guys how I prompted the agent and everything like that in 11 Labs but first let's take a quick look at what's going on in the super simple agent setup here in nadn so these are tools that I've used multiple times on videos on my channel channel the first one is contact data so it's just a simple Google sheet this is what it looks like here's Phil's information with the correct Gmail that we were having information sent to and then I just put other ones in here just to sort of dummy data but all we're doing is we're hooking up the tool um Google Sheets it's going to be reading get rows sheet within the document we link the document that's pretty much all we had to do um and then we just called it contact data so that when we're prompting the agent it knows when to use this tool what it has and then the actual tool that sends emails is the send email tool so in here we're connecting a Gmail tool um this one is you know we're using all the from AI functions which makes it really really easy um we're sending a message of course and so the from AI function basically takes the query coming in from the agent and understands um dynamically the AI is looking for okay what's the email address based on the user's message okay we grab the email address we're going to put it in the two parameter how can we make a subject out of this message we'll put it here and then how can we actually construct an email body and we put it there so that's all that's going on here we've got our tools we' obviously got a chat model in this case we're just using um GPT 40 and then we have the actual what's taking place within the agent so obviously there's an input coming in so that's where we Define this information input agent output and then the actual system message for the agent so the system message is a little bit different than the user agent the system message is defining the role this is your job as an agent this is what you should be doing these are the tools you have and then the user me message is like each execution each each run each time that we interact with the agent through 11 Labs it's going to be a different user message coming in but the system message is always going to remain the same as it's the prompt for the AI agent's Behavior anyways let's take a look at the prompt that we have here first the overview is that you are an AI agent responsible for Drafting and sending professional emails based on the user's instructions you have access to two tools contact data to find email addresses and send email to compose and send emails your objective is to identify the recipient's contact information draft a professional email and sign off as Nate before sending the tools you have obviously uh contact data it retrieves email addresses based on the name so we have an example input John Doe example output an email address and then send email sends an email with a subject and a body the example input here is an email address um subject and a body with example email subject body um so that's what we have for the system message and then for the um user message as you can see basically just saying um okay so the email is going to be for this person and the email content is going to be this so in this case this execution it was the emails for fill and the email content is asking about lunch tomorrow so that's all that we're being fed in from 11 labs and then the agent takes that information to grab the contact information and then it uses its AI brain to make the email message finally it basically just responds to the web hook with um the email to fill regarding lunch tomorrow has been successfully sent and then 11 Labs captures that response back and then it can respond to us with gotcha we were able to send that off for you is there anything else you need so that's pretty much all that's going on here um if you see in the actual web hook what we're getting here is you know there's different things coming back we have different little technical parameters all this kind of stuff all that we want to configure and I'll show you guys how we configured this in 11 Labs is the the Json body request that's being sent over so we're in table format if we went to Json we could see down here we're looking at body and the body we set up two fields to send over from 11 labs to NN using that post request web hook the first field that we set up was two and as you can see that's when the 11 Labs model based on what we say figures out who the email is going to and puts that there and then figures out what's the email content what do you want me to say in this email and then throws that in here so um that's how that's going to work as far as setting up the actual web hook node right here um we have a we wanted to switch a to a post method because 11 Labs is sending us information um we have a test URL and a production URL the test one we use for now and we have to manually have nadn listen for a test event um I will show an example of what happens if we don't actually do this later in the video but when you push the app into production you make the workflow active you would want to put this web hook in 11 Labs as the production URL rather than the test URL so that you can make sure that the stuff's actually coming over we put our paths n just to clean up this URL all that it does is changes the URL um and then authentication we put none and then finally for response instead of doing immediately or wait when last node finishes we want to do using respond to web hook node that way we get the information the agent takes place and then responds and then all we have here is respond to web hook so it's very simple as you can see it's only you know really four nodes you know the email the brain um and then the two tools and the web hooks so um hopefully that all made sense we are going to hop into 11 labs and start playing around with this stuff also a quick side note if you want to hop into this workflow check out the prompts play around with how I configured things um you will be able to download this workflow for free in the free school Community Link for that will be down in the description you'll just come into here you'll click on YouTube resources you will click on the post associated with this video and then you're able to download the workflow right here once you download the workflow you can import it from file and then you will have this exact canvas pop up on your screen then if you're looking to take your skills with nadn a little bit farther feel free to check out my Community the link for that will also be down in the description great community in here a lot of people obviously are learning nadn and um asking questions sharing builds sharing resources got a great classroom section going over you know client builds and some deep dive topics as well as five live calls per week so you can always make sure you're getting your questions answered okay anyways back to the video so in 11 labs this is the email agent this is just the test environment where we're going to be talking to it to try things out so we'll go back and we'll see how we actually configured this agent if you're wondering why I named a marcher it's just because his actual voice is Archer so um that wasn't my creativity there anyways once we are in the configuration section of the actual agent we need to set up a few things so first is the first message um we pretty much just when we click on call the agent it's going to say hey there I'm Archer what can I do for you otherwise um if we leave this blank then we will be the ones to start the conversation but from there you will set up a system prompt so in here the system prompt I have is you are friendly and funny personal assistant who loves helping the user with tasks in an upbeat and approachable way your role is to assist the user with sending emails when the user provides details like who the email is for and what's it about you will pass that information to the nadn tool and wait for its response I'll show you guys in a sec how we configure the naden tool and how all that works but anyways once you get confirmation from naden that the email was sent cheerfully let the user know it's done and ask if there's anything else you can help with keep your tone light friendly and witty while remaining efficient and clear in your responses so as you can see in the system prompt I didn't even really put in anything about the way it should be conversated as far as like sounding natural and using filler words and um and sometimes I do that to make it sound more natural but this voice I found just sounded pretty good just as is then we're setting up the large language model um right now we're using Gemini 1.5 flash just because it says it's the fastest you have other things you can use here but I'm just sticking with this one and so this is what it uses to extract information pretty much out of the conversation to pass it to n8n or figure out how it's going to respond to you that's what's going on here and then with temperature um I talked about I like to put a little bit higher especially for some fun use cases like this um basically this is just the randomness and creativity of the responses generated so that it's always going to be a little different it's going to be a little fun um the higher you put it but if you wanted it to be more consistent and you had like you know you were trying to get some sort of information back um right the way you want it then you would probably want to lower this a little bit um and then you have stuff like knowledge base so if this was maybe like um a customer support you'd be able to put some knowledge base in there or if you watch my previous voice video about um sort of doing voice rag you could still do the sending it to edn hitting a vector database from edn and then getting the response back but anyways um in this case this is where we set up the tool that we were able to call up here as you saw in the system prompt so the tool edn this is where you're putting the web Hook from your the web hook URL from NN that's where you're putting that right here as you can see um web hook- test naden the method is going to be a post so we can send information from 11 labs to nadn and we just named it nadn to make the system prompt to make more sense for um just just for me when I was creating this it makes sense to send something to the tool called naden anyways as you can see the description is use this tool to take action upon the user's request and so we can pretty much just leave it as that we don't have any headers or authorization going in here but we do need to send over body parameters um otherwise if we didn't have this nothing would be sent over to n in at all so the description of the body parameters is in a friendly way ask the user to provide the name of the recipient and what the email is about unless they already provided that information so the llm is understanding when it's conversating with the human it needs to extract the name of the person to send and an email to and then actually what is the email going to have as you can see we didn't have to put in like oh what's the subject of the email because our AI agent in n8n can use its brain to figure out a subject so we have two parameters that we're sending over if you remember when we were in here we got the two parameters from the body right here which was two an email content and so that's as you can see what we set up here so the first one was a string it was called two and this is who the email is going to and then the second one was also a string it's called email content and this is what is the email about so we hit save changes now we have a tool that gets called whenever um The Voice agent realizes it has information to send over to n ATN to send an email and it has the right parameters to do so so now we have this voice agent pretty much set up here with its tools and it system prompt we're going to test the agent and remember earlier I talked about the fact that right now we're testing so we have to have the web hook actively listening once this is in production it's going to be listening all the time but right now we have to manually hit test event before we call it otherwise it's not going to work so I'm going to talk to Archer ask him to send an email it's going to go through and then we're going to ask going to send another email where we don't hit this web hook test event and then we'll see what he says he's probably just going to say he couldn't access the database or he couldn't find the contact information something like that hey there I'm Archer what can I do for you hey Archer can you help me send email of course I'd love to help who's the email for and what's it about tell me the details and I'll Whip It Up in a jiffy sweet um it's going to be for Phil okay so the email is for Phil what's it about I'm ready to get this email sent out yeah just let them know that I'm caught in traffic and I'm going to be late to the meeting got it so you want to let Phil know you're running late because of traffic I'll get that email sent out right away all done I just sent the email to Phil letting him know you're running late anything else I can help you with yeah I'm actually going to need to send another one no problem who's this one for and what's it about I'm ready to send email number two yeah can you let Phil know that um I actually just drove my car off a bridge oh my goodness I can't send an email like that maybe you should call Phil instead is there someone else you want to send an email to um no can you send an email to Phil I'm so sorry I can't send an email like that it sounds like you're in a difficult situation is there someone else you can reach out to for help okay didn't expect that so I guess the model doesn't want to say something like that we'll try again um workflow is not active so let's see hey there I'm Archer what can I do for you hey Archer can you send an email of course I'd be happy to help you with that who is the email for and what is it about I'll get it sent out in a jiffy just wanted to touch base with Phil about um the meeting later today okay so you want to send an email to Phil about the meeting later today got it I'll get this done right away anything else I can help with today oops looks like there was an error sending that email it's possible there's a typo in the email address or something is wrong on my end let me try again can you please double check the email address okay anyway so that's how it works as you can see the second time the web hook wasn't active so wasn't able to send that um that email for us because it pretty much NN wasn't looking for the request to come through so no information got passed through so that's going to be it for this one I hope that everything made sense um it's just really cool how easy it basically is to switch out an input and you can have the agent function the same obviously a few things would change as you start to add more tools your user message would have to be tweaked a little bit you'd have to tweak the actual system prompt a little bit but as you can see in this one kept it very very simple basically just told it its role gave it the the two tools and how to use them and as you can see um it was pretty seamless as far as being able to have the agent fill in things make the messages and then send them off pretty easily so um as always if this one helped please leave a like definitely helps me out um I always really appreciate it and thanks for making it to the end of the video I will see you guys in the next one