I Tested Perplexity Comet vs ChatGPT Agent (Surprising Results)

Key Takeaways

Okay, in this video I'm going to pit chatbt agent against Perplexity's comment browser which has agentic capabilities built into it head-to-head so that we can see which one does the best for specific use cases that I give to each age agent combines deep research and its operator mode. It's meant to automate multi-step tasks rather than just retrieving information for us. And I've got six use cases I'm going to give to each agent exactly the same. Starting with the first use case where I want the agent to analyze my LinkedIn profile and posts which are not very good and compare it to another LinkedIn profile of a friend of mine who I know does a really good job on LinkedIn. I want the agent to and the AI to give me a full analysis recommendations for what I can do differently. and I want a step-by-step plan for whatever changes that I need to make. All right, so first let's start with chatbt agent. I'm going to go into the chatbt. I'm going to click on tools. I'm going to go to agent mode. This is the prompt. And this is Jacob Bank, who is the CEO and founder of Relay.app, which is a tool that I love. Very simple. I want you to analyze my LinkedIn profile and post and compare everything to his LinkedIn profile and post. I want you to make my profile and post to more similar to what he's doing. can give me a full analysis and recommendation. So, this is the full prompt. I've given it the links. Let's see what it can do. Well, this is interesting. The first thing I'm noticing about chatp agent is that it is just hung up here. All right, so now it's kicked in. So, it's setting up the desktop. Remember, it's using a virtual browser here. So, we should see hopefully a a window pop up. Okay, so it's just telling me that I have to log in. Makes sense, right? So, it's telling me please use takeover to enter your credentials on the sign-in page. So, I'm going to click on take over. So, I can click in here, but I can't type anything. So, let's go over to the comment browser. I don't know what's going on there with the chatbt. So, as with agents, right, it's telling you what it's doing. It obviously was able to log in. I think it's because I've logged into LinkedIn before in the comment browser and obviously not in the the virtual browser essentially that chatbt agent is doing. It's giving me a really good comparison here between what I'm doing and what Jacob's doing, different topics and so forth. step-by-step plan to Jacobize your LinkedIn. So, it's giving me a pretty good step-by-step plan. You can look at the steps here. It went to the both LinkedIn pages and then did the analysis. So, in a matter of seconds, this one absolutely goes to the comment browser. Much better for this what I think is a really basic use case. It crushed it on this one. For the second use case, I did a few weeks ago release a video here on the channel, nine mind-blowing use cases of Perplexity Labs. A lot of you are asking for the prompts that I used in that video. And so what I want the agent to do or see if it can do it is to analyze the transcript of that video, figure out which use cases I shared in the video, and then compare it to the notion doc with all of the prompt and I want to create a new Google doc with just the use cases that I used in that video with their corresponding prompts. Should be pretty basic, right? This is the prompt I put together. So, it's telling me I'll authenticate blah blah blah. And it shouldn't need any kind of APIs to do it. I've given it the links. So, you can see the steps that it's going through. Now, it's going and researching a whole bunch of random. So, it's having a really hard time accessing this notion page. And I gave it the URL of the notion page. All right. So, we're going about 15 minutes now of it doing this. So, while it's doing this, what I'm going to do is I'm going to switch over to comet. Okay. And I've just pasted in the exact same prompt that we put in the to chatbt agent and let's see what Comet browser Oh, it's looking up how to add codelocks to the Google doc cuz that's what I asked it to do. So, while it's doing that, let's switch over to chatbtd agent. And what I just realized that I probably should have thought of this is that both agents are trying to access the exact same Google doc. Just by the looks of it, I think Comet's going to get there faster than ChattP agent. I just noticed that the Comet browser opened up a new tab. Okay, so what it's done is Comet just pasted the URL of this page. I think I think it's trying to confirm that it has the correct Google Doc link, which I think is really interesting because I gave it the URL to use. Now that it's confirmed that, it's deleting that content on the page. Yeah, now it should be doing the task at hand. Okay, so let's flip back over to our ChattBT agent friend here. It's still trying to figure out the prompts in the notion doc. So, let's check back in with the comment browser and how it's doing with this um this task here. So, it's going really well. It's taking a while. It's actually working uh thankfully. So, here is the uh use case. Here's the prompt that I used. And then here is the So, it's adding right now. But this is actually working. So, comet's doing a good job. Yay, comet. Because there were nine different use cases, it is picking the right use cases that I did in the video. Now, going back over to ChateBT and looking at the ChateBT agent, I actually stopped the agent because it had been 15 minutes since I put the notion page in and it hadn't even gotten to the point getting to the Google doc here. And so, I just stopped the agent. I'm going to deliver Google Doc here with all the prompts for you in the comments of the Plexi Labs video. I'm going to let this keep going and we're going to test the next use case. Absolutely. the winner on this head-to-head again, the comment browser. Okay, for use case number three, I put out a newsletter every Sunday called the AI playbook. I want to see if either Chat GBT agent or comment browser can take this email newsletter sample, put it into ConvertKit account, create a new broadcast, choose one of the templates. So I wanted to click on this replace the content and then putting newsletter content into the template in the appropriate sections. Okay, so it's first asking me for my convert kit login credentials which it it should I am not impressed one bit with chat GPT agent. Let's go over to comment browser. I'm going to put the exact same thing in there. Okay, so it found the template. So you can see here that it it created a new broadcast. It brought in the template. Uh, it's writing a subject line. I can see that it's almost there. Okay. So, this looks like the email that it created. So, let's click on it. So, yeah, this is what we were just looking at. It didn't update anything. Our friend chatbt agent still hung up over here. This one, neither one did what I wanted to do, but comment browser got a lot closer than chatbt agent. So, I will give the win quote unquote to comment browser on this. Although it did not complete the task, it got closer. For this next use case, I want it to find me gaps in content for a hypothetical business coaching content strategy. So, you can see here you're a content gap opportunity finder for business coaching content strategy. Your mission is to identify untapped content opportunities by analyzing the intersection of audience demand and competitor average gaps, then automatically save your findings directly into TANA. So, TANA is a is a tool I use in my business. I have no idea if it will be able to do that. So, we'll click go on Chat GBT agent, click over to comet, and put the exact same prompt in here. Let's see what it can do. Okay, so to begin the content, please provide the following tunnel workspace API token or integration key. Chat GPT agent is asking me the exact same thing. Okay, so here in chatd agent because of the issue I had before with logging in. I've given it the URL of the TANA page I want to update as well as an API token for my for TANA. Actually, we're going to give it that information very quickly. It says it's establishing the connection to TANA. Okay, so it is identified and it's landed on the right page in TANA and it's verified access with the API. Okay, cool. So now it's doing the research. So let's click back over to Chatbt agent. It is doing the research now. It still can't log into TANA. Even though I've given it the exact same information that I put into comment browser. So all right, it's doing the research. Let's click back over to comment browser. Okay, we can see here that comet browser has just finished task. It's telling me that uh it's fully created in the tunnel workspace uh parent node. Okay, cool. Top content opportunities. So, it's giving me a little bit of an overview. Here it is. It's actually really cool. It's actually very impressive. I mean, it's it's formatted slightly wonky. It did a really good job with this. I'm actually very impressed. Okay, now let's go over to Chad GPD agent and see what it did. I'm almost afraid to look. So, it tried to connect to the API using the token. All right, so it couldn't connect TANA like the comment browser did, but it did give me the research as you can see here. I mean, it's decent. I think comment browser did a way better job for this one. Again, another win to the comment browser agent. Okay, for this next use case, I wanted to reverse engineer viral content in my niche. So, you can see here, you are a viral content reverse engineer agent specializing in AI and automation education content. Your mission is to analyze trending content in my niche. Identify the underlying patterns that made it viral and suggest specific approaches for creating similar high-erforming content. Then, automatically create a Google doc with your complete findings. And then I've again I've written this prompt here. I also ask it to create a five slide presentation. Okay. So Perplexi is saying I'm unable to connect directly to your Google Drive with my built-in Gmail calendar tools. And so it's actually creating a new Google doc. Okay. So it's not using the Google doc that I gave it, but it's creating a new Google doc. All right. Cool. So let's flip over to it's trying to establish a connection to Google Drive. So this is interesting. I did not click continue or I did not write continue. You can see here it autoresponded. That's really interesting. Okay, so now it's going through and doing the research. Okay, so checking back in with this. It's been about 20 minutes. I don't know why it's generating an image. Oh, it's putting together those slides now. Okay, cool. Well, this is good. It's given me some pretty good research actually. What is it here? Yeah, long-term strategy, short-term goals. Okay, cool. Uh, and it has created a slide presentation. You know, it's not the most beautiful thing, but hey, chat GPT actually, it created a five slide presentation, which is what I asked it to do. Now, it's saying to create the requested Google Doc, please log into your Google Drive in the open browser window. So, I'm going to attempt to take over again. And this is where I should be able to So, I can't type anything in here. Uh, so I don't know what's going on with that. So I can't type in to the chatbt agent browser. So it gets stuck there. So I'm just going to click finish controlling. Yeah, it's still it's still unable to sign in. So and it doesn't allow me to sign in. With that said, it's given me some really good research here. I can just copy and paste this into the doc myself. And it has given me a five slide presentation here that uh I asked it to. So let's check in with the comet browser. It is giving me a list of bullet points. Okay, so this is helpful information. I don't love the formatting. Let's see here. Executive summary, research findings. All good. You know, chat DPT agent did a decent job on the formatting. I know that doesn't mean that it would do a good job in a Google doc. Okay, so comment says, "I encounter an issue while attempting to insert the detailed viral content analysis into your Google doc." But what I'm seeing here is with agents, we're not quite there yet in terms of putting content or passing content in between different platforms. It tends to have an issue with Google for some reason because I'm so impressed that it did the Batana update the way that it did really, really well. What about the slides? because it hasn't even asked or done anything about the slides. Okay. And comment has just completed slide decks pretty quickly within a few minutes. And so it's giving me a link and yeah, did not do not do a great job. All slides include title and okay. Yeah, not very good. So for this use case, I'm going to call it a draw because I don't like the fact I couldn't log into Google in the screen that it gave me. I think that the breakdown, the analysis that it gave me of the viral content examples are kind of general compared to what Comet gave me. I kind of like this better in terms of the specifics of the analysis. I like the research and the presentation of the content that Perplexity did. I do not like the Google slides or lack thereof that it put together. Uh but I do like Chatbt agent. I can look at them. I can go through and they're decent slides from what I can see. The formatting isn't great, but it I mean it looks a heck of a lot better than Comet. Yeah. So, I'm going to give this one for just a different reasons. I'm going to give this one a draw. Let's move on to the last use case. Okay. For the sixth use case here, we are going to create a hopefully a micro niche hunter agent. So, you can see the role here that I'm giving it. You are you are micro niche hunter, a data savvy market research analyst who excels at mining public web chatter and keyword databases to uncover unmet consumer needs and convert them into concise product briefs. So if you're looking for a business idea, you can use this prompt here or hopefully we're going to have Comet go and find us business ideas and give us concise product briefs. Okay, and here is the Comet browser's output. It did this actually really fast and it checked 99 sources and I'm going to say please convert this uh data into well formatted business report AI course builder audit and launch suite. I asked it for specific benchmarks that it need to hit. So for keyword research volume uh keyword difficulty uh SER competition social sentiment it needed to be I think it was 65 60% or above. Uh let's see here. Yeah, here we go. Average monthly search needed to be over 800. Keyword difficulty, I gave it a benchmark. Sentiment, uh, yeah, 60% at least. And then, all right, so here is the report. So, I think it did a pretty good job. All right. So, this is ChattyBT. And so, I'm going to just It gave it to me in Jason again, which again, I asked it to do. Okay. And here is the micro niche that GBT agent found. Disposable period underwear. Okay, cool. uh breaks down the whole report, value proposition, landing page copy, keyword difficulty, sentiment score. Okay, cool. I like it. So, I think it they they both did a really good job. I think I would say this is a draw again only because I'm pretty happy with both of these answers here. This was a pretty straightforward research project basically, but I wanted to go out to a whole bunch of different sites and so forth to to do this uh and do it agentically. So again, I would call this one a draw. They both did a really good job on this. Okay, so there you have it. Six use cases head-to-head between Comet Browser and Chat GBT agent. Overall, Comet Browser was way better in what it did. It did things a lot faster. I mean, we saw some breakdowns with it, but we saw way more breakdowns with ChatP agent. I think if it's just kind of doing research and, you know, maybe producing a slide or two, ChatP agent is going to do a really good job with that. whereas Comet is going to do a really good job with the research but not so much in you know slide creation like we saw but overall comet browser was a lot better in its agent capabilities. Now, one thing you're not definitely want to consider when using, you know, agentic capabilities like this, and this is only going to become more and more prevalent, is data security, right? And so, I would only be using these types of agents at this point when absolutely necessary due to data privacy concerns, right? I would not be putting any kind of sensitive information inside these agents. Now, like right now, I'm going to go out and uh delete my TANA API. Now, it did take a long time to do a lot of these tasks, but consider how long it would take, you know, somebody on your team or a team of people to be doing this type of research manually. A lot more than, you know, the 20 minutes or so it took for each one of these uh agentic tasks. So, I'm impressed. However, I still think we have a long way to go with these. I think we're on the right path, especially with comment browser. I still like DIA a whole lot better. Uh I will say, and if you're wondering what I'm talking about, watch my previous video that I did here on the channel. So, as always, thanks so much for watching. I appreciate it. If you are an online business owner and you're looking to leverage AI in your business so that you can streamline your business and increase profit in the process, be sure and join me inside my AI playbook community. I'll link to it in the description below. Thanks so much for watching again and we'll see you in the next