Rendering & Crawl Budget -

Key Takeaways

[Music] today's question comes from michael and it's does intensive use of wrs also reduce crawl budget for a site thank you for your question michael there are a few things that come together here so let's briefly unpack them before we dive into the details wrs refers to web rendering service which is what googlebot uses to render pages like a browser so that we can index everything in the same way that users would see it crawl budget refers to the system that we use to limit the number of requests that we make to a server so that we don't cause problems during our crawling this isn't something that most sites need to worry about since google has no problem crawling enough urls from most websites while there's no specific threshold i'd consider crawl budget a topic that mostly large websites let's say sites with more than a few hundred thousand urls really have to think about for crawl budget our systems automatically determine the maximum number of requests that a server can process over a given period of time this is done automatically and adjusted over time as we see that the server starts to slow down or return server errors we reduce the crawl budget available to our crawlers there's a bit more about crawl budget in a blog post linked in the description if you want to check that out for rendering our services need to be able to access embedded content such as javascript files css files images and videos as well as server responses from apis that are used on the pages we use a lot of caching to try to reduce the number of requests needed to render a page but in most cases rendering results in more than just one request so more than just the html file being made to the server in short if you're working on a large site then reducing the number of embedded resources required to render a page can help with crawling of course doing that usually also makes pages faster for users as well so you can cover both sides at the same time i hope you found this video useful and insightful if there's something else you want to add or if this video helped you in some way feel free to comment below