Topic
5 videos.
Crawl budget is roughly how many pages a search engine's crawler can and will fetch from a site in a given time. Google says it mostly concerns very large sites, or ones with many near-duplicate or low-value URLs, where crawlers can spend time on the wrong pages.
For a gentle start, try How do you deal with Crawl Budget?, an interview from BrightonSEO 2021. Moz's What is Index Bloat? separates crawl budget from pages that sit in the index without bringing visitors, and suits medium to large sites. Reading server logs is the advanced route, and the JetOctopus webinar takes it while promoting its own tool. Vanessa Fox's podcast episode is a long listen on how search engines find and index content. The casino interview is long and about one brand's SEO.
Trade press or conference
Does optimising crawl budget improve web traffic? Vanessa Fox joins this podcast episode to talk about how search engines discover, crawl and index content.
Sells in this field
Online casino SEO is the subject of a long interview with Peter Macinkovic, covering crawl budget, schema, user-generated content and how AI fits into daily work at Stake and Kick.
Sells in this field
Index bloat is what happens when pages sit in the index and bring no visitors. Tom Capper separates it from crawl budget, explains how to check your site and suggests cleanup steps.
Sells in this field
Crawl budget management through bot logs gets a JetOctopus webinar, covering how to block malicious bots and check log health, from load times to status codes.
Older: check current guidanceIndependent practitioner
Crawl budget is how many pages crawlers can get through in a set time, according to this BrightonSEO 2021 interview with Joanna Beech, which also covers how to deal with it.
Older: check current guidance
