Listen "Crawling smarter, not harder"
Episode Synopsis
In this episode of SOTR, John Mueller, Lizzi Sassman, and Gary Illyes talk about misconceptions around crawl frequency and site quality, what's challenging about crawling the web nowadays, and how search engines could crawl more efficiently. Resources: Episode transcript → https://goo.gle/sotr079-transcript Gary's post on LinkedIn → https://goo.gle/3YAT55q Crawling episode with Dave Smart → https://goo.gle/3WShUsf If-Modified-Since → https://goo.gle/3ywXvja About the IETF → https://goo.gle/3SGVVlo Robots Exclusion Protocol → https://goo.gle/4dgmBSg Proposal for new kind of chunked transfer → https://goo.gle/3AgMF1c Listen to more Search Off the Record → https://goo.gle/sotr-yt Subscribe to Google Search Channel → https://goo.gle/SearchCentral Search Off the Record is a podcast series that takes you behind the scenes of Google Search with the Search Relations team. #SOTRpodcast
More episodes of the podcast Search Off the Record
Thoughts on SEO & SEO for AI, part 1
17/12/2025
SOTR100_transcript.pdf
30/10/2025
SOTR099_transcript.pdf
04/09/2025
Lazy loading demystified
21/08/2025
SOTR098_transcript.pdf
21/08/2025
SOTR097_Transcript.pdf
07/08/2025
How does CSS affect SEO?
24/07/2025
ZARZA We are Zarza, the prestigious firm behind major projects in information technology.