About this episode
In this episode of SOTR, John Mueller, Lizzi Sassman, and Gary Illyes talk about misconceptions around crawl frequency and site quality, what's challenging about crawling the web nowadays, and how search engines could crawl more efficiently.
Resources:
Episode transcript → https://goo.gle/sotr079-transcript
Gary's post on LinkedIn → https://goo.gle/3YAT55q
Crawling episode with Dave Smart → https://goo.gle/3WShUsf
If-Modified-Since → https://goo.gle/3ywXvja
About the IETF → https://goo.gle/3SGVVlo
Robots Exclusion Protocol → https://goo.gle/4dgmBSg
Proposal for new kind of chunked transfer → https://goo.gle/3AgMF1c
Listen to more Search Off the Record → https://goo.gle/sotr-yt
Subscribe to Google Search Channel → https://goo.gle/SearchCentral
Search Off the Record is a podcast series that takes you behind the scenes of Google Search with the Search Relations team.
#SOTRpodcast
Get every episode summarized
Each time Search Off the Record publishes, we email you a written briefing from the transcript — the topics, who appeared, and any specific claims, with the ad reads skipped.
Email me new episodesFree for 3 shows. No card needed.
Hosts & guests
No transcript yet
This episode has not been transcribed. Request it and it moves to the front of the queue.
More episodes
More from Search Off the Record
Are websites getting "fat"? Page weight, HTML size & Googlebot limits explained...
Search Off the Record
Are websites getting "fat"? Page weight, HTML size & Googlebot limits explained
Search Off the Record
Google crawlers behind the scenes - transcript
Search Off the Record
Google crawlers behind the scenes
Search Off the Record