Search Engine Roundtable

Google: Cache-Control Headers Do Not Impact GoogleBot

The Cache-Control general-header has no impact on GoogleBot and how it crawls your web pages. The cache-control general-header "field is used to specify directives for caching mechanisms in both ...
Search Engine Roundtable

Google Says Cache-Control Headers Aren't Used For Crawling & Indexing Unless It's Embedded ...

In 2018, John Mueller of Google said Google does not use cache-control headers when crawling. He said then that the has no impact on GoogleBot and how it crawls your web pages. He said that again ...
Search Engine Land

Google clarifies how Google’s crawlers handle cache control headers

Google has added a new section to its crawler and fetcher documentation for HTTP caching, which clarifies how Google’s crawlers handle cache control headers. With that, Gary Illyes from Google also ...