Select Page

Crawling December: CDNs and crawling

Content delivery networks (CDNs) are particularly well suited for decreasing latency of your website and in general keeping web traffic-related headaches away. This is their primary purpose after all: speedy delivery of your content even if your site is getting loads...

Crawling December: Faceted navigation

Faceted navigation is a great way to help users find what they need on your site, but it can create an SEO nightmare if not implemented carefully. Why? Because it can generate a near-infinite number of URLs, which causes all sorts of crawling problems. ​Google Search...

Updating our site reputation abuse policy

Earlier this year, as part of our work to fight spam and deliver a great Search experience, we launched a spam policy to combat site reputation abuse. We’re clarifying our policy language to further target this type of spammy behavior. We’re making it...

Search Central Live Kuala Lumpur and Taipei 2024: Recap

The Search Central Live events in Kuala Lumpur and Taipei were nothing short of amazing, in large thanks to the over 600 people who attended the events! We were thrilled to see the level of enthusiasm and engagement from attendees even if, on the day prior to the...

Crawling December: HTTP caching

Allow us to cache, pretty please. As the internet grew over the years, so did how much Google crawls. While Google’s crawling infrastructure supports heuristic caching mechanisms, in fact always had, the number of requests that can be returned from local caches...