Select Page

Crawling December: Faceted navigation

Faceted navigation is a great way to help users find what they need on your site, but it can create an SEO nightmare if not implemented carefully. Why? Because it can generate a near-infinite number of URLs, which causes all sorts of crawling problems. ​Google Search...

Updating our site reputation abuse policy

Earlier this year, as part of our work to fight spam and deliver a great Search experience, we launched a spam policy to combat site reputation abuse. We’re clarifying our policy language to further target this type of spammy behavior. We’re making it...

Search Central Live Kuala Lumpur and Taipei 2024: Recap

The Search Central Live events in Kuala Lumpur and Taipei were nothing short of amazing, in large thanks to the over 600 people who attended the events! We were thrilled to see the level of enthusiasm and engagement from attendees even if, on the day prior to the...

Crawling December: HTTP caching

Allow us to cache, pretty please. As the internet grew over the years, so did how much Google crawls. While Google’s crawling infrastructure supports heuristic caching mechanisms, in fact always had, the number of requests that can be returned from local caches...

Crawling December: The how and why of Googlebot crawling

You may have heard that Google Search needs to do a bit of work before a web page can show up in Google Search results. One of these steps is called crawling. Crawling for Google Search is done by Googlebot, a program running on Google servers that retrieves a URL and...