Crawling

Articles in Crawling

Illustrated robot icon with the word 'GoogleOther' crossed out, representing the crawler being blocked
5 min read

Case study: The unexpected impact of blocking GoogleOther on SEO performance

Blocking GoogleOther by IP broke Search Console connectivity, because GoogleOther shares Googlebot's IP ranges. Here's what happened and the robots.txt fix.