Google StoreBot crawler, a bot designed to collect product data for Google Search, has been abusing its powers by submitting spammy fake orders through online forms. To save businesses from this unwanted activity, we have implemented a targeted blocking solution using CleanTalk Anti-Spam.

Understanding Google StoreBot crawler


Google StoreBot crawler is a search engine-based automated crawling program, used for gathering and analyzing product information. While it is mainly designed to improve product listings within Google Search, it is now being exploited to send fake orders. For detailed information on the Google StoreBot crawler, see Google's official documentation: https://support.google.com/merchants/answer/13294660  

Why Block the Google StoreBot crawler?

Blocking the Google StoreBot crawler will prevent spammy, and fake orders, improve your website's performance, and protect your business from potential fraud. Note that blocking the bot may temporarily impact how your products are indexed in Google Search, although this can be partly mitigated by having well-structured and accurate product data.

Our Solution: A Targeted Block

To solve this problem, we have applied a custom solution with the personal blocklist by CleanTalk Anti-Spam. In such a way, we targeted the exact user-agent of the Google StoreBot crawler and since then have managed to block fake order creation by this bot.

How to Stop Google StoreBot Crawler from Sending Fake Orders

To enable user-agent blocking in CleanTalk, navigate to WordPress Admin > Settings > Anti-Spam by CleanTalk. From there, go to the Advanced Settings tab. Locate the "Anti-Crawler" option and set it to "On". Once you've made this change, click "Save Changes" to apply the new settings. This will activate the user-agent blocking feature, helping to prevent spam from bots like Google StoreBot.

google storebot crawler spam

1. Choose the type of filter you need to block the Google Store-Crawler — User-Agent.

2. Pick the Google StoreBot crawler from the drop-down list.

Benefits of blocking Google StoreBot crawler:

  • Less spam: Significantly cuts back on spammy fake orders.
  • Better website performance: Cuts load on your servers.
  • Improved security: Protects your business from potential fraud. 

The Outcome

By setting up a targeted block on the Google StoreBot crawler, we've been able to save our clients from spammy fake orders. It's a very simple solution that protects online forms and improves the user experience.

 

Was this information helpful?

It would also be interesting

Copied to clipboard