Filtration by User-Agents in the Anti-Crawler Option

The Anti-Spam plugin for WordPress allows you to filter bot access to your site by User-Agent. To enable this feature, open your Anti-Spam plugin settings:

WordPress Dashboard → Settings → Anti-Spam by CleanTalk → Advanced settings

And enable the SpamFireWall and Anti-Crawler options:

You can learn about how these options work here: CleanTalk Anti-Flood and Anti-Crawler Options.

There is a comprehensive list of trusted User-Agents in our service, whose requests will not be blocked by Anti-Crawler. If you want to block access to the site for any of them, you can add them to your personal blocklists.

To do this, click "Add New Filter" on the SpamFireWall personal lists page and select the User-Agent type. Then select an user-agent from the drop-down list and block it:

The information should be automatically transferred to the plugin within a few minutes. If this doesn't happen within 20 minutes, please go to the plugin settings and click "Synchronize with the Cloud." In any case, the plugin synchronizes its databases itself once every 24 hours.

Now all requests with a prohibited User-agent will be blocked from the first visit to the site.

Important! It is not possible to block or allow User-Agents that are not on this list.

If you want to add any User-Agent to the list of allowed ones, or if you haven't found the answer to your question, don't hesitate to get in touch with our support team:

https://cleantalk.org/my/support/open