Skip to main content

Add TrustedSite crawler to allowlist

Written by Nick Hemenway

The TrustedSite crawler is used for the Diagnostics, Search Submission, and website certification services.

You may need to add the following User-Agent to your Intrusion Protection System allowlist or whitelist if you experience issues with incomplete crawls.

Mozilla/5.0 (compatible; TrustedSite/1.0; +http://www.trustedsite.com/crawler)
Did this answer your question?