Crawl Errors: Crawler Blocked by Authentication or Login Requirements

Issue / Question

You are receiving the following errors: 

• HTTP 401 Unauthorized
• Authentication failure

Environment (If Applicable)

Specify the conditions where the issue occurs:

• Product version: Siteimprove (all supported versions)
• Platform / OS / Browser: Platform‑independent (issue occurs at the site configuration and crawl level, not browser‑specific)
• User role / permissions:  Account Owners
• Preconditions: 

Solutions

If you are seeing a HTTP 401 Unauthorized error

• Test the index URL in an incognito browser. If login is required, add or update credentials by using the options listed under the How to fix this dropdown menu in the Site summary panel under Manage sites. If blocked by CDN/firewall, IT or hosting must fix the issue outside the platform.

If you are seeing an Authentication failure error

• Verify that the login credentials are correct. Account Owners can update credentials by using the options listed under the How to fix this dropdown menu in the Site summary panel under Manage sites. If the login method has changed, contact Customer Support.

Cause

The root cause of these issues is the authentication and/or login failures.

Additional Information

• Related errors or messages: N/A
• Known limitations: N/A
• Configuration notes: N/A