Crawler
In this section you can find answers to common questions relating to Crawler
-
Update to the robots.txt parser
Mon, 11 Apr, 2022 at 10:56 AM
-
Why are broken links highlighted in relation to the "longdesc" tag?
Mon, 14 Feb, 2022 at 10:05 AM
-
What does "Pending site approval" mean?
Mon, 9 May, 2022 at 2:15 PM
-
Can Siteimprove scan a site built on our website framework?
Mon, 30 May, 2022 at 12:22 PM
-
Adding and replacing credentials for non-public sites
Mon, 23 Sep, 2024 at 7:41 PM
-
The Siteimprove Crawler – Bot Information
Wed, 4 Dec, 2024 at 6:24 PM