{{ template "head" . }}

Add Project

Full project URL including http:// or https:// {{ if .Data.Error }}

The URL is not valid.

{{ end }}
Ignore robots.txt
If checked the crawler will bypass any restriction you have set in your robots file.
Follow nofollow internal links
If checked the crawler will ignore the nofollow attribute in links and robots meta tag.
Include noindex pages in the report
If checked the pages with the noindex attribute will also be included in the report.
Crawl sitemap
If checked the URLs in the sitemap.xml will also be crawled.
Allow subdomains
If checked the crawler will also crawl URLs from subdomains.
Check External Links
If checked the crawler will look for broken external links.
Create WACZ archive
If checked a WACZ archive will be created and available as an export option.
Use HTTP Basic Authentication
Check this option if your site is password protected with HTTP Basic Auth.
or cancel.
{{ template "footer" . }}