Start at your homepage
The crawler follows links it finds on pages from the same website.
Crawl a public website’s internal links and create an XML sitemap you can download. Set a page limit to keep the crawl focused.
Preparing crawl…
Discovered URLs will appear here.
The crawler follows links it finds on pages from the same website.
Progress shows pages as they are checked. Redirects and inaccessible pages are skipped.
Save the sitemap and upload it to your website, then submit its URL in Google Search Console.
Browsers block many cross-site page requests. The companion snippet makes requests from your WordPress server and safely limits each crawl to the requested public host.
It finds pages reachable through internal links from the starting page, up to your page limit. Orphan pages and pages blocked by the site cannot be discovered this way.
No. The crawler cannot reliably know when every page was last changed, so it leaves that optional field out instead of inserting misleading dates.
The crawl reports the pages it could read. It does not add simulated or guessed URLs.
Get a free SEO audit with practical recommendations for your site.
Request a free SEO audit