Crawl any domain to find sitemap indexes, follow nested sitemap files, and map the complete structure with URL counts and download options.
A sitemap crawler automatically discovers and processes all XML sitemaps on a domain. It checks the robots.txt file for sitemap declarations and probes common sitemap paths like /sitemap.xml and /sitemap_index.xml.
For each discovered sitemap, the crawler counts the number of URLs it contains. This tree view helps you understand how a website organizes its content across multiple sitemaps — useful for SEO audits and competitive analysis.
We check robots.txt and probe common paths to find every sitemap on the domain.
We fetch and parse each discovered sitemap, counting the URLs it contains and following any sitemap index references.
We present a tree view showing each sitemap with its URL count, plus aggregate totals and download options.
Continue your sitemap audit with the next tool in your workflow.
A sitemap crawler discovers all sitemaps on a domain by checking robots.txt and common sitemap paths, then crawls each sitemap to count the URLs it contains. This gives you a complete overview of a site's sitemap structure.
A sitemap finder discovers which sitemaps exist on a domain. The sitemap crawler goes further — it processes each discovered sitemap and reports per-sitemap URL counts, giving you a tree view of the entire sitemap structure.
Yes. You can download the sitemap tree as a CSV file (with URL counts per sitemap), a plain text file (sitemap URLs only), or a JSON file with the complete data.
The tool processes up to 50 sitemaps per domain and extracts up to 5,000 URLs per sitemap for counting purposes. For larger sites, sign up for a free API key.
Need full sitemap data at scale?
Get a free API key to discover and extract all URLs from any domain. 100 requests/month included.