DarnlySitemap and robots.txt generator
Paste your site and get a sitemap.xml and robots.txt to download, plus a list of broken pages and redirects we found along the way.
Following the links on your site. This can take up to 30 seconds.
sitemap.xml
robots.txt
Where do the files go?
Then open in your browser to check, and add the sitemap in Google Search Console under Sitemaps.
More free tools
How it works
- Paste your site’s address.
- We follow the links on your site the way Google does, up to 100 pages, and skip pages that say they shouldn’t be listed.
- Download sitemap.xml and robots.txt, or copy one prompt that asks Claude Code, Cursor or Codex to add them to your project.
Questions
What is a sitemap?
A sitemap.xml is a list of every page on your site that you want Google and other search engines to find. Without one, they only find pages by following links, so new or rarely linked pages can take weeks to show up.
Where do I put sitemap.xml and robots.txt?
In the folder your site serves from its root, so they open at yoursite.com/sitemap.xml and yoursite.com/robots.txt. That’s public/ in Next.js, Vite, React, Astro and Nuxt, and static/ in SvelteKit. On a plain HTML site, put them next to index.html.
Which pages are left out?
Pages that answer with an error, addresses that redirect somewhere else, pages marked noindex, pages whose canonical tag points to another address, and pages your robots.txt blocks. Each one is listed with the reason, so you can fix it or leave it out on purpose.
Why does it stop at 100 pages?
To keep it quick and gentle on your site. Most new sites have far fewer. If yours has more, ask your AI agent to add the sitemap plugin for your framework, which lists every page on each build. The copied prompt asks for that.
Will this sitemap stay up to date?
No, the file is a snapshot of today. When you add pages, run it again, or use the prompt so your agent sets up a sitemap that rebuilds itself.
Can I use it on a site on localhost?
No. We read your site from the internet, so it needs a public address. Deploy a preview (Vercel, Netlify and Cloudflare all make one), then paste that.