Free tools

llms.txt generator for AI search

Paste your site and get an llms.txt that tells ChatGPT, Claude and Perplexity what your site is about, plus which AI crawlers your robots.txt lets in.

Free from Darnly. Spot a bug in the app you're building? Darnly hands it to Claude Code, Codex or Cursor in one key.Add to Chrome

llms.txtExample

More free tools

See all 89 tools

How it works

  1. Paste your site’s address.
  2. We read up to 50 of your pages and take each one’s title and description, then check your robots.txt for AI crawlers.
  3. Edit the name and summary if you like, then download llms.txt or copy one prompt that asks Claude Code, Cursor or Codex to add it.

Questions

What is llms.txt?

A plain text file at yoursite.com/llms.txt that tells AI tools what your site is and links to its main pages, each with one line about it. It’s like a sitemap written for ChatGPT, Claude and Perplexity instead of Google. The format is described at llmstxt.org.

Does llms.txt help my site show up in AI answers?

It can help AI tools that read it understand your site and link to the right page, and it costs nothing to add. No AI company has promised to rank sites by it, so think of it as a cheap extra, not a replacement for clear pages and good titles.

Where do I put llms.txt?

In the folder your site serves from its root, so it opens at yoursite.com/llms.txt. That’s public/ in Next.js, Vite, React, Astro and Nuxt, and static/ in SvelteKit. On a plain HTML site, put it next to index.html.

What do “allowed” and “blocked” mean for AI crawlers?

Your robots.txt file can tell each crawler to stay out. GPTBot (OpenAI), ClaudeBot (Anthropic), PerplexityBot, Google-Extended (Gemini) and CCBot (Common Crawl) all follow it. Blocked means that crawler won’t read your pages, so its AI is less likely to know about your site. Each card gives you a rule to copy if you want to change it.

Does blocking Google-Extended remove me from Google Search?

No. Google-Extended only controls whether Google uses your pages for Gemini. Google Search uses Googlebot, which this tool doesn’t change.

Why are some pages listed without a description?

We use each page’s meta description, or its first paragraph if it has none. Pages with neither are listed by title only. Adding a meta description helps search engines too.

Can I use it on a site on localhost?

No. We read your site from the internet, so it needs a public address. Deploy a preview (Vercel, Netlify and Cloudflare all make one), then paste that.