robots.txt Generator
Generate a robots.txt file in your browser. No upload, no signup.
robots.txt workspace
Generate a standards-friendly /robots.txt file.
Crawler rules
Sitemaps & AI crawlers
Generated file
Output
1 groups0 disallow1 sitemaps0 warnings
Files are processed in your browser. No data is uploaded.
Questions
What is robots.txt?
robots.txt is a plain-text file at the root of a site (/robots.txt) that tells web crawlers which paths they may or may not request.
Where do I put robots.txt?
Publish it at the root of your domain, for example https://example.com/robots.txt, served as text/plain.
Can robots.txt block AI crawlers?
You can add Disallow rules for known AI user agents like GPTBot and ClaudeBot. Compliant bots honor it, but robots.txt cannot force a crawler to obey.
Does Utilumo upload my input?
No. This tool is designed for local browser processing and does not send your input to a server.
Do I need an account?
No. Utilumo tools are built to work without accounts or sign-in.