robots.txt Generator
Generate a robots.txt file in your browser. No upload, no signup.
robots.txt workspace
Generate a standards-friendly /robots.txt file.
Crawler rules
Sitemaps & AI crawlers
Generated file
Output
Questions
What is robots.txt?
robots.txt is a plain-text file at the root of a site (/robots.txt) that tells web crawlers which paths they may or may not request.
Where do I put robots.txt?
Publish it at the root of your domain, for example https://example.com/robots.txt, served as text/plain.
Can robots.txt block AI crawlers?
You can add Disallow rules for known AI user agents like GPTBot and ClaudeBot. Compliant bots honor it, but robots.txt cannot force a crawler to obey.
Does Utilumo upload my input?
No. Utilumo has no backend that could receive your input. Where a tool makes a request as part of its function, it goes directly from your browser to the destination you choose, never through Utilumo.
Do I need an account?
No. Utilumo tools are built to work without accounts or sign-in.