Builds a robots.txt file with user-agent groups, Allow/Disallow rules, comments, and sitemaps, with safe presets, or paste an existing file to analyze it. Includes a checker that shows whether a specific path is allowed or blocked for a given user-agent, with the matching rule and group. robots.txt controls crawling, but it doesn't protect private content or guarantee a URL disappears from search engines.
Sitemaps
Path checker
✓ Allowed
The most specific matching rule is "Allow: /" from the group for "*".
robots.txt controls crawling, but it doesn't protect private content or guarantee a URL disappears from search engines.
The data is processed on your device and is never sent to the server.