Robots.txt Rule Lister – Keyword Tools
Show user-agent and disallow rules for keyword tools.
Robots.txt Rule Lister – Keyword Tools: How it works
Show user-agent and disallow rules for keyword tools.
This utility belongs to the Keyword Tools collection and performs the Robots.txt Rule Lister task locally.
- Paste the source text or data into the input panel.
- Run the processing step and review the result.
- Download or copy the output if it matches your needs.
Important limitations
This tool analyzes text or source code you supply. It does not remotely crawl arbitrary sites.
Privacy
Your submitted text or media stays in the browser for these tools. Only the normal tool-open analytics event is recorded by the website.