Robots.txt Generator
Creates a robots.txt file from simple options: allow or block all crawlers, disallow specific paths, add a crawl delay and reference your sitemap.
Paths to disallow (one per line, optional)
0 lines
Result
No result yet.
Options
How to use
Creates a robots.txt file from simple options: allow or block all crawlers, disallow specific paths, add a crawl delay and reference your sitemap.
Tip: press “Load sample” to fill the box with realistic example data.
Everything runs locally in your browser — no upload, no account, no API key.