robots.txt Generator
Create a robots.txt for your site.
About robots.txt Generator
Generate a correct robots.txt file for your website — allow everything, block everything, or disallow specific paths — and include your sitemap URL for search engines.
- 1Choose a crawl policy.
- 2Add any disallowed paths and your sitemap.
- 3Copy the robots.txt.
FAQ
Where do I put robots.txt?
At the root of your domain, e.g. https://example.com/robots.txt.