Robots.txt Generator: Free Online Tool
Generate a valid robots.txt file that tells search engine crawlers which parts of your site to skip. Add the folders you want to block and your sitemap address, then copy the result.
Use the Robots.txt Generator
How to use the Robots.txt Generator
- List each path to block, one per line, such as /admin/.
- Add your sitemap URL.
- Save the output as robots.txt in your site's root folder.
About this robots.txt generator
The robots.txt file sits at the root of your domain, for example example.com/robots.txt. It asks crawlers not to visit certain areas such as admin or cart pages. It is not a security tool, and blocked URLs can still appear in search if other sites link to them. Never block your CSS or JavaScript files, and test the file in Google Search Console after you upload it. Including your sitemap line helps crawlers find your pages faster.
Robots.txt Generator FAQ
Does robots.txt hide pages from Google?
Not reliably. Use a noindex tag to keep a page out of search results.
Where does the file go?
In the top-level folder of your site, so it loads at /robots.txt.