A robots.txt file tells search engines like Google which parts of your site they may crawl and which to skip. A wrong rule can quietly hide your whole site from search, so getting it right matters. This free robots.txt generator builds a clean, valid file for you — pick a preset for Blogger, WordPress or a custom site, add your sitemap, choose what to block, and copy the result.
No signup, nothing installed — everything runs in your browser.
Why use this robots.txt generator?
Valid every time
Correct syntax and directive order, so crawlers actually understand it.
Blogger-ready
A tested preset for Blogger blogs, plus WordPress and custom-site presets.
Sitemap included
Adds your sitemap URL so search engines discover every page faster.
100% private
Runs fully in your browser — your inputs never leave your device.
How to use it
- Choose your platform preset (Blogger, WordPress or Custom).
- Enter your full sitemap URL (e.g. https://yourdomain.com/sitemap.xml).
- Add any folders or pages you want to block, one per line.
- Optionally set a crawl-delay for aggressive bots.
- Click Generate, then Copy — paste it into your site’s robots.txt (root folder or Blogger Settings → Crawlers and indexing).
Popular use cases
- Bloggers who want to allow Google but block search/label pages.
- New websites setting up crawl rules for the first time.
- Agencies preparing robots.txt for client sites quickly.
- Anyone who accidentally blocked their site and needs a clean file.
Frequently asked questions
Where do I put the robots.txt file?
On a normal website it goes in the root folder so it is reachable at yourdomain.com/robots.txt. On Blogger, paste it under Settings → Crawlers and indexing → Custom robots.txt.
Will this hide my site from Google?
Only if you choose to block pages. The default presets allow search engines to crawl your public content and just point them to your sitemap.
Is a custom robots.txt needed for Blogger?
Blogger ships a default one, but a custom robots.txt lets you block low-value pages (search, labels) and add your sitemap for better crawling.
Is this tool free?
Yes, completely free with no signup and no limits.
Want this done for you?
We build fast, SEO-ready websites and run digital marketing for businesses across Noida & Delhi NCR.