Robots.txt Generator
Build a correct robots.txt with presets for WordPress, shops and staging sites.
noindex meta tag or password protection for pages that must stay private.About the Robots.txt Generator
Choose a preset, adjust the paths you want kept out of search, and copy the finished file. Optional blocks cover AI training crawlers and the aggressive SEO scrapers that eat server resources without sending you visitors.
The sitemap line is added automatically, which is the single most useful thing a robots.txt can do for a new site.
Frequently asked questions
Does robots.txt hide a page from Google?
No. It asks crawlers not to visit, but a blocked page can still appear in results if other sites link to it. Use a noindex meta tag for that.
Where does the file go?
In the root of your domain, so it is reachable at yoursite.com/robots.txt. Anywhere else and it is ignored.
Related tools
All SEO & Web →Meta Tag Generator
Build SEO title, description, Open Graph and Twitter Card tags with live length checks.
Schema Markup Generator
Create JSON-LD structured data for articles, products, FAQs and businesses.
Open Graph Preview
Preview and generate the tags that control how your link looks when shared.
Google SERP Preview
See how your title and description will look in search results.
Keyword Density Checker
Analyse which words and phrases dominate your text, with counts and density percentages.
Favicon Generator
Create every favicon size your site needs from a single image, plus the HTML to link them.