robots.txt Generator
Generate effective robots.txt files that help ensure Google and other search engines are crawling and indexing your site properly.
By default all robots are
Crawl delay
Enter the Sitemap URL. Leave blank for none.
Restricted directories or files. Relative to root, with trailing slash for dirs.
Your Robots.txt
Subscribe to:
Posts (Atom)