Robots.txt Generator

Default - All Robots are:	Allowed Refused
Crawl-Delay:	Default - No Delay 5 Seconds 10 Seconds 20 Seconds 60 seconds 120 Seconds
Sitemap: (leave blank if you don't have)
Search Robots:	Google	Same as Default Allowed Refused
	Google Image	Same as Default Allowed Refused
	Google Mobile	Same as Default Allowed Refused
	MSN Search	Same as Default Allowed Refused
	Yahoo	Same as Default Allowed Refused
	Yahoo MM	Same as Default Allowed Refused
	Yahoo Blogs	Same as Default Allowed Refused
	Ask/Teoma	Same as Default Allowed Refused
	GigaBlast	Same as Default Allowed Refused
	DMOZ Checker	Same as Default Allowed Refused
	Nutch	Same as Default Allowed Refused
	Alexa/Wayback	Same as Default Allowed Refused
	Baidu	Same as Default Allowed Refused
	Naver	Same as Default Allowed Refused
	MSN PicSearch	Same as Default Allowed Refused
Restricted Directories:	The path is relative to root and must contain a trailing slash "/"

Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.

About Robots.txt Generator

This Robots.txt Generator Tool developed by SEO Analysis will help you effortlessly generate quality robot.txt items. Once you enter your website details into the boxes above, this tool will allow you to quickly create a list of robot.txt items relevant for your website. These robot.txt items should then be used on your website to advance your SEO efforts.

Now that you know have successfully used the Robots.txt Generator Tool, learn more about the importance of keyword positioning and how it relates to your SEO efforts with our partners.

Make sure to also explore the many other tools developed by SEO Analysis to capitalize on leveraging our product offerings for your SEO efforts. Discover more with SEO Analysis and partners.