A Robots.txt Generator allows you to create a Robots.txt file without requiring knowledge of the Robot Exclusion Standard. It is a simple text form that allows you to select which directories & files you want to be hidden from search engine robots and which directories & files you want them to index.
This can be a great time saver for webmasters who have a large site and don't want to spend hours writing out the Robots.txt file from scratch. Instead, you can use one of these free tools to create your Robots.txt file in a matter of minutes.
Remember that your robots.txt file tells search engines what pages on your website to crawl and what pages not to crawl. The more pages you tell search engines not to crawl, the less effective the exposure of your website will be.