Envrobots is a flexible robots.txt solution for Rails to use different robots.txt files depending on the environment.

Add envrobots to your Gemfile and run the bundle command.

rails g envrobots:install

Envrobots generates two robots.txt files, one for production and one for other environments. By default robots.production.txt will allow robots to crawl your site and robots.other.txt will prevent robots from crawling.

• fix specs