Adding a Robots File for Search Engines

Please note:
Older versions of this FAQ suggest disallowing the /images/ folder. It has been brought to our attention that this can hurt rankings. Please do not include the /images/ folder in your statements.

A robots file is used by search engines to help them identify which folders and files to scan and which to ignore. In version 2.72 and higher, there is no robots file to disallow certain folders and files. However, you can add one yourself fairly easily.

  1. Create a file called robots.txt.

  2. In that file, add the following code:

    User-agent: *
    Disallow: /enc/
    Disallow: /go/email.php
    Disallow: /go/finish.php
    Disallow: /go/iframe.php
    Disallow: /go/order.php
    Disallow: /go/popup.php
    Disallow: /go/view.php
    Disallow: /secure/
    Disallow: /storeadmin/
    Disallow: /template/
    
  3. Save and upload the file into the main public directory of the site.

Important! Please contact an SEO specialist to determine if using a robots file is helpful for your site. The above information will simply show you how to create the file; it's up to you to decide if it works for your particular situation.