# for an installation in a subdirectory, you have to copy this file in your root of your domain and add /subdir/ on each line User-agent: * Crawl-Delay: 30 Disallow: /includes/ Disallow: /download/ Disallow: /data/ Disallow: /cgi-bin/ Disallow: /img/ Disallow: /sm