User-agent: * Disallow: /customeradmin/ Disallow: /sales/ # Disallow any indexing of index.* and index directories Disallow: /index