User-agent: * sitemap: sitemapxml.php # directory Disallow: /classes/ Disallow: /ctpanel/ Disallow: /customer/ Disallow: /include/ # file