# Disallow all crawlers access to certain pages. User-agent: * Disallow: /wp-admin Disallow: /wp-content Disallow: /wp-includes Disallow: /cgi-bin # Sitemap files Sitemap: http://www.alldiscountfragrances.us/sitemap.xml Sitemap: http://www.alldiscountfragrances.us/sitemap.xml.gz