User-Agent: * Allow: /wp-content/uploads/ Disallow: /wp-admin/ Disallow: /readme.html Disallow: /refer/ Disallow: /feed/ Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /trackback/ Disallow: /xmlrpc.php Sitemap: https://emporiumtreatments.co.uk/page-sitemap.xml Sitemap: https://emporiumtreatments.co.uk/post-sitemap.xml Sitemap: https://emporiumtreatments.co.uk/post_tag-sitemap.xml Sitemap: https://emporiumtreatments.co.uk/category-sitemap.xml Sitemap: https://emporiumtreatments.co.uk/product_cat-sitemap.xml Sitemap: https://emporiumtreatments.co.uk/product-sitemap.xml # Ban bots that don't benefit us. # -------------------------------- User-agent: Nuclei User-agent: WikiDo User-agent: Riddler User-agent: PetalBot User-agent: Zoominfobot User-agent: Go-http-client User-agent: Node/simplecrawler User-agent: CazoodleBot User-agent: dotbot/1.0 User-agent: dotbot/1.5 User-agent: dotbot/1.2 User-agent: dotbot User-agent: Gigabot User-agent: Barkrowler User-agent: BLEXBot User-agent: ClaudeBot/1.0 User-agent: magpie-crawler User-agent: CCBot User-agent: wpscan User-agent: CCBot User-agent: GPTBot User-agent: Bytespider User-agent: Sogou web spider User-agent: Baiduspider Disallow: / # Delay Bots that may slow down site. # -------------------------------- User-agent: ClaudeBot Crawl-delay: 20 User-agent: Claude-SearchBot Crawl-delay: 30 User-agent: GPTBot Crawl-delay: 25 User-agent: GPTBot Crawl-delay: 18 User-agent: AhrefsBot Crawl-delay: 20 User-agent: SemrushBot Crawl-delay: 20