User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php User-agent: SiteAuditBot Disallow: /wp-admin/ Crawl-delay: 15 User-agent: SemrushBot Disallow: /wp-admin/ Crawl-delay: 10 Sitemap: https://spottedfoxdigital.com/sitemap_index.xml # End of custom robots.txt rules # #Disallow: /wp-content/plugins/vimeography/lib/shared/assets/