User-agent: * Crawl-Delay: 2 User-agent: AhrefsBot Crawl-Delay: 8 Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /wp-content/plugins/ Disallow: /wp-content/themes/ Disallow: /community/addpost/* Disallow: /community/addpost/ Disallow: /community/members/ Disallow: /community/profile/ Disallow: /community/subscriptions/ Disallow: /comment-subscriptions/ User-agent: NetcraftSurveyAgent Disallow: / User-agent: FunWebProducts Disallow: / Allow: /wp-admin/admin-ajax.php Sitemap: https://nastycomics.eu/sitemap.xml