User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /download/ Disallow: */feed Disallow: */feed$ Disallow: /feed/$ Disallow: /comments/feed Disallow: /?feed= Disallow: /wp-feed User-agent: Googlebot-Image Disallow: User-agent: PetalBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: CCBot Disallow: / User-agent: GPTBot Disallow: /