User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-admin Disallow: /wp-includes User-agent: ia_archiver Disallow: /