User-agent: * Disallow: /wp-login.php Disallow: /wp-admin Disallow: /registration Disallow: /search Disallow: /taxonomy Disallow: /user User-agent: ia_archiver Disallow: /