User-agent: * Disallow: /admin.php Disallow: /auth.php Disallow: /dir/ Disallow: /w3a/