User-Agent: * Disallow: /
Bu kodu robots.txt içine koyma hariç ne yapmalıyım ?
Tüm İndexleri Silme |
4 Mesajlar | 844 Okunma |
User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /xmlrpc.php
Disallow: /recommended/
Disallow: /comments/feed/
Disallow: /trackback/
Disallow: /wp-content/plugins/
User-agent: NinjaBot
Allow: /
User-agent: Mediapartners-Google*
Allow: /
User-agent: Googlebot-Image
Allow: /wp-content/uploads/
User-agent: Adsbot-Google
Allow: /
User-agent: Googlebot-Mobile
Allow: /
Sitemap: http://domain/sitemap.xml
sitemap: http://www.domain/sitemap-image.xml