Google forum sitemdeki url leri bu şekilde indexlemiş.
http://www.wpfrm.com/u-nullsix-28.html/faq.php
http://www.wpfrm.com/u-nesim-1.html/f-wp.../f-wordpress-temalari-8/
http://www.wpfrm.com/u-heysohbet-16.html/sendmessage.php
http://www.wpfrm.com/u-goldbut-13.html/f-wp.../f-wp-kodlari-3/
.html den sonra bir klasör şeklinde yapıyor?
doğru url:
www.wpfrm.com/u-nullsix-28.html
www.wpfrm.com/u-nesim-1.html
www.wpfrm.com/u-heysohbet-16.html
www.wpfrm.com/u-goldbut-13.html
Bu .html/ den sonraki url leri engellemek için robots.txt veya .htaccess dosyasıyle bir engel koyabilirmyiz?
http://www.wpfrm.com/u-nullsix-28.html/faq.php
http://www.wpfrm.com/u-nesim-1.html/f-wp.../f-wordpress-temalari-8/
http://www.wpfrm.com/u-heysohbet-16.html/sendmessage.php
http://www.wpfrm.com/u-goldbut-13.html/f-wp.../f-wp-kodlari-3/
.html den sonra bir klasör şeklinde yapıyor?
doğru url:
www.wpfrm.com/u-nullsix-28.html
www.wpfrm.com/u-nesim-1.html
www.wpfrm.com/u-heysohbet-16.html
www.wpfrm.com/u-goldbut-13.html
Bu .html/ den sonraki url leri engellemek için robots.txt veya .htaccess dosyasıyle bir engel koyabilirmyiz?
hocam bunu robots.txt ile yapmak mümkün
http://www.mcanerin.com/en/search-engine/robots-txt.asp
yukarıdaki adresten yapabilirsin yada aşağıdaki kodu robots.txt'ye kaydet ftpye yolla
User-agent: *
Disallow: /admincp/
Disallow: /ajax.php
Disallow: /clientscript/
Disallow: /cpstyles/
Disallow: /images/
Disallow: /includes/
Disallow: /install/
Disallow: /modcp/
Disallow: /subscriptions/
Disallow: /customavatars/
Disallow: /customprofilepics/
Disallow: /announcement.php
Disallow: /attachment.php
Disallow: /calendar.php
Disallow: /cron.php
Disallow: /editpost.php
Disallow: /faq.php
Disallow: /frm_attach
Disallow: /image.php
Disallow: /inlinemod.php
Disallow: /joinrequests.php
Disallow: /login.php
Disallow: /memberlist.php
Disallow: /misc.php
Disallow: /moderator.php
Disallow: /newattachment.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /online.php
Disallow: /payment_gateway.php
Disallow: /payments.php
Disallow: /poll.php
Disallow: /postings.php
Disallow: /private.php
Disallow: /profile.php
Disallow: /register.php
Disallow: /report.php
Disallow: /reputation.php
Disallow: /search.php
Disallow: /sendmessage.php
Disallow: /showgroups.php
Disallow: /showpost.php
Disallow: /subscription.php
Disallow: /usercp.php
Disallow: /threadrate.php
Disallow: /usernote.php