Buna bir bakın hocam https://kb.yoast.com/kb/crawl-error-url-restricted-by-robots-txt/