arkadaşlar merhaba bir sitem var smm sitesi ve site map ile robot.txt dosyası yükledim ancak içeriği dogru mu sizlere sormak istedim?
Sizce bu tür bir site için ideal anlamda bu iki dosya türü nasıl olmalıdır?
Sitemdeki blog yazıları vs de indexlemesini istiyorum
Benim dosya içerikleri şöyle
Robot
# robots.txt
User-agent: *
Disallow:
Disallow: /cgi-bin/
Site Map
<?xml version="1.0" encoding="UTF-8"?>
<urlset
xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://www.sitemaps.org/schemas/sitemap/0.9
http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd ">
<!-- created with Free Online Sitemap Generatorwww.xml-sitemaps.com -->
<url>
<loc>https://takipcialsana.com/</loc>
<lastmod>2023-02-20T11:01:19+00:00</lastmod>
<priority>1.00</priority>
</url>
<url>
<loc>https://takipcialsana.com/services</loc>
<lastmod>2023-02-20T11:01:19+00:00</lastmod>
<priority>0.80</priority>
</url>
<url>
<loc>https://takipcialsana.com/register</loc>
<lastmod>2023-02-20T11:01:19+00:00</lastmod>
<priority>0.80</priority>
</url>
<url>
<loc>https://takipcialsana.com/forgot</loc>
<lastmod>2023-02-20T11:01:19+00:00</lastmod>
<priority>0.80</priority>
</url>
<url>
<loc>https://takipcialsana.com/terms</loc>
<lastmod>2023-02-20T11:01:19+00:00</lastmod>
<priority>0.80</priority>
</url>
<url>
<loc>https://takipcialsana.com/contact</loc>
<lastmod>2023-02-20T11:01:19+00:00</lastmod>
<priority>0.80</priority>
</url>
<url>
<loc>https://takipcialsana.com/api</loc>
<lastmod>2023-02-20T11:01:19+00:00</lastmod>
<priority>0.80</priority>
</url>
<url>
<loc>https://takipcialsana.com/blog</loc>
<lastmod>2023-02-20T11:01:19+00:00</lastmod>
<priority>0.80</priority>
</url>
</urlset>
teşekkürler