When I added Google Sitemap to our site, and checked on Webmaster Tools section, the Web Crawl report showed several "URLs restricted by robots.txt" including index page. Our robots.txt file has only following lines. User-agent: * Disallow: Since then, I have removed Sitemap fearing problems with Google search results. What could be the reason for this? For your information, we do have some 301 redirect pages, and sitemap was showing old as well as new urls. Please guide me, so that I can generate a correct Google sitemap and add to my site. URL of our site http://www.lth-hotels.comThanks in advance....You do not need robots.txt unless you want to exclude pages.You do not need a XML sitemap becuase there is no benefit to be had other than to possibly reduce your server bandwith costs and I do not think the site has high enough traffic for that.
Google Sitemap
- Thread starter DUde001
- Start date