Captain705
New Member
Hello,
I've got many discontinued products on my site and I would like to ask you the best way to tell spiders/crawlers etc. that the pages do not exist anymore.
301 redirect or robot.txt to block these url products from search engines?
Thank you so much If the product pages were heavily advertised and have good number of backlinks, then redirect it to some other related product. Otherwise block it using robots.txt. Hello Dman 2007,
The product pages were not heavily advertised, but they were interlinked (forgot to remove theses links on active pages). I just blocked the pages removed on the robot.txt
Thank you for your answer. Quote: Originally Posted by Natural Elements Hello,
I've got many discontinued products on my site and I would like to ask you the best way to tell spiders/crawlers etc. that the pages do not exist anymore.
301 redirect or robot.txt to block these url products from search engines?
Thank you so much yes robot txt helps...
I've got many discontinued products on my site and I would like to ask you the best way to tell spiders/crawlers etc. that the pages do not exist anymore.
301 redirect or robot.txt to block these url products from search engines?
Thank you so much If the product pages were heavily advertised and have good number of backlinks, then redirect it to some other related product. Otherwise block it using robots.txt. Hello Dman 2007,
The product pages were not heavily advertised, but they were interlinked (forgot to remove theses links on active pages). I just blocked the pages removed on the robot.txt
Thank you for your answer. Quote: Originally Posted by Natural Elements Hello,
I've got many discontinued products on my site and I would like to ask you the best way to tell spiders/crawlers etc. that the pages do not exist anymore.
301 redirect or robot.txt to block these url products from search engines?
Thank you so much yes robot txt helps...