Google Spiders half the site... www.earborist.com

burak101

New Member
Hi All,I wonder if any one can offer advice. We have a site http://www.earborist.com and am having troubloe getting google to spider the whole site. at present pages...http://www.earborist.com/about.phphttp://www.earborist.com/help.phphttp://www.earborist.com/multitip.phpare being spidered almost every day, but our adverts (you can see them if you use the search button) and our home page http://www.earborist.com are very rarely being visited.I assumed that if the bot was on my site it would index the whole site. Can anyone help?Why doesn't google like me Have you tried using a robot.txt file?curious, cause I have a similar problem. What does a robot.txt file do.a robot.txt simply tells which pages the spider can visit and it can also block certain spiders from entering yr site..(in short)It also takes a while for your home page to be indexed by google. how old is your site? it doesnt look new.perhaps a signature in ozzu will create some more activity to yr site... Would this meta tag be the problem? <META NAME="robots" CONTENT="FOLLOW,INDEX"> shouldnt it be <META NAME="robots" CONTENT="INDEX,FOLLOW"> cos by the looks of it its following links but no indexing them.http://www.infocopter.com/know-how/robots.htmIndeed it should
 
Back
Top