I have a site with 6 php includes. header,footer,right menu, left menu, sales menu, content. Sometimes more for a special menu.<br /><br /><b>Do I need a robots.txt in every .php include for it to be effective?</b> I don't necessarily want the robot crawling all of my headers if my bandwidth is suffering from anything unecessary.<br /><br />I'm doing a php include of a robots.txt file so that way I can universally update it across the platform.<br /><br /><br />Yeah, maybe nobody should have clued me in on the basics of php. Even though I haven't started programming as a programmer would, the doors have been opened and I'm using this knowledge everyday.<br /><br /><b><br />Is 6 php includes for a robots.txt file in every include overkill, or smart use?</b><br />I understand it's open to interpretation and I highly value your opinions.<br /><br /><br /><br />If anyone else is doing something similar, it would be fun to hear what you're up to;definitely participate.<!--content-->
I'd suggest just putting one robots.txt file in the root folder (public_html directory) of your account ( and in subdomains, if you have subdomains)<!--content-->
<img src="http://www.totalchoicehosting.com/forums/style_emoticons/default/thumbup1.gif" style="vertical-align:middle" emoid=":thumbup1:" border="0" alt="thumbup1.gif" /> <br /><b>Thanks!</b><br /><br />That saved me a world of wonder and missteps...<!--content-->
An hour later, that makes so much sense... thinking how a spider works, crawling through the directory.<br /><br />As a new programmer and designer with so much on my mind getting my pages up as fast as possible it's easy to not see the forest for the trees.<br /> <img src="http://www.totalchoicehosting.com/forums/style_emoticons/default/notworthy.gif" style="vertical-align:middle" emoid=":notworthy:" border="0" alt="notworthy.gif" /> <br /><!--content-->
I'd suggest just putting one robots.txt file in the root folder (public_html directory) of your account ( and in subdomains, if you have subdomains)<!--content-->
<img src="http://www.totalchoicehosting.com/forums/style_emoticons/default/thumbup1.gif" style="vertical-align:middle" emoid=":thumbup1:" border="0" alt="thumbup1.gif" /> <br /><b>Thanks!</b><br /><br />That saved me a world of wonder and missteps...<!--content-->
An hour later, that makes so much sense... thinking how a spider works, crawling through the directory.<br /><br />As a new programmer and designer with so much on my mind getting my pages up as fast as possible it's easy to not see the forest for the trees.<br /> <img src="http://www.totalchoicehosting.com/forums/style_emoticons/default/notworthy.gif" style="vertical-align:middle" emoid=":notworthy:" border="0" alt="notworthy.gif" /> <br /><!--content-->