Big Sites Dont Need All Pages on Sitemap

giobuon

New Member
As we know sitemaps are intended to help the bots crawl the site better. For bigger sites listing all the pages could be a nightmare.

I think if we have a nice internal linking structure, we dont need to list all the pages on sitemap-we can just list the major pages.

What you think? Quote: Originally Posted by webcosmo As we know sitemaps are intended to help the bots crawl the site better. For bigger sites listing all the pages could be a nightmare.

I think if we have a nice internal linking structure, we dont need to list all the pages on sitemap-we can just list the major pages.

What you think?

I have large wordpress blog sites and use a sitemap plugin

I have the last 5,000 posts in the sitemaps and category pages, archive pages, etc.

I don't bother with author pages

I'd like to have tag pages in the sitemaps as well - but the plugin always runs out of memory and doesn't complete updating the sitemap - so no tag pages - but I'm planning to tweak some .ini files to allow more memory usage, so maybe one day





I'd also have For big sites, Yes, I don't think they really need to have a sitemap at all. Internal linking can really play a big role for their links to be crawled faster. And most big sites that has a daily updates on their content, indexing is not a problem at all. Quote: Originally Posted by zeruel For big sites, Yes, I don't think they really need to have a sitemap at all. Internal linking can really play a big role for their links to be crawled faster. And most big sites that has a daily updates on their content, indexing is not a problem at all.
I suppose it depends how many new pages per day a big site is creating

I usually create about 100+ new pages a day on my big sites - so I'm not going to take a chance that some of the pages don't get found by search engine bots

Why take the chance, when it's so easy to have an up-to-date sitemap? I have my own site map creator, but I don't really update sitemaps unless I am looking for a search engine to crawl the site, so it tends to happen at milestones.

An up to date sitemap is probably better than one that is not, but in the grand scheme it is fairly minor, so if you do omit some pages it is not the end of the world, in my opinion. Quote: Originally Posted by TechnMist I have my own site map creator, but I don't really update sitemaps unless I am looking for a search engine to crawl the site, so it tends to happen at milestones.

An up to date sitemap is probably better than one that is not, but in the grand scheme it is fairly minor, so if you do omit some pages it is not the end of the world, in my opinion.

I agree with what you're saying

However getting your websites top ranked for many keywords in now a major battle - so you should not miss any trick that will assist you in getting those top rankings

Use every thing you can to grab those top rankings -
 
Back
Top