My site's URL is: http://www.dirtydozensbunker.com/index.php
I am running a forum, using vBulletin. I have made the General Discussion area viewable only to logged in members. That is this area: http://www.dirtydozensbunker.com/forumdisplay.php?f=3
However, all of the threads which were previously posted still show up in Google's cache. I am wanting to delete all of them from Google's cache.
Yesterday, I used Google's webmaster tools to generate a robots.txt to stop robots from crawling that part of my forum. (I did upload that robots.txt to the appropriate place on the server).
Then on the Crawler Access page of Webmaster Tools I told Google to remove the URL of that part of my forum (http://www.dirtydozensbunker.com/forumdisplay.php?f=3)
This morning, I checked, and I found that Google reported that they removed that URL.
But, I checked, and I see that that directory of my forum is still in cache.
After reading further, I see that I have to write a Meta Tag to remove the cache. I'm only semi-literate in this kind of stuff. And I can't figure that out.
Could someone write a Meta Tag that would cause Google to remove the cache for the directory that I'm wanting to remove? And Tell me where I should put it.
I've posted this question a couple other places, but I haven't received a reply. I thought maybe the people here might help me.
Thanks much. Looks like you are in a bit of a pickle.
The only way to control how a search engine caches your pages is through <META HTTP-EQUIV="CACHE-CONTROL" CONTENT="NO-CACHE">
However, once the search engine has cached your page, it is hard to get it removed.
What would be better is to allow the search engine to crawl that page again (by removing your robots.txt block) and make sure that page has the no-cache tag.
That might then remove the cache from Google. OK, thanks. I'll give that a try. Hi, Pogo
I would like to suggest below steps:
1. delete the un-wanted directory
2. regenerate a sitemap
3. re-submit your new sitemap to search engines via your webmaster account on them
Wish this help, Example meta tag http-equiv="cache-control"
Add the following meta tag in the source of your web-page. The difference in spelling at the end of the tag is either you use " /> = xml or "> = html.
<meta http-equiv="Cache-control" content="no-cache"><meta http-equiv="Cache-control" content="no-store">
You may add this Cache-control meta tag to all of your web-pages, so not only in the first index page. Make sure that on every page relevant meta tags are added. Add keywords and phrases that are relevant and correspond to the text and the language on that specific page. It might be a lot of work to add specific meta tags to each page but you will notice in time that it works! Thanks, I'll try those suggestions and see if they accomplish what I want. My forum is a vBulletin one. In the styles and templates, I've added the following:
<meta name="robots" content="noarchive">
<meta name="robots" content+"noarchive">
<meta name="robots" content="noindex">
<meta http-equiv="pragma" content="no-cache">
<meta http-equiv="Cache-control" content="no-cache">
<meta http-equiv="Cache-control" content="no-store">
Am I being redundent by adding all of those tags? Are there any of them causing a conflict?
And using Google's webmaster tools, I've used the URL tool to remove certain threads.
Is that correct? Also, if it is, about how long does it take for google to remove that cached page?
Thanks Quote: Originally Posted by Pogo My forum is a vBulletin one. In the styles and templates, I've added the following:
...
Thanks Moved your related question to this thread. Let's keep the conversation in one spot so you don't get repeat answers.
HTMLBasicTutor
Moderator Quote: Originally Posted by Pogo My forum is a vBulletin one. In the styles and templates, I've added the following:
<meta name="robots" content="noarchive">
<meta name="robots" content+"noarchive">
<meta name="robots" content="noindex">
<meta http-equiv="pragma" content="no-cache">
<meta http-equiv="Cache-control" content="no-cache">
<meta http-equiv="Cache-control" content="no-store">
Am I being redundent by adding all of those tags? Are there any of them causing a conflict?
And using Google's webmaster tools, I've used the URL tool to remove certain threads.
Is that correct? Also, if it is, about how long does it take for google to remove that cached page?
Thanks I would remove second line, I would write <meta name="robots" content="noindex, nofollow">.
You can do it as well by robots.txt - which is more easy.
User-agent: *
Disallow: /temp/ # these will soon disappear
Disallow: /foo.html User-agent: *
Disallow: /temp/ # This is where the URL goes?
Disallow: /foo.html
If so, should there be a space between the /temp/ and the #?
Thanks User-agent: * # * means different bots (Google bot, Yahoo etc.)
Disallow: /temp/ # (temp = folder) blocks a directory and everything in it
Disallow: /foo.html # blocks a page. Let me write it down again so it will be more easy for you.(Note* this is an example only)
User-agent: *
Disallow: /temp/
Disallow: /images/
Disallow: /css/
Disallow: /admin/
Disallow: /foo.html
Disallow: /contact.html
Disallow: /contact.php
Disallow: /about.html
----------------------------------------------------------
blocks the entire site
User-agent: *
Disallow: / And if I put those lines in the robots.txt and use the Google URL remover, the URLs I remove will go away? Is that correct?
That helps a lot thanks. The code in robots.txt will block folders and pages from crawling and indexing by search engine bots. Kewl. Thanks You are welcome.
I am running a forum, using vBulletin. I have made the General Discussion area viewable only to logged in members. That is this area: http://www.dirtydozensbunker.com/forumdisplay.php?f=3
However, all of the threads which were previously posted still show up in Google's cache. I am wanting to delete all of them from Google's cache.
Yesterday, I used Google's webmaster tools to generate a robots.txt to stop robots from crawling that part of my forum. (I did upload that robots.txt to the appropriate place on the server).
Then on the Crawler Access page of Webmaster Tools I told Google to remove the URL of that part of my forum (http://www.dirtydozensbunker.com/forumdisplay.php?f=3)
This morning, I checked, and I found that Google reported that they removed that URL.
But, I checked, and I see that that directory of my forum is still in cache.
After reading further, I see that I have to write a Meta Tag to remove the cache. I'm only semi-literate in this kind of stuff. And I can't figure that out.
Could someone write a Meta Tag that would cause Google to remove the cache for the directory that I'm wanting to remove? And Tell me where I should put it.
I've posted this question a couple other places, but I haven't received a reply. I thought maybe the people here might help me.
Thanks much. Looks like you are in a bit of a pickle.
The only way to control how a search engine caches your pages is through <META HTTP-EQUIV="CACHE-CONTROL" CONTENT="NO-CACHE">
However, once the search engine has cached your page, it is hard to get it removed.
What would be better is to allow the search engine to crawl that page again (by removing your robots.txt block) and make sure that page has the no-cache tag.
That might then remove the cache from Google. OK, thanks. I'll give that a try. Hi, Pogo
I would like to suggest below steps:
1. delete the un-wanted directory
2. regenerate a sitemap
3. re-submit your new sitemap to search engines via your webmaster account on them
Wish this help, Example meta tag http-equiv="cache-control"
Add the following meta tag in the source of your web-page. The difference in spelling at the end of the tag is either you use " /> = xml or "> = html.
<meta http-equiv="Cache-control" content="no-cache"><meta http-equiv="Cache-control" content="no-store">
You may add this Cache-control meta tag to all of your web-pages, so not only in the first index page. Make sure that on every page relevant meta tags are added. Add keywords and phrases that are relevant and correspond to the text and the language on that specific page. It might be a lot of work to add specific meta tags to each page but you will notice in time that it works! Thanks, I'll try those suggestions and see if they accomplish what I want. My forum is a vBulletin one. In the styles and templates, I've added the following:
<meta name="robots" content="noarchive">
<meta name="robots" content+"noarchive">
<meta name="robots" content="noindex">
<meta http-equiv="pragma" content="no-cache">
<meta http-equiv="Cache-control" content="no-cache">
<meta http-equiv="Cache-control" content="no-store">
Am I being redundent by adding all of those tags? Are there any of them causing a conflict?
And using Google's webmaster tools, I've used the URL tool to remove certain threads.
Is that correct? Also, if it is, about how long does it take for google to remove that cached page?
Thanks Quote: Originally Posted by Pogo My forum is a vBulletin one. In the styles and templates, I've added the following:
...
Thanks Moved your related question to this thread. Let's keep the conversation in one spot so you don't get repeat answers.
HTMLBasicTutor
Moderator Quote: Originally Posted by Pogo My forum is a vBulletin one. In the styles and templates, I've added the following:
<meta name="robots" content="noarchive">
<meta name="robots" content+"noarchive">
<meta name="robots" content="noindex">
<meta http-equiv="pragma" content="no-cache">
<meta http-equiv="Cache-control" content="no-cache">
<meta http-equiv="Cache-control" content="no-store">
Am I being redundent by adding all of those tags? Are there any of them causing a conflict?
And using Google's webmaster tools, I've used the URL tool to remove certain threads.
Is that correct? Also, if it is, about how long does it take for google to remove that cached page?
Thanks I would remove second line, I would write <meta name="robots" content="noindex, nofollow">.
You can do it as well by robots.txt - which is more easy.
User-agent: *
Disallow: /temp/ # these will soon disappear
Disallow: /foo.html User-agent: *
Disallow: /temp/ # This is where the URL goes?
Disallow: /foo.html
If so, should there be a space between the /temp/ and the #?
Thanks User-agent: * # * means different bots (Google bot, Yahoo etc.)
Disallow: /temp/ # (temp = folder) blocks a directory and everything in it
Disallow: /foo.html # blocks a page. Let me write it down again so it will be more easy for you.(Note* this is an example only)
User-agent: *
Disallow: /temp/
Disallow: /images/
Disallow: /css/
Disallow: /admin/
Disallow: /foo.html
Disallow: /contact.html
Disallow: /contact.php
Disallow: /about.html
----------------------------------------------------------
blocks the entire site
User-agent: *
Disallow: / And if I put those lines in the robots.txt and use the Google URL remover, the URLs I remove will go away? Is that correct?
That helps a lot thanks. The code in robots.txt will block folders and pages from crawling and indexing by search engine bots. Kewl. Thanks You are welcome.