Hello Friends,
I need help regarding crawl error. I tried almost all the stuff that I'm aware with. I'd done removal through webmaster, robot.txt for removal of url from google crawl. I use "site:domain.com" to search for my crawl page. I found around 900+ pages in it. Prior it was around 1500+ pages. But now I am feed-up with this error. Can any one suggest me any other technique for removal of crawl url from search engine. And one more thing never see a robot.txt is been crawled but in my project is be been crawled and it show as link with above search. Any idea or suggestion would be appreciable.
Thanks in advance. How long ago have you made these changes?
And what was the crawl errors? Did you change your link structure? The changes was done prior 15 days but those link hasn't removed yet. I have 100+ links in my site and only 4 links is been crawled till date. I haven't made any changes in link structure. I submitted sitemap(dot)xml twice and it only shows 4 links as crawled. It is really difficult to me to change link structure. The site contains more then 100 links and modifying all links is really difficult task.
Another thing my new links isn't crawled I don't know why they are not getting crawled. Thanks for you reply mate.
I need help regarding crawl error. I tried almost all the stuff that I'm aware with. I'd done removal through webmaster, robot.txt for removal of url from google crawl. I use "site:domain.com" to search for my crawl page. I found around 900+ pages in it. Prior it was around 1500+ pages. But now I am feed-up with this error. Can any one suggest me any other technique for removal of crawl url from search engine. And one more thing never see a robot.txt is been crawled but in my project is be been crawled and it show as link with above search. Any idea or suggestion would be appreciable.
Thanks in advance. How long ago have you made these changes?
And what was the crawl errors? Did you change your link structure? The changes was done prior 15 days but those link hasn't removed yet. I have 100+ links in my site and only 4 links is been crawled till date. I haven't made any changes in link structure. I submitted sitemap(dot)xml twice and it only shows 4 links as crawled. It is really difficult to me to change link structure. The site contains more then 100 links and modifying all links is really difficult task.
Another thing my new links isn't crawled I don't know why they are not getting crawled. Thanks for you reply mate.