Google spiders certain sites a lot - but doesn’t add the pages to the index
June 8, 2006 – 9:59 amIf you're new here, you may want to subscribe to my RSS feed. Thanks for visiting!
This is something I see as a big change that occurred because of the “Big Daddy” update. Google used to include most pages in its’ index fast, even if they didn’t rank quickly for the desired search phrases. But Google has gotten tough on new pages and new domains in the last few years, treating them like lepers! In a sense this marks an extreme change in philosophy for them, and shows the incredible bias towards old information they now arrogantly proclaim as progress.
PSST Google!! The best pages on the internet weren’t always created in 1998. An they weren’t always created by some schlub college student on his home directory! Get real! There’s tons of crap on .edus, just like anywhere else in the index. The sites that get inflated importance in Google are almost always the same type of beast, but creating your website to emulate them would be insane. There’s too much attention paid to legacy links.
The latest craze that is the most counter-intuitive is to look at websites with few backlinks as pariahs, and only include them in the index as you deem them worthy. Admittedly, this might save time and resources in certain cases, but it appears to be aimed more at stopping the self-created Google Scraper problem, and it’s not even a great solution. For people who don’t work in the SEO or SEM arena, acquiring backlinks is not always a top priority. That puts link builders in the driver’s seat, as usual. I guess this is good news after all!
Google might appear to update, but the strategy rarely changes: to rank high, get more incoming links. They’ll keep on devaluing them, and people will keep on adding them. Cat and mouse. Yin and Yang and all that. Just keep on link building and you should be all set in 40 years or so! If you can build permanent links fast, that’s quite an advantage. Good luck with your link building
If you enjoyed this post, subscribe to the Sootle RSS feed!.
2 Responses to “Google spiders certain sites a lot - but doesn’t add the pages to the index”
Good points as usual Darren.
You are right on with link builders being in the drivers seat. Forget creating quality content and the traffic will come. More like create quality content and your pages will never get indexed… unless you go out and get links which is what Google does not want people doing.
One thing I want to add: old sites are being hammered too and losing pages from the index if they don’t have enough links pointing to them. Small businesses that should be indexed are having a hard time keeping their pages in the index.
This is just bad on Google’s part.
By Gomer on Jun 8, 2006
I know this is a fact for sure. I have a ten year old website where I added 100 pages of content to it in April. It’s been spidered again and again by Google, yet the pages are not indexed.
The site still displays its’ PR 5 in the toolbar, but it’s operating more like a PR 1. Sort of a disappointing step back in time for Google.
By Darren McLaughlin on Jun 9, 2006