7 Steps Toward Fast Spidering
June 11, 2007 – 8:58 amIf you're new here, you may want to subscribe to my RSS feed. Thanks for visiting!
Getting spidered is the first step towards earning high rankings in the search engines. Therefore, you need to ensure that you have a strategy that will always get your new pages indexed fast. Anyone who relies on a long-tail strategy, such as a blogger, will appreciate that being indexed quick equals exposure.
Steps you can take to ensure your pages get spidered quick
1) Don’t leave any pages orphaned. If a page isn’t linked from somewhere, the page can’t be included in the index.
2) Make sure you fix any canononical issues.
3) Be a well-linked website due to constantly updated and/or authoritative content
4) Offer RSS and ping the major RSS aggregator services everytime you update.
5) Keep HTML errors to a minimum. In particular, pay attention to broken links. If you run a template-driven website, the errors add up in a hurry.
6) Link out to multiple sources. Be a part of the internet, in a totally organic and natural way.
7) Acquire incoming links from websites that are well spidered.
Anything that your website does to attract incoming links is a good thing for your overall spiderability. The area that you control the most is the content on your website. With enough content, you should attract the kind of links you need. If you have a completely tough time getting any incoming links, you’ll need to analyze the competition to find out where they’re getting there’s from.
What other methods can you think of to get pages spidered fast?
If you enjoyed this post, subscribe to the Sootle RSS feed!.
4 Responses to “7 Steps Toward Fast Spidering”
Thanks - regarding number 7 - place a link to your new content on a page which is well indexed and often visited by a search engine. This could be on your own homepage if your site is fairly successful, but I know many SEO’s buy or rent links specifically for this purpose. The point is that the new page gets spidered very quickly this way.
By Robert on Jun 11, 2007
I find that Google spiders my sites more often when I update them. If I don’t update my site for a few weeks I find that the number of visits I get from Google’s spider tends to drop off.
By John on Jun 11, 2007
I have a site full of original content that I have had online and well-linked for almost a year now — http://lastmed.com. Google does spider the site’s sitemap, but still does not include the site http://lastmed.com in the search results. I wonder why. Is it because the site’s domain is parked in cpanel and points at another one of my domains hosted within that same cpanel account?
By dave on Jun 11, 2007
Could be. But what the site really needs is some backlinks from spidered pages. It’s lacking in that department.
By Darren McLaughlin on Jun 15, 2007