Increasing Google Crawl Rate Frequency
November 27, 2006 – 7:20 amIf you're new here, you may want to subscribe to my RSS feed. Thanks for visiting!
The newest thing I’ve been into lately is getting Google to increase the frequency of the Crawl Rate. I think this is key to getting new pages in faster, and to get any changes you’ve made to pages noticed faster. What are some of the ways you can increase the Crawl Rate frequency?
1) More incoming links to the main website page
2) More incoming links to direct interior pages
3) More frequent updates of content
4) Increasing the number of incoming links on a broad range of IP groups
These tactics are similar (if not nearly exact) to “getting a new site out of the Sandbox”. Once your Crawl Rate is fast enough, it seems the main way to keep it going is to keep on updating your content. Once Google gets in the habit of visiting your website daily to find fresh content, they will generally add that content to their index within 24 hours!
That’s why, if you do “long tail search”, like I do, you can expect rankings within 24 hours for many phrases. If you play in the long tail arena at all, I suggest you focus on updating constantly, building one mega-site, and keeping those spiders coming in.
If the frequency of index inclusion is much longer for your pages, it hurts you, especially in the area of experimentation. You need to be able to experiment with SEO to succeed. When your additions and modifications are recorded almost instantly, you’d be amazed at how much easier the job gets.
If you enjoyed this post, subscribe to the Sootle RSS feed!.
3 Responses to “Increasing Google Crawl Rate Frequency”
That is a very interesting tip and a very helpful article. Google thrives on new information.
I have a question; if you are selling a product on your web site and the product does not change, is it a good idea to constantly change the style and format of your web site to make Google think that your web site is constantly offering new content?
By Mike on Nov 27, 2006
Nope. The only new content Google is looking for is real content. They can spot template changes pretty easily.
A better idea would be to add a blog to the website. You don’t have to update every day, but updating once and a while should have very good effects on your overall rankings. Plus, it helps you communicate with customers.
By Darren McLaughlin on Nov 28, 2006