Jan 21 2008

How Often Does Google Crawl You?

As niche blogs become even more popular, the reliance on google for bloggers is at a new and different high. Much of the traffic for certain niche blogs come from search engines, mainly google. So when (and how much) does google crawl you?


Add your website to SeoMeter, and start to keep track of search engine’s crawling!

SeoMeter allows you to monitor when search engine’s crawl your website or blog. Getting listed is free and the tool records in the database how often you get crawled.

blogaboutyourblog.com - SEOmeter SEO toolsYou can see on our badge that our CC or crawl cycle is .9. The CC is the time between two consecutive crawls done by search engine robots. So if our crawl cycle was 1, that means we get crawled once a day.

You can also notice our rank, which I thought was pretty cool. You can check out the top 20 websites in blogging. Looks like we are in the top 5.

Why Does this Matter?

SeoMeter puts it simply and states that this

“allows webmasters to monitor their website’ crawling activities, and to collate crawling trend against their ongoing marketing campaign and other SEO strategies.”

However, I’m just more fascinated on graphs and how much the trends change over time. This gives you different things to check your experiments. Maybe you start posting more or less. It could affect your search engine referrals.

What determines search engine’s crawl rate is best outlined at the SEOmeter blog. The factors include content updates, pinging, sitemap, robots.txt and server speed.

How often do you get Crawled?

Random Posts


12 Comments on this post


  1. Best of the Sphere - 27/1/08 | TechnoMoney | Smashing Blogging Tips wrote:

    [...] How Often Does Google Crawl You? from Blog About Your Blog [...]

    January 27th, 2008 at 12:52 pm
  2. Best of the Sphere - 27/1/08 | TechnoMoney | Smashing Blogging Tips wrote:

    [...] How Often Does Google Crawl You? from Blog About Your Blog [...]

    January 27th, 2008 at 12:52 pm
  1. Lynne said:

    Thanks for posting this, it sounds intriguing. I have submitted both of my sites and will wait to hear from SEOMeter.

    January 21st, 2008 at 7:14 am
  2. Matthew Henrickson said:

    It takes about 12-24 hours to get approved. I submitted another one of my sites last night and its already approved

    January 21st, 2008 at 10:07 am
  3. webduck said:

    I submitted my blog iPentimento this morning after reading your post, and about 10 min. later they had approved me. Now if only Google will…lol.

    January 21st, 2008 at 12:19 pm
  4. Deimos Tel`Arin said:

    Wow! Talk about awesome coolness! O_O

    This is like totally a very useful thingie for blogmasters and webmasters alike! ^_^

    Thanks for sharing this, mate. ;)

    Okay I just submitted my site.

    Hope they approve it soon!

    This is a good share, mate.

    Cheers yo!

    January 21st, 2008 at 3:13 pm
  5. Matthew Henrickson said:

    Enjoy it, feel free to come back and share your feelings about it. I’ve been checking mine everyday

    January 21st, 2008 at 3:15 pm
  6. patrick said:

    This is an awesome tool, thanks for sharing with us. I have already noticed though that Google seems to index my new posts within 24 hours or so, even though I only post once a week and have a very low pagerank.

    But I’m definitely going to check this thing out!

    January 21st, 2008 at 5:46 pm
  7. SEO Meter said:

    Thanks for your detailed review!
    We have some stats out which will allow you to compare your site against all other sites that we are monitoring. Check out:

    February 11th, 2008 at 8:29 am
  8. Pete said:

    Hmmmm. I am curious how often Google is crawling my blog pages, I totally rebuilt my main website this week and google still is showing the results of the previous pages? Is there an industry average number of days? Check out my page, I’d love your input!


    June 27th, 2008 at 9:40 pm
  9. Woody said:

    Thanks for your posting such great details, these were really interesting and I have signed up for the crawl rate.

    Keep up the good work


    July 14th, 2008 at 6:54 pm
  10. Dinesh said:

    I have a blog and 300 plus post in my blog, but google crawled only 185, do you have any more ideas for that issue.

    June 15th, 2009 at 7:08 am


Subscribe Form

Subscribe to Blog

UBD Moneymaker Theme by Unique Blog Designs & Phillip van Coller. Header designed by Israel of Fat Man Unleashed.