As niche blogs become even more popular, the reliance on google for bloggers is at a new and different high. Much of the traffic for certain niche blogs come from search engines, mainly google. So when (and how much) does google crawl you?

SeoMeter

Add your website to SeoMeter, and start to keep track of search engine’s crawling!

SeoMeter allows you to monitor when search engine’s crawl your website or blog. Getting listed is free and the tool records in the database how often you get crawled.

You can see on our badge that our CC or crawl cycle is .9. The CC is the time between two consecutive crawls done by search engine robots. So if our crawl cycle was 1, that means we get crawled once a day.

You can also notice our rank, which I thought was pretty cool. You can check out the top 20 websites in blogging. Looks like we are in the top 5.

Why Does this Matter?

SeoMeter puts it simply and states that this

“allows webmasters to monitor their website’ crawling activities, and to collate crawling trend against their ongoing marketing campaign and other SEO strategies.”

However, I’m just more fascinated on graphs and how much the trends change over time. This gives you different things to check your experiments. Maybe you start posting more or less. It could affect your search engine referrals.

What determines search engine’s crawl rate is best outlined at the SEOmeter blog. The factors include content updates, pinging, sitemap, robots.txt and server speed.

How often do you get Crawled?

9 Responses to “How Often Does Google Crawl You?”

1. Lynne Says:
   January 21st, 2008 at 7:14 am

   Thanks for posting this, it sounds intriguing. I have submitted both of my sites and will wait to hear from SEOMeter.

2. Matthew Henrickson Says:
   January 21st, 2008 at 10:07 am

   It takes about 12-24 hours to get approved. I submitted another one of my sites last night and its already approved

3. webduck Says:
   January 21st, 2008 at 12:19 pm

   I submitted my blog iPentimento this morning after reading your post, and about 10 min. later they had approved me. Now if only Google will…lol.

4. Deimos Tel`Arin Says:
   January 21st, 2008 at 3:13 pm

   Wow! Talk about awesome coolness! O_O

   This is like totally a very useful thingie for blogmasters and webmasters alike! ^_^

   Thanks for sharing this, mate.

   Okay I just submitted my site.

   Hope they approve it soon!

   This is a good share, mate.

   Cheers yo!

5. Matthew Henrickson Says:
   January 21st, 2008 at 3:15 pm

   Enjoy it, feel free to come back and share your feelings about it. I’ve been checking mine everyday

6. patrick Says:
   January 21st, 2008 at 5:46 pm

   This is an awesome tool, thanks for sharing with us. I have already noticed though that Google seems to index my new posts within 24 hours or so, even though I only post once a week and have a very low pagerank.

   But I’m definitely going to check this thing out!

7. Best of the Sphere - 27/1/08 | TechnoMoney | Smashing Blogging Tips Says:
   January 27th, 2008 at 12:52 pm

   […] How Often Does Google Crawl You? from Blog About Your Blog […]

8. Best of the Sphere - 27/1/08 | TechnoMoney | Smashing Blogging Tips Says:
   January 27th, 2008 at 12:52 pm

   […] How Often Does Google Crawl You? from Blog About Your Blog […]

9. SEO Meter Says:
   February 11th, 2008 at 8:29 am

   Thanks for your detailed review!
   We have some stats out which will allow you to compare your site against all other sites that we are monitoring. Check out:
   http://blog.seometer.com/where-is-your-site-ranked-in-terms-of-google-crawl-rate/

Leave a Comment