Why Alexa sucks.
In my articles and research, I have sometimes used Alexa’s traffic rankings as a way to get at least some information on how much traffic a certain website has. Lately I’ve been getting comments by people saying that Alexa is inaccurate. It’s not exactly news to me, but…
The truth is, Alexa IS inaccurate. Grossly inaccurate. I’ve always thought that Alexa can still be of use in certain situations. I did a bit of research today (I’ve gotten the idea from a good little article on Digg and Alexa on Mashable.com, thank you), and I’ve came to the conclusion that Alexa is not only inaccurate, but also useless. Its data figures are almost random. Read on.
Alexa supposedly works like this: it measures what Alexa toolbar users do, and gets its data from there. And I always thought: ok, it’s a percentage of internet users, same as users of Firefox are a percentage of total number of internet users, so it might not be perfectly accurate, but it’s still accurate to some degree, right? Wrong. Alexa churns out completely wrong and seemingly random numbers.
Well, how does Alexa calculate traffic, then? There are many speculations about it. The truth is, after just a little research, I don’t even want to know. It certainly doesn’t seem connected to, you know, the actual traffic. Some people say that it can be manipulated by using Alexa toolbar, as in, you and two of your friends install it and you get a huge boost in Alexa rankings. Which seems to be true, but also doesn’t explain how the damn thing works, because it would implicate that basically noone is using Alexa toolbar anymore. Which also might be true. Like I’ve said, it’s time to stop caring.
You know why? Because Alexa isn’t the only free service that estimates web traffic. There are several alternatives out there, most notably SnapShot, Quantcast, Google Trends. This gives us the opportunity to simply try out a couple of websites and see how the traffic ranking matches accross different graphs. You guessed it: it matches to a reasonable degree in the mentioned three other services, but it’s completely bonkers in Alexa. Which leads me to the conclusion that any of these services is better than Alexa (and probably the best idea for any serious research would be to do a side-by-side comparison of all of them - someone make that mash-up, please?).
And now, for the cold, hard facts. These numbers need little or no explanation. In the following three instances, I took three websites with predictably comparable traffic but focused on completely different areas. I didn’t set this up to make Alexa look bad, I just came up with 9 sites from the top of my head. In all three tests, Alexa had major, inexplicable differences from the other two-traffic measuring sites. Here are the results (btw, the timeframes don’t match, but the differences are so huge that it doesn’t really matter):
flurl.com, pitchforkmedia.com, metacafe.com - everyone besides Alexa sees Metacafe on top here. Also, Alexa shows a big hump in Flurl’s traffic, starting with August 2006, which is nowhere to be seen in the other graphs.
penny-arcade.com, pvponline.com, dilbert.com - Yay, an online comic battle! Google trends said it doesn’t have enough volume to compare, so its results are omitted here. The results are similar accross the three graphs, with one notable difference: Snapshot and Quantcast say that Penny-Arcade’s traffic is slowly falling, while Alexa sees it as rising.
digg.com, facebook.com, imdb.com - I took a couple of heavyweights for the last one, and boy did they cause a mess for our poor traffic measuring sites. Fact: Everyone except Alexa puts Digg FAR behind the other two, in the third place. Fact: Facebook fares pretty horrible in Alexa’s graph compared to others. However, since the graphs generally don’t match here, I can only conclude that at least two of the traffic-measuring sites have guessed horribly wrong here. My estimate would be that Google trends and Snapshot are on the right track, although I don’t have the facts to back it up. One thing is for sure: Alexa is dead-wrong about Facebook here, because Facebook is heavily analyzed lately and many analysts put in the top 10 of all websites.
OK, so what have we learned here? Well, although my methods aren’t exactly scientific, I’d say that this short analysis gives a good estimate about the quality of Alexa’s rankings. And the estimate is: they suck. Even if you’re going to compare Alexa’s data with the other 3 sites mentioned here, you’ll still get useless results because Alexa’s rankings are so far off that it would just ruin your graph. Conclusion: although I’ve used Alexa’s rankings for some analysis in the past, I’ll either steer clear of it in the future or triple-check it with these other services.
December 27th, 2006 at 1:12 pm
Let’s just hope that the vast majority of internet publishers come to realise this all-to-open fact!
January 19th, 2007 at 6:51 pm
I laughed when you asked who actually uses the alexa toolbar c:
My experience shows traffic rankings depend entirely on the users of the providers of the rankings. I get much more referrals from MSN Live that Google, and MSN ranks me higher.
February 19th, 2007 at 12:16 am
[…] Like many other folks, I think Alexa data is just plain wrong. […]
April 20th, 2007 at 4:14 am
[…] I’ve recently voiced my opinion that bigcos and some of the essential components of Web 2.0, especially mashups and sharing (all kinds of sharing) simply don’t mix. With the recent news of Amazon suing Statsaholic, the poor little mashup that simply took Alexa’s (largely useless) data and made it better looking - and after they’ve done everything in their power to shut down the service - this seems even more obvious. […]
June 11th, 2007 at 1:04 pm
Stan,
We recently undertook a similar analysis and concluded Alexa was using a random number generator to produce the graphs. This was the only theory that consistently held up to a variety of tests.
June 11th, 2007 at 2:12 pm
[…] So why I still don’t think Alexa traffic ranking will do anything good to my blog? I agree with few of the bloggers out there. Why Alexa sucks. 3 Reasons Why Alexa Sucks (And They Know It!) […]
June 12th, 2007 at 2:45 pm
@Steve: hey, i bet at least 5% of it is real solid data (:
November 4th, 2007 at 10:33 am
[…] berguna untuk melihat seberapa ramaikah web/blog yang kita kelola selama ini. Akan tetapi ada juga beberapa org yang kontra terhadap kesimpulan itu. Mereka menilai bahwa perhitungan ranking alexa tidak akurat […]
December 21st, 2007 at 12:27 am
[…] it dead, even when there’s no other indication (except an Alexa graph, and we all know how reliable those are) that the company is actually doing bad. Case in point: […]
August 29th, 2008 at 5:59 am
Good post, may I use it?
October 6th, 2008 at 10:09 pm
[…] berguna untuk melihat seberapa ramaikah web/blog yang kita kelola selama ini. Akan tetapi ada juga beberapa org yang kontra terhadap kesimpulan itu. Mereka menilai bahwa perhitungan ranking alexa tidak akurat […]
October 21st, 2008 at 12:30 am
[…] berguna untuk melihat seberapa ramaikah web/blog yang kita kelola selama ini. Akan tetapi ada juga beberapa org yang kontra terhadap kesimpulan itu. Mereka menilai bahwa perhitungan ranking alexa tidak akurat […]
March 5th, 2009 at 1:06 am
The factors that are determinant in a website’s http://www.alexa.com/data/details/main?url=www.fortunehotels.in Alexa rankings apart from the data collected from the users of the Alexa toolbar are no where clearly mentioned. This somehow brings in a question of doubt and credibility issues as far as the Alexa rankings are concerned. However, even today the Alexa toolbar has the largest chunk in determining the ranking of a website.
April 6th, 2009 at 9:15 am
frying oil filter siemens business notebook pro v 5315
April 18th, 2009 at 7:52 am
uk number one singles history
jobserver.exe
June 5th, 2009 at 4:08 pm
what a great post, i like it
July 3rd, 2009 at 11:39 am
This was very nice to read. I will share this with my friends on Facebook.
November 4th, 2009 at 3:06 am
Hi! I have seen many such websites that provide competitive analysis for free. My personal favourite is www.estimix.com . It seems to generate very accurate traffic information, too.
November 13th, 2009 at 6:57 am
Thanks. I liked your post, do you have more like this? The topic needs lots of research, most people don’t have it.
November 26th, 2009 at 7:31 pm
Can not say that I can argue with this post at all.
November 28th, 2009 at 8:46 am
Hi everyone, I figured I would share a late Black Friday gift of some great information I found. Free backlinks for your website. I have been taking advantage of this this for my websites and it absolutely works great! Click my name to get what I mean.
December 2nd, 2009 at 7:45 pm
Valuable info for anybody who wants backlinks for no cost. Anybody want free backlinks for their blog? I figured I would share some great info I discovered recently. Free one way backlinks for your website. I have been taking advantage of this this for my websites and it absolutely works super! Click my name to get what I mean. Not selling a thing, it’s totally free of charge and it works.
December 2nd, 2009 at 7:45 pm
Important gift for anyone who wants backlinks for no cost. Anyone need free backlinks for their webite? I thought I might distribute some awesome information I found a little while ago. Free backlinks for your website. I have been taking advantage of this this for my websites and it really works great! Just click my name to see what I mean. Not selling anything, it’s totally free and it works.
December 2nd, 2009 at 7:45 pm
Important gift for anybody who wants backlinks for no charge. Anyone need free backlinks for their blog? I thought I would share some great info I found a little while ago. Free one way backlinks for your website. I have been using this for my websites and it absolutely works great! Just click my name to see what I mean. Not peddling a thing, it’s totally free of charge and it works.
December 20th, 2009 at 8:08 pm
Hmmrh I’m amazed! This is not too shabby site. Not bad posts too. Thanks!
buy links
December 26th, 2009 at 2:32 am
my God, i thought you were going to chip in with some decisive insght at the end there, not leave it with ?we leave it to you to decide?.
December 26th, 2009 at 5:11 pm
What is captcha code?, pls provide me captcha code codes or plugin, Thanks in advance.
January 1st, 2010 at 5:28 am
gragg advertising made the top tweets site 100tweets of whatever its called. gragg is working towards trying to break the barrier on becoming the kansas cities top twitter profile that has the most followers. I am pretty excited about this endeavor. gragg advertising
January 2nd, 2010 at 12:43 am
Thank You for sharing your knowledge, Really nice post
January 4th, 2010 at 10:54 am
Welcome over from The Faux Sty. Thanks for the comment!
January 10th, 2010 at 8:12 pm
This is absolutely perfect!!! Thanks for making this available
January 12th, 2010 at 1:57 pm
Let me start by saying nice post. Im not sure if it has been addressed, but when using Safari I can never get the entire site to load without refreshing alot of times. Maybe just my laptop. Thanks
January 13th, 2010 at 3:14 pm
I have been reading these posts for some time now and love your site. Thank you for always providing the info. I would like to mention a service that I have begun using to Improve web site ranking It?s a great service but it is probably ending soon. It has helped my web site rankings a lot!
January 15th, 2010 at 2:02 pm
thanks for explaining this so clearly
January 18th, 2010 at 8:11 am
Go to a9mm and check theirs, it may work better?.
January 18th, 2010 at 6:30 pm
Pretty good post. I just stumbled upon your blog and wanted to say that I have really enjoyed reading your blog posts. Any way I’ll be subscribing to your feed and I hope you post again soon.
January 26th, 2010 at 1:04 pm
Good info here but the formatting is difficult and it makes reading the blog entry hard. I’m using Firefox 3.6 (same thing, though in Internet Explorer).
Thanks,
Nutritional Supplement
January 31st, 2010 at 8:58 am
I really liked the details shared in this blog.It makes me more knowledgable towards it.I am waiting for your next post.
February 5th, 2010 at 12:09 pm
Thank you for your help!
February 5th, 2010 at 12:19 pm
thanks !! very helpful post!
February 5th, 2010 at 12:58 pm
Hey very nice blog!! Man .. Beautiful .. Amazing .. I will bookmark your blog and take the feeds also…
February 5th, 2010 at 1:03 pm
There is obviously a lot to know about this. I think you made some good points in Features also.
February 5th, 2010 at 1:18 pm
There is obviously a lot to know about this. I think you made some good points in Features also.
February 5th, 2010 at 1:23 pm
VRy interesting to read it
February 5th, 2010 at 1:28 pm
Thank you for your help!
February 5th, 2010 at 1:39 pm
VRy interesting to read it
February 5th, 2010 at 1:43 pm
Super-Duper site! I am loving it!! Will come back again - taking you feeds also, Thanks.
February 5th, 2010 at 2:02 pm
As a Newbie, I am always searching online for articles that can help me. Thank you Wow! Thank you! I always wanted to write in my site something like that. Can I take part of your post to my blog?
February 5th, 2010 at 10:09 pm
Great thing. I was looking for places to advertise my blog? Almost all major directories ban blogs, so this page came in handy.
February 5th, 2010 at 10:32 pm
Good information. Search engine rankings has come to a level where your anchor text and the amount of links you get matter the most. Even before the blogs coming into scene or Google was in power, webmasters would submit their websites to as many directories as possible to get any traffic they can.
February 6th, 2010 at 6:00 pm
Very good well informed ty you for the information. From the guys at Bloggles