Why Alexa sucks.

alexa.jpgIn my articles and research, I have sometimes used Alexa’s traffic rankings as a way to get at least some information on how much traffic a certain website has. Lately I’ve been getting comments by people saying that Alexa is inaccurate. It’s not exactly news to me, but…

The truth is, Alexa IS inaccurate. Grossly inaccurate. I’ve always thought that Alexa can still be of use in certain situations. I did a bit of research today (I’ve gotten the idea from a good little article on Digg and Alexa on Mashable.com, thank you), and I’ve came to the conclusion that Alexa is not only inaccurate, but also useless. Its data figures are almost random. Read on.

Alexa supposedly works like this: it measures what Alexa toolbar users do, and gets its data from there. And I always thought: ok, it’s a percentage of internet users, same as users of Firefox are a percentage of total number of internet users, so it might not be perfectly accurate, but it’s still accurate to some degree, right? Wrong. Alexa churns out completely wrong and seemingly random numbers.

Well, how does Alexa calculate traffic, then? There are many speculations about it. The truth is, after just a little research, I don’t even want to know. It certainly doesn’t seem connected to, you know, the actual traffic. Some people say that it can be manipulated by using Alexa toolbar, as in, you and two of your friends install it and you get a huge boost in Alexa rankings. Which seems to be true, but also doesn’t explain how the damn thing works, because it would implicate that basically noone is using Alexa toolbar anymore. Which also might be true. Like I’ve said, it’s time to stop caring.

You know why? Because Alexa isn’t the only free service that estimates web traffic. There are several alternatives out there, most notably SnapShot, Quantcast, Google Trends. This gives us the opportunity to simply try out a couple of websites and see how the traffic ranking matches accross different graphs. You guessed it: it matches to a reasonable degree in the mentioned three other services, but it’s completely bonkers in Alexa. Which leads me to the conclusion that any of these services is better than Alexa (and probably the best idea for any serious research would be to do a side-by-side comparison of all of them - someone make that mash-up, please?).

And now, for the cold, hard facts. These numbers need little or no explanation. In the following three instances, I took three websites with predictably comparable traffic but focused on completely different areas. I didn’t set this up to make Alexa look bad, I just came up with 9 sites from the top of my head. In all three tests, Alexa had major, inexplicable differences from the other two-traffic measuring sites. Here are the results (btw, the timeframes don’t match, but the differences are so huge that it doesn’t really matter):

flurl.com, pitchforkmedia.com, metacafe.com - everyone besides Alexa sees Metacafe on top here. Also, Alexa shows a big hump in Flurl’s traffic, starting with August 2006, which is nowhere to be seen in the other graphs.
Alexa snapshot_1.gif

quantcast_1.gifgoogle_1.gif
penny-arcade.com, pvponline.com, dilbert.com - Yay, an online comic battle! Google trends said it doesn’t have enough volume to compare, so its results are omitted here. The results are similar accross the three graphs, with one notable difference: Snapshot and Quantcast say that Penny-Arcade’s traffic is slowly falling, while Alexa sees it as rising.

alexa_2.gifquantcast_2.gifsnapshot_2.gif
digg.com, facebook.com, imdb.com - I took a couple of heavyweights for the last one, and boy did they cause a mess for our poor traffic measuring sites. Fact: Everyone except Alexa puts Digg FAR behind the other two, in the third place. Fact: Facebook fares pretty horrible in Alexa’s graph compared to others. However, since the graphs generally don’t match here, I can only conclude that at least two of the traffic-measuring sites have guessed horribly wrong here. My estimate would be that Google trends and Snapshot are on the right track, although I don’t have the facts to back it up. One thing is for sure: Alexa is dead-wrong about Facebook here, because Facebook is heavily analyzed lately and many analysts put in the top 10 of all websites.

alexa_3.gifsnapshot_3.gif

quantcast_3.gifgoogle_3.gif

OK, so what have we learned here? Well, although my methods aren’t exactly scientific, I’d say that this short analysis gives a good estimate about the quality of Alexa’s rankings. And the estimate is: they suck. Even if you’re going to compare Alexa’s data with the other 3 sites mentioned here, you’ll still get useless results because Alexa’s rankings are so far off that it would just ruin your graph. Conclusion: although I’ve used Alexa’s rankings for some analysis in the past, I’ll either steer clear of it in the future or triple-check it with these other services.

70 Responses to “Why Alexa sucks.”

  1. Gustav Mörtberg Says:

    Let’s just hope that the vast majority of internet publishers come to realise this all-to-open fact!

  2. Zach Says:

    I laughed when you asked who actually uses the alexa toolbar c:

    My experience shows traffic rankings depend entirely on the users of the providers of the rankings. I get much more referrals from MSN Live that Google, and MSN ranks me higher.

  3. The Boxxet Blog » Make Bad Business Decisions with Alexa Says:

    […] Like many other folks, I think Alexa data is just plain wrong.  […]

  4. Big companies vs. Web 2.0, round 2 - franticindustries. Says:

    […] I’ve recently voiced my opinion that bigcos and some of the essential components of Web 2.0, especially mashups and sharing (all kinds of sharing) simply don’t mix. With the recent news of Amazon suing Statsaholic, the poor little mashup that simply took Alexa’s (largely useless) data and made it better looking - and after they’ve done everything in their power to shut down the service - this seems even more obvious. […]

  5. Steve Larsen Says:

    Stan,

    We recently undertook a similar analysis and concluded Alexa was using a random number generator to produce the graphs. This was the only theory that consistently held up to a variety of tests.

  6. Increase Alexa traffic ranking by 5 million points in 10 days - Just Stumble! | Terence Chang - Blah Blah Blog Says:

    […] So why I still don’t think Alexa traffic ranking will do anything good to my blog? I agree with few of the bloggers out there. Why Alexa sucks. 3 Reasons Why Alexa Sucks (And They Know It!) […]

  7. Stan Schroeder Says:

    @Steve: hey, i bet at least 5% of it is real solid data (:

  8. Tips Meningkatkan Traffic Alexa Rank | hadriyan.com Says:

    […] berguna untuk melihat seberapa ramaikah web/blog yang kita kelola selama ini. Akan tetapi ada juga beberapa org yang kontra terhadap kesimpulan itu. Mereka menilai bahwa perhitungan ranking alexa tidak akurat […]

  9. Deadpoolbaiting! at franticindustries - web 2.0, social networking, IT technology trends. Says:

    […] it dead, even when there’s no other indication (except an Alexa graph, and we all know how reliable those are) that the company is actually doing bad. Case in point: […]

  10. Gills Secret traffic generator Says:

    Good post, may I use it?

  11. Tips Meningkatkan Traffic Alexa Rank | Nada Sumbang | Sebuah Inspirasi Untuk Belajar Says:

    […] berguna untuk melihat seberapa ramaikah web/blog yang kita kelola selama ini. Akan tetapi ada juga beberapa org yang kontra terhadap kesimpulan itu. Mereka menilai bahwa perhitungan ranking alexa tidak akurat […]

  12. Tips Meningkatkan Traffic Alexa Rank dari handriyan | Manshurin.com Says:

    […] berguna untuk melihat seberapa ramaikah web/blog yang kita kelola selama ini. Akan tetapi ada juga beberapa org yang kontra terhadap kesimpulan itu. Mereka menilai bahwa perhitungan ranking alexa tidak akurat […]

  13. what are the "other sources" determing Alexa Traffic? Says:

    The factors that are determinant in a website’s http://www.alexa.com/data/details/main?url=www.fortunehotels.in Alexa rankings apart from the data collected from the users of the Alexa toolbar are no where clearly mentioned. This somehow brings in a question of doubt and credibility issues as far as the Alexa rankings are concerned. However, even today the Alexa toolbar has the largest chunk in determining the ranking of a website.

  14. cleaners air engine intake Says:

    frying oil filter siemens business notebook pro v 5315

  15. bride ceremony closing olympics Says:

    uk number one singles history
    jobserver.exe

  16. Alexa Rank Checker Says:

    what a great post, i like it

  17. alex farguson Says:

    This was very nice to read. I will share this with my friends on Facebook.

  18. sidney Says:

    Hi! I have seen many such websites that provide competitive analysis for free. My personal favourite is www.estimix.com . It seems to generate very accurate traffic information, too.

  19. Backlink Services Says:

    Thanks. I liked your post, do you have more like this? The topic needs lots of research, most people don’t have it.

  20. Free Traffic Says:

    Can not say that I can argue with this post at all.

  21. Backlinks Says:

    Hi everyone, I figured I would share a late Black Friday gift of some great information I found. Free backlinks for your website. I have been taking advantage of this this for my websites and it absolutely works great! Click my name to get what I mean.

  22. Free One Way Links Says:

    Valuable info for anybody who wants backlinks for no cost. Anybody want free backlinks for their blog? I figured I would share some great info I discovered recently. Free one way backlinks for your website. I have been taking advantage of this this for my websites and it absolutely works super! Click my name to get what I mean. Not selling a thing, it’s totally free of charge and it works.

  23. Free One Way Links Says:

    Important gift for anyone who wants backlinks for no cost. Anyone need free backlinks for their webite? I thought I might distribute some awesome information I found a little while ago. Free backlinks for your website. I have been taking advantage of this this for my websites and it really works great! Just click my name to see what I mean. Not selling anything, it’s totally free and it works.

  24. Free Backlinks Says:

    Important gift for anybody who wants backlinks for no charge. Anyone need free backlinks for their blog? I thought I would share some great info I found a little while ago. Free one way backlinks for your website. I have been using this for my websites and it absolutely works great! Just click my name to see what I mean. Not peddling a thing, it’s totally free of charge and it works.

  25. Karon Mccleskey Says:

    Hmmrh I’m amazed! This is not too shabby site. Not bad posts too. Thanks!

    buy links

  26. webhosting talk Says:

    my God, i thought you were going to chip in with some decisive insght at the end there, not leave it with ?we leave it to you to decide?.

  27. web advance Says:

    What is captcha code?, pls provide me captcha code codes or plugin, Thanks in advance.

  28. Putney Says:

    gragg advertising made the top tweets site 100tweets of whatever its called. gragg is working towards trying to break the barrier on becoming the kansas cities top twitter profile that has the most followers. I am pretty excited about this endeavor. gragg advertising

  29. Marla Hanna Says:

    Thank You for sharing your knowledge, Really nice post

  30. linkvana review Says:

    Welcome over from The Faux Sty. Thanks for the comment!

  31. wireless network interface card Says:

    This is absolutely perfect!!! Thanks for making this available :)

  32. Oleta Chason Says:

    Let me start by saying nice post. Im not sure if it has been addressed, but when using Safari I can never get the entire site to load without refreshing alot of times. Maybe just my laptop. Thanks

  33. Jack Kennedy Says:

    I have been reading these posts for some time now and love your site. Thank you for always providing the info. I would like to mention a service that I have begun using to Improve web site ranking It?s a great service but it is probably ending soon. It has helped my web site rankings a lot!

  34. Backlink Building Says:

    thanks for explaining this so clearly

  35. Gerard Nhep Says:

    Go to a9mm and check theirs, it may work better?.

  36. Candice Center Says:

    Pretty good post. I just stumbled upon your blog and wanted to say that I have really enjoyed reading your blog posts. Any way I’ll be subscribing to your feed and I hope you post again soon.

  37. Cayenne Pepper Says:

    Good info here but the formatting is difficult and it makes reading the blog entry hard. I’m using Firefox 3.6 (same thing, though in Internet Explorer).

    Thanks,
    Nutritional Supplement

  38. I really liked the info shared in this blog.It makes me more knowledgable towards it.I am looking forward for your next post. Says:

    I really liked the details shared in this blog.It makes me more knowledgable towards it.I am waiting for your next post.

  39. google trends lab Says:

    Thank you for your help!

  40. funny google trends Says:

    thanks !! very helpful post!

  41. twitter trends from Says:

    Hey very nice blog!! Man .. Beautiful .. Amazing .. I will bookmark your blog and take the feeds also…

  42. google trends india Says:

    There is obviously a lot to know about this. I think you made some good points in Features also.

  43. google trends 2009 Says:

    There is obviously a lot to know about this. I think you made some good points in Features also.

  44. twitter trends search Says:

    VRy interesting to read it :P

  45. google trends funny Says:

    Thank you for your help!

  46. google trends uk Says:

    VRy interesting to read it :P

  47. google trends lab Says:

    Super-Duper site! I am loving it!! Will come back again - taking you feeds also, Thanks.

  48. twitter trends map Says:

    As a Newbie, I am always searching online for articles that can help me. Thank you Wow! Thank you! I always wanted to write in my site something like that. Can I take part of your post to my blog?

  49. Neil O Reilley Says:

    Great thing. I was looking for places to advertise my blog? Almost all major directories ban blogs, so this page came in handy.

  50. Gregory Despain Says:

    Good information. Search engine rankings has come to a level where your anchor text and the amount of links you get matter the most. Even before the blogs coming into scene or Google was in power, webmasters would submit their websites to as many directories as possible to get any traffic they can.

  51. foreveradog Says:

    Very good well informed ty you for the information. From the guys at Bloggles

  52. fabianofinger.com Says:

    There is obviously a lot to know about this. I think you made some good points in Features also.

  53. Dominic Bentley Says:

    Great information! {Thanks!|Many Thanks|Please keep it up|I will be back for more very soon}

  54. sandu Says:

    This website is on very good ranking!

  55. Watch Says:

    I?m unsure of my own stance on commenting. Sometimes I feel its watch shameless self-promotion for most people, but then at other times I feel watch somewhat guilty for consuming some fantastic content without contributing my thoughts to the topic.

  56. Gavello Gavello Says:

    Hi First time bounded here on your site, founde on ASK. Thanks so much for you advice, it helped me see some things in a new light.

  57. Replacement Windows West Chester PA Says:

    Just checking out your article on my new Nokia , and I wanted to see if it would allow me reply or if it was going to me go to a pc to do that. Ill check back later to see if it worked.

  58. Eddie Seys Says:

    How to Promote Your Website and Gain Traffic - How I Did It

  59. Jessica Liu Says:

    I have been trying to Gain access to this Blog for a while. I was using Chrome then when I tried Firefox, it worked just great? Just wanted to bring this to your attention.

  60. Electric Bed Says:

    Great postings. I hope to read more from you.
    Electric Bed

  61. MatildaFinley24 Says:

    Do you acknowledge that it’s high time to receive the credit loans, which can help you.

  62. Howtogetyourexloveback Says:

    Why my post always deleted by admin, who can help me to get my love back?how to get your ex back

  63. Charles Loan Says:

    I agree with you Fighting for peace is like fucking for virginity.

  64. Digital creed Says:

    amazing stuff thanx :)

  65. cricket games Says:

    It’s an interesting information and useful suggestion for me.

    thanks for all

  66. memory foam mattress Says:

    My research of my thesis is about factory overhead. I am stress with my research because to get some data is very difficult.

  67. Cheap Breakdown Cover Says:

    To start earning dollars using yournet log, at first use Google Adsense but step by step as your targeted traffic growths, Continue adding a lot more and more funds creating applications for a web website.

  68. dell computers Says:

    Excellent idea! I highly appreciate your post. I would like to get more information and I hope that there are many interesting things in my studies. Thanks so much and let keep on sharing your stuffs. Well-done!

  69. Web Hosting Says:

    It’s useful instruction, keep on posting like that.

    It’s an interesting information and useful suggestion for me.

    thanks for all

  70. Credit Cards Compared Says:

    Thanks for the information! I’ve been meaning to start this process myself so this is a big help.

Leave a Reply