feedback

At last, a comparison website for multivariate testing software

Which should you use: the free Google Website Optimizer or a $50,000 alternative?

We’ve just launched a website that you’ll find really useful. It’s a comparison site for split testing software (like Google Website Optimizer). It allows you to

  • See the differences between 15 different multivariate testing software solutions (including Google Website Optimizer).
  • Read reviews from existing users (happy ones and unhappy ones), so you can see the truth behind the sales pitches.
  • Get a better understanding of what you’re missing out on.

So if you’d like to know which multivariate testing software is best for you, then hurry to … rabba dabba dabba dabba tish* …

Which Multivariate?

* That was supposed to be a drum roll.

Oh, and please don’t forget to come back here and leave your comments.

P.S. If you know anyone else who’d find this valuable, could you please spread the word?

Comments

  1. JoeD says:

    Useful website, an idea for the future: “MVT Wizard”

    It asks you a set of questions about your website and business model and drills down to a select few solutions suitable for you.

  2. It’s nice to see them all lined up, ready for comparison. I’ll make sure to review a bunch of them later on!

  3. Nice job lads! Pretty revealing actually. Have you used and would you recommend the Accenture platform? It seems a tad pricey!

  4. We happen to personally know the person who reviewed the Accenture platform and we value his opinion highly. Though Accenture has a high price tag, he works for one of Germany’s biggest online companies, so it’s easier to get a good ROI.

  5. Adam Killam says:

    I like you how you answered one of my questions before I even had to ask it: is this an affiliate site? Answer: No. Your graphic, 100% neutral says it all. Great site guys.

  6. Dan Grossman says:

    One of the first times I’ve run across my WordPress ratings plugin in the wild without knowing about it beforehand — the site looks great.

  7. This is a great resource. We’ve compiled a similar list of possible tools in the past. For us, SiteSpect came out pretty high up, alongside GWO, but we’ve enjoyed reading about the other alternatives.

  8. Andy Beard says:

    It doesn’t answer enough questions

    * Can it split test the whole code, or just the visible elements?
    * Can you split test the same element across multiple pages?
    * WYSIWYG?
    * Can it split test pages that contain dynamic keyword substitution?
    * Can results be filtered based on any/all referrers & specific profiles set up?
    * Can a relatively new user set up a split test in 10 minutes?
    * Can parameters be excluded from pages?
    * Can fragments be ignored?
    * Is data passed from the split test software back to the landing page for recording by other scripts or dynamic substitution?

  9. Fred Gleeck says:

    Interesting to see the side by side comparisons of all of the various options. What’s missing, IMHO, is some kind of summary recommendation. I need to look at your data and then not have to click around to compare pricing. If you are going to give me a review, then REVIEW them for me and give me the top 3 choices and tell me why!

  10. Carl Juneau says:

    Right on! I’ve noticed lots of new software have come up recently. I’ve been trying Visual Website Optimizer, and I like it so far (great customer service). Thanks! CJ

  11. Jake Whistle says:

    Great concept and good format – thanks!

  12. Bookmarked. Superb, thank you for the hours of work – and the head scratching – that you’ve saved me.

  13. Patrick says:

    Cool to see this! Didn’t even know that there were so many optimizers.

  14. It’s about time someone pulled this list together – glad you guys did it, and did it so well. What a great resource. Thank you!

  15. Matt Bentley says:

    Really a great looking and very useful site, and by far the best implementation of WP Review Site I’ve seen — did you do the design and coding in-house, or external? If the latter, would you mind letting me know who you used? Thank you!

  16. Matt, the site was built by our team.

    Fred, Andy and Joe, thanks for your great suggestions. We’ll incorporate them into next version of Which Multivariate?

    Thanks to you all for your kind words.

  17. Nice article and very good site. This is an interesting approach, and very good looking.

  18. Adam says:

    I’ve been using “Intelligent MVT” on some of our client’s sites and it has had amazing results, maybe it’s not one you’ve considered already, but I think it has a place on this list.

  19. Juli B says:

    Have you had any reviews for the WebTrends Optimize product?

  20. Joe Doveton says:

    Great article and great site guys, and thanks for championing MVT. Also check out our tool: GlobalMaxer. Developed by Oban Multilingual, GlobalMaxer is the only tool designed to provide CULTURAL Multivariate Testing so you can compare the way your visitors interact between UK, France, Germany, USA, wherever!

  21. Sonia says:

    Check out Amadesa. Amadesa offers a full-factorial Multivariate Testing product with features like easy wizard set up, the flexibility to control and adjust traffic mix, image upload and storage, and quick preview. Test images, copy, offers, and an unlimited myriad of elements to improve click through rates and increase conversions. Amadesa already helps clients like Shoebuy.com, myFICO, Mary Kay, Mountain Equipment Co-Op and 2Checkout, just to name a few, drive customer engagement and increase ROI. The Amadesa platform is very easy-to-use, so clients can use it as a self-service solution. Amadesa also offers hybrid and full service options for customers that want to outsource their website optimization partially or completely.

  22. Hi Sonia, we know Amadesa very well… in fact, we’re waiting for Pete Olson to send us the information we need to add you to the list of vendors on WhichMVT.com.

  23. Sonia says:

    That’s great. Thanks for the reply! Wonderful website you have here.

  24. Ryan says:

    I’d like to see a comparison and review done of Monetate

  25. JMiller says:

    I am about to purchase Split Test Accelerator and I am glad I came across this blog. It was very helpful in helping me decide to actually buy it. I have been looking for something like this to help scale up my affiliate marketing.

  26. Matt Hardy says:

    Glad that we came across this website . This was really helpful in comparing all the multivariate testing tools that we have been using and now we have made up our mind :)

  27. Great list. But my favorite: Optimizely is not even on the list. To me this beats both Google and Visual website optimizer – to which the compare well.

    /Ole

  28. Cool stuff! :)

  29. Jeroen says:

    Hi, nice overview! I’m curious, what are you all using for A/B testing software?

  30. Nice list for comparison! now its all about choosing which platform to use. Unlike many other people I love the way you clearly state that you dont get remuneration for referring to the sites. Brilliant. 100% unbiased views and reviews. I have learnt loads today from your site and have bookmarked for future use, which I am sure that I will be coming to again and again. Please keep up the good work its a breath of fresh air :)

    As you ‘are authorized consultants for Google Website Optimizer’ and use ‘Visual Website Optimizer’ on your own site. What would you say the main advantages and disadvantages are in comparison?

Speak Your Mind

(Required)