Category Archives: A/B Testing

Building a Testing Culture with the 3 Second Scan

Yet another article trying to diagnose and solve a problem that every organization could likely solve differently. I’m solving this problem for companies that are in very immature stages of testing/optimization. That means you may have run one or two tests but want to run tests continuously and simultaneously. Go to any other site to find best… Read More »

My Secret Sauce: Building a Forgettable Donation Form

A big part of my job over the past 2 years has been managing a single donation form. During this time I’ve operationalized the A/B testing program and turned our focus from the “big and sexy” to… well… boring and iterative. It’s not all that bad, though! We’ve grown our revenue substantially each year – largely attributed to… Read More »

The Importance of Celebrating Test Outcomes

You know what’s worth celebrating? Running an A/B test between 3 versions of copy and the variant yields a 36% increase in email opt-ins with a 97% significance level. Rolled out across every web property, a friend’s optimization team learned this could potentially (and conservatively) yield $750,000 based on the average value of the email subscriber. This was an actual… Read More »

Adobe Target Standard vs. Optimizely

When shopping around for an A/B testing tool, I was searching for some key terms “Optimizely compared with…” or “Visual Website Optimizer vs….” – as a current Target Standard customer, it would have been nice to have had a guide that pits Target Standard against… well… anything. So without further adieu, Target Standard vs. Optimizely Optimizely I consider… Read More »