Brian Christian's long Wired feature on A/B testing does a good job of explaining the quiet revolution in product design we've experienced this century, the modes of thought that habitual A/B testing encourages, and the drawbacks to those modes. A lot of the products and services we use today are designed to a turn that makes the previous technologies look like stone axes. That's largely thanks to the ability to run multivariate tests on vast sets of diverse design-choices and quickly converge on optimal solutions that are continuously and automatically refined.
For that same reason, A/B increasingly makes meetings irrelevant. Where editors at a news site, for example, might have sat around a table for 15 minutes trying to decide on the best phrasing for an important headline, they can simply run all the proposed headlines and let the testing decide. Consensus, even democracy, has been replaced by pluralism—resolved by data...
Google insiders, and A/B enthusiasts more generally, have a derisive term to describe a decisionmaking system that fails to put data at its heart: HiPPO—”highest-paid person’s opinion.” As Google analytics expert Avinash Kaushik declares, “Most websites suck because HiPPOs create them...”
One consequence of this data-driven revolution is that the whole attitude toward writing software, or even imagining it, becomes subtly constrained. A number of developers told me that A/B has probably reduced the number of big, dramatic changes to their products. They now think of wholesale revisions as simply too risky—instead, they want to break every idea up into smaller pieces, with each piece tested and then gradually, tentatively phased into the traffic.
The A/B Test: Inside the Technology That’s Changing the Rules of Business
Larkin Jones is a hardcore Pokemon fan who loses money every year on his annual Pokemon PAX party; he makes up the shortfall from his wages managing a cafe. This year, Pokémon Company International sued him and told him that even though he’d cancelled this year’s party, they’d take everything he had unless he paid […]
With this year’s “ag-gag” law, Wyoming has made it a crime to gather evidence of agricultural wrongdoing, from illegal pollution to animal cruelty, even from public land — and also prohibits regulators from acting on information gathered in violation of the law.
Content-based App Store takedowns aren’t just for drone killing anymore: Apple’s also removed the Ifixit App, which offers you third-party manuals for fixing things you own, including your Apple products.
Power up your gadgets in the most unexpected places with the extremely compact SolarJuice battery pack. SolarJuice charges up at home like your average battery pack, but also lets you add extra juice on-the-go using its built-in solar panel—so you’ll never be left unplugged from the digital world.4.5 Stars on Amazon!Simultaneously charges 2 devices at […]
Hold your camera to higher standards with the brand-new iBlazr 2, the most advanced LED flash to date. Simply attach to your smartphone, tablet, or DSLR camera. Conveniently sized and wireless, this premium flash will let you easily take amazing photos in low light situations. It’s a literal snap to use: simply attach to your […]
Moment of truth: Is “Microsoft Office Expert” on your resume, but not totally accurate? This pay what you want bundle will not only help you brush up on old skills, but teach you advanced techniques that will impress your current and future boss. From intricate Excel formulas to Outlook organization hacks, you’ll not only boost […]