Eppo reposted this
A/B TESTING IS DEAD! THE AI REVOLUTION IS HERE! ...or at least that's what some blog posts and software vendors and LinkedIn pundits would tell you. Normally when you hear this rhetoric, the "pitch" - either explicitly, or under the hood - is to replace A/B tests with multi-armed bandit algorithms. Multi-armed bandits are more optimal, faster to realize gains, automated, machine learning... but how much of this is real promise vs. just hype? I sat down with Chetan Sharma and Sven Schmit to get to the bottom of this: down to specific, practical use cases where you should ditch randomized controlled trials for bandit algorithms, and where you should stick to the classics. Check it out on the Outperform podcast: https://lnkd.in/eAccpyAY (also available on Spotify, Apple, and anywhere else you listen to podcasts!) #experimentation #machinelearning #AI