A/B Testing Is a Waste of Time in B2B

12/08/2025 26 min
A/B Testing Is a Waste of Time in B2B

Listen "A/B Testing Is a Waste of Time in B2B"

Episode Synopsis

If you’ve ever been asked to A/B test a page with 37 visits, this one’s for you.In this episode of All the Hats, Ómar Thor Ómarsson and Alicja Lei dismantle one of the most overhyped practices in B2B marketing: A/B testing. From statistical illusions to traffic volume myths, they walk through why the math just doesn’t work for most small teams — and what to do instead.This episode cuts through the performative testing mindset and gets to what actually works when you’re trying to move the needle with limited data and limited time.In this episode:Why most B2B A/B tests are doomed from the startThe minimum data you actually need for statistical significanceWhat to do instead when you're testing messaging, landing pages, or campaignsHow to talk about this with stakeholders who are obsessed with “running a test”