12 Mistakes to Avoid in an A/B Test

Photo by Maksim Goncharenok from Pexels

Testing mistake #1 — Wasting time on stupid tests

Testing mistake #2 — You think you know what will work

Photo by Pavel Churiumov on Unsplash

Testing mistake #3 Copying other people tests

Testing mistake #4 — Too low sample size

Testing mistake #5 — You run tests on pages with very little traffic

Testing mistake #6 — Tests don’t run long enough

Photo by Brooke Lark on Unsplash

Testing mistake #7 — Test full weeks — not middle of the week

Testing mistake #8 — Test data is not sent to third-party analytics

Testing mistake #9 — You give up after your first hypothesis fails

Testing mistake #10 — Validity threats

Testing mistake #11 — Ignoring small gains

Testing mistake #12 — You’re not running tests all the time

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store