Monkeys testing random designs

A Tweet by Jared Spool

A/B testing is an effective approach to use science to design and deliver deeply-frustrating user experiences.

A/B testing without upfront research is just random monkeys testing random designs to see which of those designs do “best” against random criteria.

If drug testing was actually implemented like most A/B tests, you’d give 2 drugs to 2 groups of people and pick the “winner” by whichever group had fewer deaths.