As we’ve been researching what design teams need to do to create great user experiences, we’ve stumbled across an interesting finding. It’s the closest thing we’ve found to a silver bullet when it comes to reliably improving the designs teams produce.
The solution? Exposure hours. The number of hours each team member is exposed directly to real users interacting with the team’s designs or the team’s competitor’s designs. There is a direct correlation between this exposure and the improvements we see in the designs that team produces.
The horizontal axis represents the investment the organization makes. As investment increases, the organization spends more resources on improving the quality (remember, Noriaka was a quality guy at heart) or adding new capabilities.
The vertical dimension represents the satisfaction of the user, moving from an extreme negative of frustration to an extreme positive of delight. (Neutral satisfaction being neither frustrated nor delighted is in the middle of the axis.)
It’s against the backdrop of these two axes that we see how the Kano Model works. It shows us there are three forces at work, which we can use to predict our users’ satisfaction with the investment we make.
A/B testing is an effective approach to use science to design and deliver deeply-frustrating user experiences.
A/B testing without upfront research is just random monkeys testing random designs to see which of those designs do “best” against random criteria.
If drug testing was actually implemented like most A/B tests, you’d give 2 drugs to 2 groups of people and pick the “winner” by whichever group had fewer deaths.
Though you might not think it from the comic, I’m actually sympathetic to questions about tools and process, as I myself am a kind of process junky. I love hearing about how other writers work.
I’m also not someone who dismisses questions about tools with the line “the tools don’t matter.” In fact, I think tools matter so much that if you don’t talk about them correctly you can do some damage.
...What I love about John Gardner and Lynda Barry is that they believe that the tools you use do matter, but the point, for them, is finding the proper tools that get you to a certain way of working in which you can get your conscious, mechanical mind out of the way so that your dreaming can go on, undeterred.
You have to find the right tools to help your voice sing.