Once you see that an answer is not serving its question properly anymore, it should be tossed away. It's just their natural life cycle.
They usually kick and scream, raising one hell of a ruckus when we ask them to leave. Especially when they have been with us for a long time.
You see, too many actions have been based on those answers. Too much work and energy invested on them. They feel so important, so full of themselves. They will answer to no one. Not even to their initial question!
The hardest thing about customer interviews is knowing where to dig. An effective interview is more like a friendly interrogation. We don’t want to learn what customers think about the product, or what they like or dislike — we want to know what happened and how they chose... To get those answers we can’t just ask surface questions, we have to keep digging back behind the answers to find out what really happened.
Prescriptive feedback limits creative collaboration. I’ve seen it time and time again, but I’ve struggled to articulate the exact reasons and their remedies. Recently, though, I got some insight from an unusual source: a game of chess.
In hand and brain chess, each team has two players: a “brain” and a “hand.” At the beginning of each turn, the “brain” tells the “hand” which piece to move, and the “hand” then has to move that piece, but can move it wherever they think it should go. No other communication is allowed.
In every feedback conversation, one person is the hand. That’s the person doing the design — they’ll leave the meeting and go back to their computer and fire up a dozen Adobe apps. The other people in the room (virtual or otherwise) are the brain. Regardless of their skill in design, it’s their job to give the hand some constraints to work within.