Once you see that an answer is not serving its question properly anymore, it should be tossed away. It's just their natural life cycle.
They usually kick and scream, raising one hell of a ruckus when we ask them to leave. Especially when they have been with us for a long time.
You see, too many actions have been based on those answers. Too much work and energy invested on them. They feel so important, so full of themselves. They will answer to no one. Not even to their initial question!
The hardest thing about customer interviews is knowing where to dig. An effective interview is more like a friendly interrogation. We don’t want to learn what customers think about the product, or what they like or dislike — we want to know what happened and how they chose... To get those answers we can’t just ask surface questions, we have to keep digging back behind the answers to find out what really happened.
In the middle of the 2000s, the designers at creative consultancy Landor installed Adobe Photoshop on their computers and started using it. General manager Antonio Marazza tells author David Sax:
“Overnight, the quality of their designs seemed to decline. After a few months of this, Landor’s Milan office gave all their designers Moleskine notebooks, and banned the use of Photoshop during the first week’s work on a project. The idea was to let their initial ideas freely blossom on paper, without the inherent bias of the software, before transferring them to the computer later for fine-tuning. It was so successful, this policy remains in place today.”