Research & Ethnography
What is unspoken
A nested classificatory hierarchy
Unfinished
Record them all
Recommendations for field notes
In Defense of Browsing
The illustrated guide to a Ph.D.
When users never use the features they asked for
An Article by Austin Z. HenleyWe deployed our tool. Almost no one used it.
The handful that did use it, used it once or twice and barely interacted with it. After a few days, zero people were using it.
Why did they tell me they wanted these features?
Why Most Published Research Findings Are False
A Research Paper by John P.A. IoannidisThere is increasing concern that most current published research findings are false. The probability that a research claim is true may depend on study power and bias, the number of other studies on the same question, and, importantly, the ratio of true to no relationships among the relationships probed in each scientific field. In this framework, a research finding is less likely to be true when the studies conducted in a field are smaller; when effect sizes are smaller; when there is a greater number and lesser preselection of tested relationships; where there is greater flexibility in designs, definitions, outcomes, and analytical modes; when there is greater financial and other interest and prejudice; and when more teams are involved in a scientific field in chase of statistical significance.
How can we develop transformative tools for thought?
A Research Paper by Andy Matuschak & Michael NielsenConventional tech industry product practice will not produce deep enough subject matter insights to create transformative tools for thought.
...The aspiration is for any team serious about making transformative tools for thought. It’s to create a culture that combines the best parts of modern product practice with the best parts of the (very different) modern research culture. You need the insight-through-making loop to operate, whereby deep, original insights about the subject feed back to change and improve the system, and changes to the system result in deep, original insights about the subject.
A hypothesis is a liability
A Research Paper by Itai Yanai & Martin LercherThere is a hidden cost to having a hypothesis. It arises from the relationship between night science and day science, the two very distinct modes of activity in which scientific ideas are generated and tested, respectively [1, 2]. With a hypothesis in hand, the impressive strengths of day science are unleashed, guiding us in designing tests, estimating parameters, and throwing out the hypothesis if it fails the tests. But when we analyze the results of an experiment, our mental focus on a specific hypothesis can prevent us from exploring other aspects of the data, effectively blinding us to new ideas.
Keep digging
An Article by Ryan SingerThe hardest thing about customer interviews is knowing where to dig. An effective interview is more like a friendly interrogation. We don’t want to learn what customers think about the product, or what they like or dislike — we want to know what happened and how they chose... To get those answers we can’t just ask surface questions, we have to keep digging back behind the answers to find out what really happened.
Fast Path to a Great UX – Increased Exposure Hours
An Article by Jared SpoolAs we’ve been researching what design teams need to do to create great user experiences, we’ve stumbled across an interesting finding. It’s the closest thing we’ve found to a silver bullet when it comes to reliably improving the designs teams produce.
The solution? Exposure hours. The number of hours each team member is exposed directly to real users interacting with the team’s designs or the team’s competitor’s designs. There is a direct correlation between this exposure and the improvements we see in the designs that team produces.
Weighing up UX
An Article by Jeremy KeithMetrics come up when we’re talking about A/B testing, growth design, and all of the practices that help designers get their seat at the table (to use the well-worn cliché). But while metrics are very useful for measuring design’s benefit to the business, they’re not really cut out for measuring user experience.
Monkeys testing random designs
A Tweet by Jared SpoolA/B testing is an effective approach to use science to design and deliver deeply-frustrating user experiences.
A/B testing without upfront research is just random monkeys testing random designs to see which of those designs do “best” against random criteria.
If drug testing was actually implemented like most A/B tests, you’d give 2 drugs to 2 groups of people and pick the “winner” by whichever group had fewer deaths.
You and Your Research
A Speech by Richard HammingThis talk centered on Hamming's observations and research on the question "Why do so few scientists make significant contributions and so many are forgotten in the long run?"
The Poetics of Space
Poetic drugs
In the final chapters Bachelard lets slip (a confession really) how if he "were a psychiatrist," he would recommend a poem by Baudelaire to treat "anguish." His squabble then is not with the purpose but rather the approach of a still-young profession. And of course, why not treat the power of great poems as something akin to "virtual 'drugs'"?
The world itself dreams
For Plato and many medieval philosophers, imagination was construed primarily as a mimetic act of mirroring, representing, copying. This approach was often associated with deceit and illusion, with confounding original realities with secondary substitutes. By contrast, for Kant and the romantics—including German idealists and existentialists like Sartre—imagination was hailed as a productive force in its own right, the source of all true meaning and value.
Bachelard resisted both extremes. For him, imagination was at once receptive and creative—an acoustic of listening and an art of participation. The two functions, passive and active, were inseparable. The world itself dreams, he said, and we help give it voice.
The past of his image upon me
The poet does not confer the past of his image upon me, and yet his image immediately takes root in me. The communicability of an unusual image is a fact of great ontological significance.
In the world of sunlight
And here we come back to that forgotten, outcast word, the soul.
Indeed, the soul possesses an inner light, the light that an inner vision knows and expresses in the world of brilliant colors, in the world of sunlight.
Refuges
Of course, thanks to the house, a great many of our memories are housed, and if the house is a bit elaborate, if it has a cellar and a garret, nooks and corridors, our memories have refuges that are all the more clearly delineated. All our lives we come back to them in our daydreams.
Deprived of all thickness
Here space is everything, for time ceases to quicken memory. Memory—what a strange thing it is!—does not record concrete duration, in the Bergsonian sense of the word. We are unable to relive duration that has been destroyed. We can only think of it, in the line of an abstract time that is deprived of all thickness. The finest specimens of fossilized duration concretized as a result of long sojourn, are to be found in and through space.
Memories are motionless, and the more securely they are fixed in space, the sounder they are.
The odor of raisins
What would be the use, for instance, in giving the plan of the room that was really my room, in describing the little room at the end of the garret, in saying that from the window, across the indentations of the roofs, one could see the hill. I alone, in my memories of another century, can open the deep cupboard that still retains for me alone that unique odor, the odor of raisins drying on a wicker tray. The odor of raisins! It is an odor that is beyond description, one that it takes a lot of imagination to smell. But I've already said too much. If I said more, the reader, back in his own room, would not open that unique wardrobe, with its unique smell, which is the signature of intimacy.
Oneiric topography
If I were the architect of an oneiric house, I should hesitate between a three-story house and one with four. A three-story house, which is the simplest as regards essential height, has a cellar, a ground floor, and an attic; while a four-story house puts a floor between the ground floor and the attic. One floor more, and our dreams become blurred. In the oneiric house, topoanalysis only knows how to count to three or four.
Winter is by far the oldest of the seasons
...and we feel warm because it is cold out-of-doors.
I am the space where I am
Je suis l'espace où je suis.
This is a great line. But nowhere can it be better appreciated than in a corner.
My house is diaphanous
My house is diaphanous, but it is not made of glass. It is more of the nature of vapor. Its walls contract and expand as I desire.