Research & Ethnography
What is unspoken
A nested classificatory hierarchy
Unfinished
Record them all
Recommendations for field notes
In Defense of Browsing
The illustrated guide to a Ph.D.
When users never use the features they asked for
An Article by Austin Z. HenleyWe deployed our tool. Almost no one used it.
The handful that did use it, used it once or twice and barely interacted with it. After a few days, zero people were using it.
Why did they tell me they wanted these features?
Why Most Published Research Findings Are False
A Research Paper by John P.A. IoannidisThere is increasing concern that most current published research findings are false. The probability that a research claim is true may depend on study power and bias, the number of other studies on the same question, and, importantly, the ratio of true to no relationships among the relationships probed in each scientific field. In this framework, a research finding is less likely to be true when the studies conducted in a field are smaller; when effect sizes are smaller; when there is a greater number and lesser preselection of tested relationships; where there is greater flexibility in designs, definitions, outcomes, and analytical modes; when there is greater financial and other interest and prejudice; and when more teams are involved in a scientific field in chase of statistical significance.
How can we develop transformative tools for thought?
A Research Paper by Andy Matuschak & Michael NielsenConventional tech industry product practice will not produce deep enough subject matter insights to create transformative tools for thought.
...The aspiration is for any team serious about making transformative tools for thought. It’s to create a culture that combines the best parts of modern product practice with the best parts of the (very different) modern research culture. You need the insight-through-making loop to operate, whereby deep, original insights about the subject feed back to change and improve the system, and changes to the system result in deep, original insights about the subject.
A hypothesis is a liability
A Research Paper by Itai Yanai & Martin LercherThere is a hidden cost to having a hypothesis. It arises from the relationship between night science and day science, the two very distinct modes of activity in which scientific ideas are generated and tested, respectively [1, 2]. With a hypothesis in hand, the impressive strengths of day science are unleashed, guiding us in designing tests, estimating parameters, and throwing out the hypothesis if it fails the tests. But when we analyze the results of an experiment, our mental focus on a specific hypothesis can prevent us from exploring other aspects of the data, effectively blinding us to new ideas.
Keep digging
An Article by Ryan SingerThe hardest thing about customer interviews is knowing where to dig. An effective interview is more like a friendly interrogation. We don’t want to learn what customers think about the product, or what they like or dislike — we want to know what happened and how they chose... To get those answers we can’t just ask surface questions, we have to keep digging back behind the answers to find out what really happened.
Fast Path to a Great UX – Increased Exposure Hours
An Article by Jared SpoolAs we’ve been researching what design teams need to do to create great user experiences, we’ve stumbled across an interesting finding. It’s the closest thing we’ve found to a silver bullet when it comes to reliably improving the designs teams produce.
The solution? Exposure hours. The number of hours each team member is exposed directly to real users interacting with the team’s designs or the team’s competitor’s designs. There is a direct correlation between this exposure and the improvements we see in the designs that team produces.
Weighing up UX
An Article by Jeremy KeithMetrics come up when we’re talking about A/B testing, growth design, and all of the practices that help designers get their seat at the table (to use the well-worn cliché). But while metrics are very useful for measuring design’s benefit to the business, they’re not really cut out for measuring user experience.
Monkeys testing random designs
A Tweet by Jared SpoolA/B testing is an effective approach to use science to design and deliver deeply-frustrating user experiences.
A/B testing without upfront research is just random monkeys testing random designs to see which of those designs do “best” against random criteria.
If drug testing was actually implemented like most A/B tests, you’d give 2 drugs to 2 groups of people and pick the “winner” by whichever group had fewer deaths.
You and Your Research
A Speech by Richard HammingThis talk centered on Hamming's observations and research on the question "Why do so few scientists make significant contributions and so many are forgotten in the long run?"
On Love
Not knowing quite what they mean
"Do you understand all the symbolism?"
"Not really, besides its being Venus and Cupid."
"I didn't even know that, so you're one up on me. I wish I'd read more about ancient mythology," she continued. "But actually, I like looking at things and not knowing quite what they mean."
We're not children, you know
We're not children, you know.
And with these words, she placed her lips on mine and we embarked on one of the longer and more beautiful kisses mankind has ever known.
To think
Few things are as antithetical to sex as thought. Sex is instinctive, unreflective, and spontaneous, while thought is careful, uninvolved, and judgmental. To think during sex is to violate a fundamental law of intercourse.
A cruel paradox
When we look at someone (an angel) from a position of unrequited love and imagine the pleasures that being in heaven with them might bring us, we are prone to overlook a significant danger: how soon their attractions might pale if they began to love us back. We fall in love because we long to escape from ourselves with someone as ideal as we are corrupt. But what if such a being were one day to turn around and love us back? We can only be shocked. How could they be as divine as we had hoped when they have the bad taste to approve of someone like us? If in order to love we must believe that the beloved surpasses us in some way, does not a cruel paradox emerge when we witness this love returned? "If s/he really is so wonderful, how could s/he love someone like me?"
Shoes
It was perhaps a pedantic matter over which to come to such a decision, but shoes are supreme symbols of aesthetic, and hence by extension psychological, compatibility. Certain areas and coverings of the body say more about a person than others: shoes suggest more than pullovers, thumbs more than elbows, underwear more than overcoats, ankles more than shoulders.
I marshmallow you
Then I noticed a small plate of complimentary marshmallows near Chloe's elbow and it suddenly seemed clear that I didn't love Chloe so much as marshmallow her. What it was about a marshmallow that should suddenly have accorded so perfectly with my feelings toward her, I will never know, but the word seemed to capture the essence of my amorous state with an accuracy that the word 'love', weary with overuse, simply could not aspire to.
From then on, love was, for Chloe and me at least, no longer simply love, it was a sugary, puffy object a few millimeters in diameter that melts deliciously in the mouth.
A social animal
What does it mean that man is a "social animal"? Only that humans need one another in order to define themselves and achieve self-consciousness, in a way that mollusks and earthworms do not. We cannot come to a proper sense of ourselves if there aren't others around to show us what we're like.
"A man can acquire anything in solitude except a character," wrote Stendhal.
Possible lives
Watching Alice talk, light a candle that had blown out, rush into the kitchen with the plates, or brush a strand of blonde hair from her face, I found myself falling victim to romantic nostalgia, which descends whenever we are faced with those who might have been our lovers, but whom chance has decreed we will never properly know. The possibility of an alternative love story is a reminder that the life we are leading is only one of a myriad of possible lives, and it is the impossibility of leading them all that plunges us into sadness.
The threat of happiness
Dr. Saavedra had diagnosed a case of anhedonia, a disease defined by the British Medical Association as a reaction remarkably close to mountain sickness resulting from the sudden terror brought on by the threat of happiness. It was a common disease among tourists in this region of Spain, faced in these idyllic surroundings with the sudden realization that earthly happiness might be within their grasp, and prey therefore to a violent physiological reaction designed to counteract such a daunting possibility.
I don't see a wall
"I don't know, really. It's just a sense I have that ever since about the middle of September, we haven't really been communicating. It's like there's a wall between us and you're refusing to acknowledge it's there."
"I don't see a wall."
"That's what I mean. You're refusing to admit there was ever anything other than this."
"Than what?"
Romantic terrorism
Once a partner has begun to lose interest, there is apparently little the other can do to arrest the process. Like seduction, withdrawal suffers under a blanket of reticence. The very breakdown of communication is hard to discuss, unless both parties have a desire to see it restored.
This leaves the lover in a desperate situation. Honest dialogue seems to produce only irritation and smothers love in the attempt to revive it. Desperate to woo the partner back at any cost, the lover might at this point be tempted to turn to romantic terrorism, the product of irredeemable situations, a gamut of tricks (sulking, jealousy, guilt) that attempt to force the partner to return love, by blowing up (in fits of tears, rage, or otherwise) in front of the loved one. The terroristic partner knows he cannot realistically hope to see his love reciprocated, but the futility of something is not always (in love or in politics) a sufficient argument against it.
Certain things are said not because they will be heard, but because it is important to speak.
Walls
As the plane pierced through the clouds, I tried to imagine a future: a period of life was coming brutally to an end, and I had nothing to replace it with, only a terrifying absence.
What would life mean from now on? Though we continued holding hands, I knew how Chloe and I would watch our bodies grow foreign to each other. Walls would be build up, the separation would be institutionalized, I would meet her in a few months or years, we would be light, jovial, masked, dressed for business, ordering a salad in a restaurant—unable to touch what we were now revealing: the sheer human drama, the nakedness, the dependency, the unalterable loss. We would be like an audience emerging from a heart-wrenching play but unable to communicate any of the emotions they had felt inside, able only to head for a drink at the bar, knowing there was more, but unable to touch it.
In order that
No philosophy is further from the thought that what happens to us is random than psychoanalysis. I did not simply love Chloe and then she left me. I loved Chloe in order that she would leave me. It was not for the shape of her smile or the liveliness of her mind that I had chosen Chloe. It was because the unconscious, perverse casting director of my life had recognized in her a suitable character to leave the stage after inflicting the requisite amount of suffering.
The significance of love's burden
There is an Arabic saying that the soul travels at the pace of a camel. While most of our self is led by the strict demands of timetables and diaries, our soul, the seat of the heart, trails nostalgically behind, burdened by the weight of memory. If every love affair adds a certain weight to the camel's load, then we can expect the soul to slow according to the significance of love's burden.
What does wisdom counsel?
We start trying to be wise when we realize that we are not born knowing how to live, that living one's life is a skill that has to be acquired, like learning to ride a bicycle or play the piano. But what does wisdom counsel us to do? It tells us to aim for tranquility and inner peace, a life free from anxiety, fear, idolatry, and harmful passions. Wisdom teaches us that our first impulses may not always be trustworthy, and that our appetites will lead us astray if we do not train reason to separate vain from genuine needs.
Once again begun to fall
Such lessons appeared all the more relevant when Rachel accepted my invitation for dinner the following week, and the very thought of her began sending tremors through the region the poets have called the heart, tremors that I knew could have meant one thing only—that I had once again begun to fall.