Research & Ethnography
What is unspoken
A nested classificatory hierarchy
Unfinished
Record them all
Recommendations for field notes
In Defense of Browsing
The illustrated guide to a Ph.D.
When users never use the features they asked for
An Article by Austin Z. HenleyWe deployed our tool. Almost no one used it.
The handful that did use it, used it once or twice and barely interacted with it. After a few days, zero people were using it.
Why did they tell me they wanted these features?
Why Most Published Research Findings Are False
A Research Paper by John P.A. IoannidisThere is increasing concern that most current published research findings are false. The probability that a research claim is true may depend on study power and bias, the number of other studies on the same question, and, importantly, the ratio of true to no relationships among the relationships probed in each scientific field. In this framework, a research finding is less likely to be true when the studies conducted in a field are smaller; when effect sizes are smaller; when there is a greater number and lesser preselection of tested relationships; where there is greater flexibility in designs, definitions, outcomes, and analytical modes; when there is greater financial and other interest and prejudice; and when more teams are involved in a scientific field in chase of statistical significance.
How can we develop transformative tools for thought?
A Research Paper by Andy Matuschak & Michael NielsenConventional tech industry product practice will not produce deep enough subject matter insights to create transformative tools for thought.
...The aspiration is for any team serious about making transformative tools for thought. It’s to create a culture that combines the best parts of modern product practice with the best parts of the (very different) modern research culture. You need the insight-through-making loop to operate, whereby deep, original insights about the subject feed back to change and improve the system, and changes to the system result in deep, original insights about the subject.
A hypothesis is a liability
A Research Paper by Itai Yanai & Martin LercherThere is a hidden cost to having a hypothesis. It arises from the relationship between night science and day science, the two very distinct modes of activity in which scientific ideas are generated and tested, respectively [1, 2]. With a hypothesis in hand, the impressive strengths of day science are unleashed, guiding us in designing tests, estimating parameters, and throwing out the hypothesis if it fails the tests. But when we analyze the results of an experiment, our mental focus on a specific hypothesis can prevent us from exploring other aspects of the data, effectively blinding us to new ideas.
Keep digging
An Article by Ryan SingerThe hardest thing about customer interviews is knowing where to dig. An effective interview is more like a friendly interrogation. We don’t want to learn what customers think about the product, or what they like or dislike — we want to know what happened and how they chose... To get those answers we can’t just ask surface questions, we have to keep digging back behind the answers to find out what really happened.
Fast Path to a Great UX – Increased Exposure Hours
An Article by Jared SpoolAs we’ve been researching what design teams need to do to create great user experiences, we’ve stumbled across an interesting finding. It’s the closest thing we’ve found to a silver bullet when it comes to reliably improving the designs teams produce.
The solution? Exposure hours. The number of hours each team member is exposed directly to real users interacting with the team’s designs or the team’s competitor’s designs. There is a direct correlation between this exposure and the improvements we see in the designs that team produces.
Weighing up UX
An Article by Jeremy KeithMetrics come up when we’re talking about A/B testing, growth design, and all of the practices that help designers get their seat at the table (to use the well-worn cliché). But while metrics are very useful for measuring design’s benefit to the business, they’re not really cut out for measuring user experience.
Monkeys testing random designs
A Tweet by Jared SpoolA/B testing is an effective approach to use science to design and deliver deeply-frustrating user experiences.
A/B testing without upfront research is just random monkeys testing random designs to see which of those designs do “best” against random criteria.
If drug testing was actually implemented like most A/B tests, you’d give 2 drugs to 2 groups of people and pick the “winner” by whichever group had fewer deaths.
You and Your Research
A Speech by Richard HammingThis talk centered on Hamming's observations and research on the question "Why do so few scientists make significant contributions and so many are forgotten in the long run?"
The Architecture of Happiness
A few millimeters apart
Aesthetes force us to consider whether happiness may not sometimes turn on the presence or absence of a fingerprint, whether in certain situations beauty and ugliness may not lie only a few millimeters apart, whether a single mark might not wreck a wall or an errant brush stroke undo a landscape painting.
Tragic colors
Life may have to show itself to us in some of its authentically tragic colors before we can begin to grow properly visually responsive to its subtler offerings.
Classical absurdity
Corbusier observed that the requirements of flight of necessity rid airplanes of all superfluous decoration and so unwittingly transformed them into successful pieces of architecture. To place a Classical statue atop a house was as absurd as to add one to a plane, he noted, but at least by crashing in response to this addition, the plane had the advantage of rendering its absurdity starkly manifest.
Ideas of a good life
In essence, what works of design and architecture talk to us about is the kind of life that would most appropriately unfold within and around them. They tell us of certain moods that they seek to encourage and sustain in their inhabitants. While keeping us warm and helping us in mechanical ways, they simultaneously hold out an invitation for us to be specific sorts of people. They speak of visions of happiness.
To describe a building as beautiful therefore suggests more than a mere aesthetic fondness; it implies an attraction to the particular way of life this structure is promoting through its roof, door handles, window frames, staircase, and furnishings. A feeling of beauty is a sign that we have come upon a material articulation of certain of our ideas of a good life.
The people we love
The objects we describe as beautiful are versions of the people we love.
The search for happiness
If the search for happiness is the underlying quest of our lives, it seems only natural that it should simultaneously be the essential theme to which beauty alludes.
An equivalence
In both early Christianity and Islam, theologians made a claim about architecture likely to sound so peculiar to modern ears as to be worth of sustained examination: they proposed that beautiful buildings had the power to improve us morally and spiritually. They believed that, rather than corrupting us, rather than being an idle indulgence for the decadent, exquisite surroundings could edge us towards perfection. A beautiful building could reinforce our resolve to be good.
Behind this distinctive claim lay another astonishing belief: that of an equivalence between the visual and ethical realms.
Inwardly to resemble
What we want, at the deepest level, is inwardly to resemble, rather than physically to possess, the objects and places that touch us through their beauty.
We can conclude from this that we are drawn to call something beautiful whenever we detect that it contains in a concentrated form those qualities which we personally, or our societies more generally, are deficient.
The gathering darkness of a Sunday evening
Our jobs make relentless calls on a narrow band of our faculties, reducing our chances of achieving rounded personalities and leaving us to suspect (often in the gathering darkness of a Sunday evening) that much of who we are, or could be, has gone unexplored.
What we don't like
A grasp of the psychological mechanism behind taste may not change our sense of what we find beautiful, but it can prevent us from reacting to what we don’t like with simple disbelief.
Our understanding of the psychology of taste can in turn help us to escape from the two great dogmas of aesthetics: the view that there is only one acceptable visual style or (even more implausibly) that all styles are equally valid.
Over-imagination
An architect intent on being different may in the end prove as troubling as an over-imaginative pilot or doctor. However important originality may be in some fields, restraint and adherence to procedure emerge as the more significant virtues in a great many others.
We rarely wish to be surprised by novelty as we round street corners. We require consistency in our buildings, for we are ourselves frequently close to disorientation and frenzy.
The extremes of order and complexity
Such works emphasize the truth of the ancient maxim that beauty lies between the extremes of order and complexity.
It follows that the balance we approve of in architecture, and which we anoint with the word ‘beautiful’, alludes to a state that, on a psychological level, we can describe as mental health or happiness. Like buildings, we, too, contain opposites which can be more or less successfully handled.
Beauty and strength
Yet the bridge testifies to how closely a certain kind of beauty is bound up with our admiration for strength, for man-made objects which can withstand the life-destroying forces of heat, cold, gravity or wind.
We respond with emotion to creations which transport us across distances we could never walk, which shelter us during storms we could not weather, which pick up signals we could never hear with our own ears and which hang daintily off cliffs from which we would fall instantly to our deaths.
With grace and economy
Both bridges accomplish daring feats, but Maillart’s possesses the added virtue of making its achievement look effortless - and because we sense it isn’t, we wonder at it and admire it all the more. The bridge is endowed with a subcategory of beauty we can refer to as elegance, a quality present whenever a work of architecture succeeds in carrying out an act of resistance - holding, spanning, sheltering - with grace and economy as well as strength; when it has the modesty not to draw attention to the difficulties it has surmounted.
The dignity of age
Wood and stone, and now concrete and wood, age slowly and with dignity. They do not shatter hysterically like glass, or tear like paper, but discolor with a melancholy, noble air.
Apportioning value
Contrary to the Romantic belief that we each settle naturally on a fitting idea of beauty, it seems that our visual and emotional faculties in fact need constant external guidance to help them decide what they should take note of and appreciate. ‘Culture’ is the word we have assigned to the force that assists us in identifying which of our many sensations we should focus on and apportion value to.
There was no fog in London
It is books, poems and paintings which often give us the confidence to take seriously feelings in ourselves that we might otherwise never have thought to acknowledge. Oscar Wilde referred to this phenomenon when he quipped that there was no fog in London before Whistler started painting the Thames. Likewise, there must have been little beauty in old stones before Japanese priests and poets began writing about them.
To the worms and the trees
We owe it to the fields that our houses will not be the inferiors of the virgin land they have replaced. We owe it to the worms and the trees that the buildings we cover them with will stand as promises of the highest and most intelligent kinds of happiness.