Research & Ethnography
What is unspoken
A nested classificatory hierarchy
Unfinished
Record them all
Recommendations for field notes
In Defense of Browsing
The illustrated guide to a Ph.D.
When users never use the features they asked for
An Article by Austin Z. HenleyWe deployed our tool. Almost no one used it.
The handful that did use it, used it once or twice and barely interacted with it. After a few days, zero people were using it.
Why did they tell me they wanted these features?
Why Most Published Research Findings Are False
A Research Paper by John P.A. IoannidisThere is increasing concern that most current published research findings are false. The probability that a research claim is true may depend on study power and bias, the number of other studies on the same question, and, importantly, the ratio of true to no relationships among the relationships probed in each scientific field. In this framework, a research finding is less likely to be true when the studies conducted in a field are smaller; when effect sizes are smaller; when there is a greater number and lesser preselection of tested relationships; where there is greater flexibility in designs, definitions, outcomes, and analytical modes; when there is greater financial and other interest and prejudice; and when more teams are involved in a scientific field in chase of statistical significance.
How can we develop transformative tools for thought?
A Research Paper by Andy Matuschak & Michael NielsenConventional tech industry product practice will not produce deep enough subject matter insights to create transformative tools for thought.
...The aspiration is for any team serious about making transformative tools for thought. It’s to create a culture that combines the best parts of modern product practice with the best parts of the (very different) modern research culture. You need the insight-through-making loop to operate, whereby deep, original insights about the subject feed back to change and improve the system, and changes to the system result in deep, original insights about the subject.
A hypothesis is a liability
A Research Paper by Itai Yanai & Martin LercherThere is a hidden cost to having a hypothesis. It arises from the relationship between night science and day science, the two very distinct modes of activity in which scientific ideas are generated and tested, respectively [1, 2]. With a hypothesis in hand, the impressive strengths of day science are unleashed, guiding us in designing tests, estimating parameters, and throwing out the hypothesis if it fails the tests. But when we analyze the results of an experiment, our mental focus on a specific hypothesis can prevent us from exploring other aspects of the data, effectively blinding us to new ideas.
Keep digging
An Article by Ryan SingerThe hardest thing about customer interviews is knowing where to dig. An effective interview is more like a friendly interrogation. We don’t want to learn what customers think about the product, or what they like or dislike — we want to know what happened and how they chose... To get those answers we can’t just ask surface questions, we have to keep digging back behind the answers to find out what really happened.
Fast Path to a Great UX – Increased Exposure Hours
An Article by Jared SpoolAs we’ve been researching what design teams need to do to create great user experiences, we’ve stumbled across an interesting finding. It’s the closest thing we’ve found to a silver bullet when it comes to reliably improving the designs teams produce.
The solution? Exposure hours. The number of hours each team member is exposed directly to real users interacting with the team’s designs or the team’s competitor’s designs. There is a direct correlation between this exposure and the improvements we see in the designs that team produces.
Weighing up UX
An Article by Jeremy KeithMetrics come up when we’re talking about A/B testing, growth design, and all of the practices that help designers get their seat at the table (to use the well-worn cliché). But while metrics are very useful for measuring design’s benefit to the business, they’re not really cut out for measuring user experience.
Monkeys testing random designs
A Tweet by Jared SpoolA/B testing is an effective approach to use science to design and deliver deeply-frustrating user experiences.
A/B testing without upfront research is just random monkeys testing random designs to see which of those designs do “best” against random criteria.
If drug testing was actually implemented like most A/B tests, you’d give 2 drugs to 2 groups of people and pick the “winner” by whichever group had fewer deaths.
You and Your Research
A Speech by Richard HammingThis talk centered on Hamming's observations and research on the question "Why do so few scientists make significant contributions and so many are forgotten in the long run?"
Towards a New Architecture
The house is a machine for living in
But men live in old houses
It is not right that we should produce bad things because of a bad tool; nor is it right that we should waste our energy, our health and our courage because of a bad tool; it must be thrown away and replaced.
But men live in old houses and they have not yet thought of building houses adapted to themselves.
Primitive resources
There is no such thing as primitive man; there are primitive resources.
Employs nothing at all
The man of today planes to perfection a board with a planing machine in a few seconds. The man of yesterday planed a board reasonably well with a plane. Very primitive man squared a board very badly with a flint or a knife. Very primitive man employed a unit of measurement and regulating lines in order to make his task easier. The Greek, the Egyptian, Michaelangelo or Blondel employed regulating lines in order to correct their work and for the satisfaction of their artist’s sense and of their mathematical thought. The man of today employs nothing at all and the result is the boulevard Raspail.
All the work of an epoch
Style is a unity of principle animating all the work of an epoch, the result of a state of mind which has its own special character.
Our own epoch is determining, day by day, its own style.
Our eyes, unhappily, are unable yet to discern it.A taste for fresh and clear daylight
Tail pieces and garlands, exquisite ovals where triangular doves preen themselves or one another, boudoirs embellished with “poufs” in gold and black velvet, are now no more than the intolerable witnesses to a dead spirit. These sanctuaries stifling with elegance, or on the other hand with the follies of “Peasant Art,” are an offense.
We have acquired a taste for fresh and and clear daylight.
Eyes which do not see
Our epoch is fixing its own style day by day. It is there under our eyes—Eyes which do not see.
The problem of the house has not yet been stated
The lesson of the airplane is not primarily in the forms it has created, and above all we must learn to see in an airplane not a bird or a dragon-fly, but a machine for flying; the lesson of the airplane lies in the logic which governed the enunciation of the problem and which led to its successful realization. When a problem is properly stated, in our epoch, it inevitably finds its solution.
The problem of the house has not yet been stated.
At the Green Mosque
In Broussa in Asia Minor, at the Green Mosque, you enter by a little doorway of normal human height; a quite small vestibule produces in you the necessary change of scale so that you may appreciate, as against the dimensions of the street and the spot you come from, the dimensions with which is is intended to impress you. Then you can feel the noble size of the mosque and your eyes can take its measure. You are in a great white marble space filled with light. Beyond you can see a second similar space of the same dimensions, but in half-light and raised on several steps (repetition in a minor key); on each side still a smaller space in subdued light; turning round, you have two very small spaces in shade.
From full light to shade, a rhythm. Tiny doors and enormous bays. You are captured, you have lost the sense of the common scale. You are enthralled by a sensorial rhythm (light and volume) and by an able use of scale and measure, into a world of its own which tells you what it set out to tell you.
Poems of an Indian summer
To build one's house is very much like making one’s will. When the time does arrive for building this house, it is not the mason’s nor the craftsman’s moment, but that moment in which every man makes one poem, at any rate, in his life. And so, in our towns and their outskirts, we have had during the last forty years not so much houses as poems, poems of an Indian summer, for a house is the crowning of a career.
A grave and noble beauty
An architecture of our own age is slowly but surely shaping itself; its main lines become more and more evident. The use of steel and reinforced concrete construction; of large areas of plate glass; of standardized units (as, for example, in metal windows); of the flat roof; of new synthetic materials and new surface treatments of metals that machinery made possible; of hints taken from the airplane, the motor-car or the steamship where it was never possible, from the beginning, to attack the problem from an academic standpoint—all these things are helping, at any rate, to produce a twentieth-century architecture whose lineaments are already clearly traceable. A certain squareness of mass and outline, a criss-cross or “grid-iron” treatment with an emphasis on the horizontals, an extreme bareness of wall surface, a pervading austerity and economy and a minimum of ornament; these are among its characteristics. There is evolving, we may begin to suppose, a grave and classical architecture whose fully developed expression should be of a noble beauty.