Research & Ethnography
What is unspoken
A nested classificatory hierarchy
Unfinished
Record them all
Recommendations for field notes
In Defense of Browsing
The illustrated guide to a Ph.D.
When users never use the features they asked for
An Article by Austin Z. HenleyWe deployed our tool. Almost no one used it.
The handful that did use it, used it once or twice and barely interacted with it. After a few days, zero people were using it.
Why did they tell me they wanted these features?
Why Most Published Research Findings Are False
A Research Paper by John P.A. IoannidisThere is increasing concern that most current published research findings are false. The probability that a research claim is true may depend on study power and bias, the number of other studies on the same question, and, importantly, the ratio of true to no relationships among the relationships probed in each scientific field. In this framework, a research finding is less likely to be true when the studies conducted in a field are smaller; when effect sizes are smaller; when there is a greater number and lesser preselection of tested relationships; where there is greater flexibility in designs, definitions, outcomes, and analytical modes; when there is greater financial and other interest and prejudice; and when more teams are involved in a scientific field in chase of statistical significance.
How can we develop transformative tools for thought?
A Research Paper by Andy Matuschak & Michael NielsenConventional tech industry product practice will not produce deep enough subject matter insights to create transformative tools for thought.
...The aspiration is for any team serious about making transformative tools for thought. It’s to create a culture that combines the best parts of modern product practice with the best parts of the (very different) modern research culture. You need the insight-through-making loop to operate, whereby deep, original insights about the subject feed back to change and improve the system, and changes to the system result in deep, original insights about the subject.
A hypothesis is a liability
A Research Paper by Itai Yanai & Martin LercherThere is a hidden cost to having a hypothesis. It arises from the relationship between night science and day science, the two very distinct modes of activity in which scientific ideas are generated and tested, respectively [1, 2]. With a hypothesis in hand, the impressive strengths of day science are unleashed, guiding us in designing tests, estimating parameters, and throwing out the hypothesis if it fails the tests. But when we analyze the results of an experiment, our mental focus on a specific hypothesis can prevent us from exploring other aspects of the data, effectively blinding us to new ideas.
Keep digging
An Article by Ryan SingerThe hardest thing about customer interviews is knowing where to dig. An effective interview is more like a friendly interrogation. We don’t want to learn what customers think about the product, or what they like or dislike — we want to know what happened and how they chose... To get those answers we can’t just ask surface questions, we have to keep digging back behind the answers to find out what really happened.
Fast Path to a Great UX – Increased Exposure Hours
An Article by Jared SpoolAs we’ve been researching what design teams need to do to create great user experiences, we’ve stumbled across an interesting finding. It’s the closest thing we’ve found to a silver bullet when it comes to reliably improving the designs teams produce.
The solution? Exposure hours. The number of hours each team member is exposed directly to real users interacting with the team’s designs or the team’s competitor’s designs. There is a direct correlation between this exposure and the improvements we see in the designs that team produces.
Weighing up UX
An Article by Jeremy KeithMetrics come up when we’re talking about A/B testing, growth design, and all of the practices that help designers get their seat at the table (to use the well-worn cliché). But while metrics are very useful for measuring design’s benefit to the business, they’re not really cut out for measuring user experience.
Monkeys testing random designs
A Tweet by Jared SpoolA/B testing is an effective approach to use science to design and deliver deeply-frustrating user experiences.
A/B testing without upfront research is just random monkeys testing random designs to see which of those designs do “best” against random criteria.
If drug testing was actually implemented like most A/B tests, you’d give 2 drugs to 2 groups of people and pick the “winner” by whichever group had fewer deaths.
You and Your Research
A Speech by Richard HammingThis talk centered on Hamming's observations and research on the question "Why do so few scientists make significant contributions and so many are forgotten in the long run?"
A Burglar's Guide to the City
To commune with the space
...having realized long ago that the best way to commune with an architectural space was by breaking into it.
Every building is infinite
For the burglar, every building is infinite.
Putting the streets to use
Tad Friend writes, if you build “nine hundred miles of sinuous highway and twenty-one thousand miles of tangled surface streets” in one city alone, then you’re going to find at least a few people who want to put those streets to use. This suggests that every city blooms with the kinds of crime most appropriate to its form.
Topology by other means
The burglar is a three-dimensional actor amid the two-dimensional surfaces and objects of the city. This means operating with a fundamentally different spatial sense of how architecture should work, and how one room could be connected to another. It means seeing how a building can be stented: engineering short-circuits where mere civilians, altogether less aggressive users of the city, would never expect to find them. Burglary is topology pursued by other means: a new science of the city, proceeding by way of shortcuts, splices, and wormholes.
Burglary's White Whale
If all cities already contain the crimes that will occur there, then, taken to its logical conclusion, this suggests there might be a kind of Moby-Dick of crime, a White Whale of urban burglary: a town or city so badly designed that the entire place can be robbed in one go.
Tarzan of the concrete jungle
Weissmuller was most famous for playing Tarzan, and swinging into his apartment from a ledge outside had a wild irony, like some new Tarzan of the concrete jungle updating the character for an urban age.
The source code for SimCity
Local Code was Sorkin’s attempt to design a whole city from scratch—with one big twist. The whole thing had been written as if it were the byzantine, nearly impossible to follow codes and regulations for an entire, hypothetical metropolis. The effect is like stumbling upon the source code for SimCity. Sorkin’s exhaustively made point was that, if you know everything about a given metropolis, from its plumbing standards to its parking requirements, its sewer capacity to the borders of its school districts, then you could more or less accurately imagine the future form of that city from the ground up.
Architectural dark matter
Every building had its rhythms. These service corridors were the internal hinterlands—the architectural dark matter—so beloved by Bill Mason.
Vamburglars
Burglary was originally only possible in a household or dwelling; the very word contains an etymological variant on the Latin burgus, for “castle” or “fortified home” (from which other words, such as burgher and even borough, also derive). Common law definitions of burglary also originally required the person to break into a house or dwelling at night. Giving historical burglary an oddly vampiric dimension, you could not, legally speaking, be a burglar while the sun was still out.
The close
Think of it as an invisible geometric shape perceptible only to lawyers—a conceptual pane of glass that might not have kept the rain out but could, for legal purposes, be used to define the original limits of the car’s interior. This is the close, and defining it is ultimately just a form of connecting the dots: drawing an imaginary line from the corner of an open window to the edge of a nearby wall to the front gate of a home garden, and so on.
Breaking the close thus constitutes entry into a “protected interior” or “specified enclosure".
To deter crime
“To deter crime,” Cisneros explains, “spaces should convey to would-be intruders a strong sense that if they enter they are very likely to be observed, to be identified as intruders, and to have difficulty escaping.”
Architectural sequences
Noted designer and architectural theorist Bernard Tschumi would call the predictable repetition of events inside an architectural space a sequence: a linear series of actions and behaviors that are at least partially determined by the design of the space itself.
Architectural screenplays
Tschumi began to explore this notion through what he called screenplays: each “screenplay” was a black-and-white diagram breaking down a range of events that might occur inside an architectural space. Tschumi drew them in a way that resembled dance notation or the spatial analysis of a film scene.
The City of Light
Streetlights were one of many new patrol tools implemented by Louis XIV’s lieutenant general of police, Gabriel Nicolas de la Reynie. De la Reynie’s plan ordered that lanterns be hung over the streets every sixty feet—with the unintended side effect that Paris soon gained its popular moniker, the City of Light. The world’s most romantic city takes its nickname from a police operation.
Spatial expectations
Loya, who served seven years in prison for multiple bank heists before becoming a writer, explained to me that it was during the getaway that he often had the best chance of thwarting people’s spatial expectations. In his case, this meant that what he did immediately after leaving the bank was often the most important decision of all.
The getaway to end all getaways
Any attempt to track down the perfect getaway is made all the more complex because almost everything we know about burglary—including how they did (or did not) get away—comes from the burglars we’ve caught. As sociologist R. I. Mawby pithily phrases this dilemma, “Known burglars are unrepresentative of burglars in general.” Great methodological despair is hidden in such a comment. Studying burglary is thus a strangely Heisenbergian undertaking, riddled with uncertainty and distorted by moving data points. The getaway to end all getaways—the one that leaves us all scratching our heads—to no small extent remains impossible to study.
Every heist is a counterdesign
Heists obsess people because of what they reveal about architecture’s peculiar power: the design of new ways of moving through the world. Every heist is thus just a counterdesign—a response to the original architect.
All the things we want to do
This is precisely where “burglary” becomes a myth, a symbol, a metaphor: it stands in for all the things people really want to do with the built environment, what they really want to do to sidestep the obstacles of their lives.