Research & Ethnography
What is unspoken
A nested classificatory hierarchy
Unfinished
Record them all
Recommendations for field notes
In Defense of Browsing
The illustrated guide to a Ph.D.
When users never use the features they asked for
An Article by Austin Z. HenleyWe deployed our tool. Almost no one used it.
The handful that did use it, used it once or twice and barely interacted with it. After a few days, zero people were using it.
Why did they tell me they wanted these features?
Why Most Published Research Findings Are False
A Research Paper by John P.A. IoannidisThere is increasing concern that most current published research findings are false. The probability that a research claim is true may depend on study power and bias, the number of other studies on the same question, and, importantly, the ratio of true to no relationships among the relationships probed in each scientific field. In this framework, a research finding is less likely to be true when the studies conducted in a field are smaller; when effect sizes are smaller; when there is a greater number and lesser preselection of tested relationships; where there is greater flexibility in designs, definitions, outcomes, and analytical modes; when there is greater financial and other interest and prejudice; and when more teams are involved in a scientific field in chase of statistical significance.
How can we develop transformative tools for thought?
A Research Paper by Andy Matuschak & Michael NielsenConventional tech industry product practice will not produce deep enough subject matter insights to create transformative tools for thought.
...The aspiration is for any team serious about making transformative tools for thought. It’s to create a culture that combines the best parts of modern product practice with the best parts of the (very different) modern research culture. You need the insight-through-making loop to operate, whereby deep, original insights about the subject feed back to change and improve the system, and changes to the system result in deep, original insights about the subject.
A hypothesis is a liability
A Research Paper by Itai Yanai & Martin LercherThere is a hidden cost to having a hypothesis. It arises from the relationship between night science and day science, the two very distinct modes of activity in which scientific ideas are generated and tested, respectively [1, 2]. With a hypothesis in hand, the impressive strengths of day science are unleashed, guiding us in designing tests, estimating parameters, and throwing out the hypothesis if it fails the tests. But when we analyze the results of an experiment, our mental focus on a specific hypothesis can prevent us from exploring other aspects of the data, effectively blinding us to new ideas.
Keep digging
An Article by Ryan SingerThe hardest thing about customer interviews is knowing where to dig. An effective interview is more like a friendly interrogation. We don’t want to learn what customers think about the product, or what they like or dislike — we want to know what happened and how they chose... To get those answers we can’t just ask surface questions, we have to keep digging back behind the answers to find out what really happened.
Fast Path to a Great UX – Increased Exposure Hours
An Article by Jared SpoolAs we’ve been researching what design teams need to do to create great user experiences, we’ve stumbled across an interesting finding. It’s the closest thing we’ve found to a silver bullet when it comes to reliably improving the designs teams produce.
The solution? Exposure hours. The number of hours each team member is exposed directly to real users interacting with the team’s designs or the team’s competitor’s designs. There is a direct correlation between this exposure and the improvements we see in the designs that team produces.
Weighing up UX
An Article by Jeremy KeithMetrics come up when we’re talking about A/B testing, growth design, and all of the practices that help designers get their seat at the table (to use the well-worn cliché). But while metrics are very useful for measuring design’s benefit to the business, they’re not really cut out for measuring user experience.
Monkeys testing random designs
A Tweet by Jared SpoolA/B testing is an effective approach to use science to design and deliver deeply-frustrating user experiences.
A/B testing without upfront research is just random monkeys testing random designs to see which of those designs do “best” against random criteria.
If drug testing was actually implemented like most A/B tests, you’d give 2 drugs to 2 groups of people and pick the “winner” by whichever group had fewer deaths.
You and Your Research
A Speech by Richard HammingThis talk centered on Hamming's observations and research on the question "Why do so few scientists make significant contributions and so many are forgotten in the long run?"
The Elements of Style
- Choose a suitable design and hold to it
- Make the paragraph the unit of composition
- Use the active voice
- Put statements in positive form
- Specific, definite, concrete
Choose a suitable design and hold to it
A basic structural design underlies every kind of writing.
Writing, to be effective, must follow closely the thoughts of the writer, but not necessarily the order in which those thoughts occur. This calls for a scheme of procedure. In some cases, the best design is no design, as with a love letter, which is simply an outpouring, or with a casual essay, which is a ramble. But in most cases, planning must be a deliberate prelude to writing.
The more clearly the writer perceives the shape, the better are the chances of success.
Make the paragraph the unit of composition
As a rule, begin each paragraph either with a sentence that suggests the topic or with a sentence that helps the transition.
More commonly, the opening sentence simply indicates by its subject the direction the paragraph is to take.
Use the active voice
"I shall always remember my first visit to Boston” is better than "My first visit to Boston will always be remembered by me."
Put statements in positive form
Make definite assertions. Use the word not as a means of denial or in antithesis, never as a means of evasion.
"He was not very often on time” becomes “He usually came late.”
“She did not think that studying Latin was much use” becomes “She thought the study of Latin useless."
Consciously or unconsciously, the reader is dissatisfied with being told only what is not; the reader wishes to be told what is.
If your every sentence admits a doubt, your writing will lack authority.
Specific, definite, concrete
Prefer the specific to the general, the definite to the vague, the concrete to the abstract.
Omit needless words
When a sentence is made stronger, it usually becomes shorter.
Vigorous writing is concise. A sentence should contain no unnecessary words, a paragraph no unnecessary sentences, for the same reason that a drawing should have no unnecessary lines and a machine no unnecessary parts. This requires not that the writer make all sentence short, or avoid all detail and treat subjects only in outline, but that every word tell.
The principle of parallel construction
This principle, that of parallel construction, requires that expressions similar in content and function be outwardly similar.
Blessed are the poor in spirit; for theirs in the kingdom of Heaven.
Blessed are they that mourn; for they shall be comforted.
Blessed are the meek; for they shall inherit the earth.Steering by stars that are disturbingly in motion
Here we leave solid ground. Who can confidently say what ignites a certain combination of words, causing them to explode in the mind? Who knows why certain notes in music are capable of stirring the listener deeply, though the same notes slightly rearranged are impotent? These are high mysteries, and this chapter is a mystery story, thinly disguised. There is no satisfactory explanation of style, no infallible guide to good writing, no assurance that a person who thinks clearly will be able to write clearly, no key that unlocks the door, no inflexible rule by which writers may shape their course. Writers will often find themselves steering by stars that are disturbingly in motion.
Design informs even the simplest structure
Design informs even the simplest structure, whether of brick and steel or of prose.
Even the kind of writing that is essentially adventurous and impetuous will on examination be found to have a secret plan: Columbus didn’t just sail, he sailed west, and the New World took shape from this simple and, we now think, sensible design.
Do not overstate
When you overstate, readers will be instantly on guard, and everything that has preceded your overstatement as well as everything that follows it will be suspect in their minds because they have lost confidence in your judgment or your poise.
A single overstatement, wherever or however it occurs, diminishes the whole.
Do not explain too much
It is seldom advisable to tell all.
Place the emphatic words of a sentence at the end
The proper place in the sentence for the word or a group of words that the writer desires to make most prominent is usually the end.
The principle that the proper place for what is to be made most prominent is the end applies equally to the words of a sentence, to the sentences of a paragraph, and to the paragraphs of a composition.
Writing is one way to go about thinking
And the practice and habit of writing not only drains the mind but supplies it, too.
Style is not separate from substance
Young writers often suppose that style is a garnish for the meat of prose, a sauce by which a dull dish is made palatable. Style has no such separate entity; it is nondetachable, unfilterable. The beginner should approach style warily, realizing that it is an expression of self, and should turn resolutely away from all devices that are popularly believed to indicate style - all mannerisms, tricks, adornments. The approach to style is by way of plainness, simplicity, orderliness, sincerity.
The young writer should learn to spot them - words that at first glance seem freighted with delicious meaning but that soon burst in air, leaving nothing but a memory of bright sound.