Research & Ethnography
What is unspoken
A nested classificatory hierarchy
Unfinished
Record them all
Recommendations for field notes
In Defense of Browsing
The illustrated guide to a Ph.D.
When users never use the features they asked for
An Article by Austin Z. HenleyWe deployed our tool. Almost no one used it.
The handful that did use it, used it once or twice and barely interacted with it. After a few days, zero people were using it.
Why did they tell me they wanted these features?
Why Most Published Research Findings Are False
AÂ Research Paper by John P.A. IoannidisThere is increasing concern that most current published research findings are false. The probability that a research claim is true may depend on study power and bias, the number of other studies on the same question, and, importantly, the ratio of true to no relationships among the relationships probed in each scientific field. In this framework, a research finding is less likely to be true when the studies conducted in a field are smaller; when effect sizes are smaller; when there is a greater number and lesser preselection of tested relationships; where there is greater flexibility in designs, definitions, outcomes, and analytical modes; when there is greater financial and other interest and prejudice; and when more teams are involved in a scientific field in chase of statistical significance.
How can we develop transformative tools for thought?
AÂ Research Paper by Andy Matuschak & Michael NielsenConventional tech industry product practice will not produce deep enough subject matter insights to create transformative tools for thought.
...The aspiration is for any team serious about making transformative tools for thought. Itâs to create a culture that combines the best parts of modern product practice with the best parts of the (very different) modern research culture. You need the insight-through-making loop to operate, whereby deep, original insights about the subject feed back to change and improve the system, and changes to the system result in deep, original insights about the subject.
A hypothesis is a liability
AÂ Research Paper by Itai Yanai & Martin LercherThere is a hidden cost to having a hypothesis. It arises from the relationship between night science and day science, the two very distinct modes of activity in which scientific ideas are generated and tested, respectively [1, 2]. With a hypothesis in hand, the impressive strengths of day science are unleashed, guiding us in designing tests, estimating parameters, and throwing out the hypothesis if it fails the tests. But when we analyze the results of an experiment, our mental focus on a specific hypothesis can prevent us from exploring other aspects of the data, effectively blinding us to new ideas.
Keep digging
An Article by Ryan SingerThe hardest thing about customer interviews is knowing where to dig. An effective interview is more like a friendly interrogation. We donât want to learn what customers think about the product, or what they like or dislike â we want to know what happened and how they chose... To get those answers we canât just ask surface questions, we have to keep digging back behind the answers to find out what really happened.
Fast Path to a Great UX â Increased Exposure Hours
An Article by Jared SpoolAs weâve been researching what design teams need to do to create great user experiences, weâve stumbled across an interesting finding. Itâs the closest thing weâve found to a silver bullet when it comes to reliably improving the designs teams produce.
The solution? Exposure hours. The number of hours each team member is exposed directly to real users interacting with the teamâs designs or the teamâs competitorâs designs. There is a direct correlation between this exposure and the improvements we see in the designs that team produces.
Weighing up UX
An Article by Jeremy KeithMetrics come up when weâre talking about A/B testing, growth design, and all of the practices that help designers get their seat at the table (to use the well-worn clichĂ©). But while metrics are very useful for measuring designâs benefit to the business, theyâre not really cut out for measuring user experience.
Monkeys testing random designs
AÂ Tweet by Jared SpoolA/B testing is an effective approach to use science to design and deliver deeply-frustrating user experiences.
A/B testing without upfront research is just random monkeys testing random designs to see which of those designs do âbestâ against random criteria.
If drug testing was actually implemented like most A/B tests, youâd give 2 drugs to 2 groups of people and pick the âwinnerâ by whichever group had fewer deaths.
You and Your Research
AÂ Speech by Richard HammingThis talk centered on Hamming's observations and research on the question "Why do so few scientists make significant contributions and so many are forgotten in the long run?"
Gods of the Word
Imagine that we had no voice and no tongue
Socrates: Imagine that we have no voice and no tongue, but want to communicate with one another. Wouldnât we like the deaf and the dumb make signs with the hands and the head and the rest of the body?
Hermogenes: There would be no choice, Socrates.
Socrates: We would imitate the nature of the thing: lifting the hands to heaven would mean lightness and upwardness. Heaviness and downwardness would be expressed by letting them drop toward the ground...
Hermogenes: I donât see that we could do anything else.
Socrates: And when we want to express ourselves with the voice or tongue or mouth, the expression is simply their imitation of what we want to express?
Hermogenes: I think, it must be so.My name
âI am the utterance of my name.â
â Thunder, Perfect Mind, The Nag Hammadi Library
Reference and Is-ness
There are at least two aspects to what we have traditionally called the meaning of a word. One aspect is reference, and the other is something I will call âinherent meaningâ following Ullman (1963). Inherent meaning is âIs-nessâ meaning. Inherent meaning is a wordâs identity, and reference merely its resumĂ©, where it has gone and what it has done, an itemization of its contexts. âIs-nessâ is unifying. Each word has a single pronunciation, a single inherent meaning. But reference is divisive. It makes what was one thing â the word â appear to be many things â its senses. It is inherent meaning which gives all those multifarious senses the power of being a single word.
It flows out and fills
This deeper meaning of a word isnât confined to what we think of as a dictionary definition. Rather it flows out and fills all the space available to it. Although a basic sense does affect the dynamics of a word, it has no power over its essence. Like the captain of a ship, it can control the crewâs actions, but not their minds. Each word has an aspect of meaning which lies deeper than any of its senses, and it is fundamentally on this meaning that all the senses depend.
No less than a Zeus
I too am a true believer in the autonomy of the archetype. A
/t/
or an/h/
is no less than a Zeus. The consonants are not essentially physical, but they live, evolve and influence human affairs. We overlook something essential if we deny that they can get up and walk around. This is not to say that their existence is independent of the human psyche. But then everything depends on everything.Like a prism
When you look at phonemes, you look through the perspective of morphemes, which are one linguistic level higher. The higher level is like a prism that splits the light in two. What was one thing, like âlengthâ at the phoneme level, looks like two opposite things âlongâ and âshortâ from the perspective of the morphemes. In practice, when you find both a word and its opposite, then the phoneme is not about either of these two things, but about what is common to them.
Fracturing
If we step back and view from afar this process of One-ness and Is-ness to fracturing and interpretation â of inherent meaning to reference, it follows that what lies at the foundation of language is simply what it is â sound â free of reference and interpretation. What makes what we know as language from its sound is fracturing and interpretation or using a word for a function other than what it simply is.
To evolve the language itself
So in the process of talking, we might say we are putting words in slightly new contexts, and then testing them against our peers to see if our experiment in juxtaposition had âmeaning. If we succeed, we have introduced new contexts for the words we use. These contexts will be taken up by our listeners, and will gradually become clearly enough defined to be thought of as referents. Once our words gain new referents, they start affecting the underlying phonosemantic structure of the language, the clustering patterns, the network of semantic relations. That is, the purpose of talking in the long run is to evolve the language itself.
Scooting over
There is at this point no evidence that acquired characteristics can be inherited. It is held that all changes to a genome are random, and cannot be subject to any higher principle. However, when a word is used in a new context, as it is whenever we say something new, a new sense is permitted. This does affect the phonosemantic structure, the linguistic DNA. Words in the vicinity of this word âscoot overâ to make room and allow themselves to be influenced by its philosophy. The language itself is now different.
The element becomes a sign
Each unit can be seen purely as form, as what it is. Or it can be viewed as having a function. Its function is only understandable within the next higher level of organization. And in every case, function must succumb to the constraints of form. Once this worldly function is assigned, the element becomes a âsignâ. It falls into the realm of concept. There is a mapping from one thought system to another.
The demand of a new word
Why are these phonosemantic classes enough, and we need neither more nor less? Why are these consonants enough, and we need neither more nor less? What determines the need for a new word? How is this demand âfeltâ by a language? How did the metabolic pathways of American English recognize that âjerkâ and âtwerpâ and âpunkâ and ânitwitâ and âdorkâ and âassâ and âgoonâ and âtwitâ and âdodoâ and âbumâ and ânerdâ and âdunceâ and âturdâ and âboobâ and âchumpâ and âbitchâ and âbastardâ and âprudeâ and so on and so forth simply were not equal to the task? We had to add âturkeyâ and âsquirrelâ as well?