Research & Ethnography
What is unspoken
A nested classificatory hierarchy
Unfinished
Record them all
Recommendations for field notes
In Defense of Browsing
The illustrated guide to a Ph.D.
When users never use the features they asked for
An Article by Austin Z. HenleyWe deployed our tool. Almost no one used it.
The handful that did use it, used it once or twice and barely interacted with it. After a few days, zero people were using it.
Why did they tell me they wanted these features?
Why Most Published Research Findings Are False
A Research Paper by John P.A. IoannidisThere is increasing concern that most current published research findings are false. The probability that a research claim is true may depend on study power and bias, the number of other studies on the same question, and, importantly, the ratio of true to no relationships among the relationships probed in each scientific field. In this framework, a research finding is less likely to be true when the studies conducted in a field are smaller; when effect sizes are smaller; when there is a greater number and lesser preselection of tested relationships; where there is greater flexibility in designs, definitions, outcomes, and analytical modes; when there is greater financial and other interest and prejudice; and when more teams are involved in a scientific field in chase of statistical significance.
How can we develop transformative tools for thought?
A Research Paper by Andy Matuschak & Michael NielsenConventional tech industry product practice will not produce deep enough subject matter insights to create transformative tools for thought.
...The aspiration is for any team serious about making transformative tools for thought. It’s to create a culture that combines the best parts of modern product practice with the best parts of the (very different) modern research culture. You need the insight-through-making loop to operate, whereby deep, original insights about the subject feed back to change and improve the system, and changes to the system result in deep, original insights about the subject.
A hypothesis is a liability
A Research Paper by Itai Yanai & Martin LercherThere is a hidden cost to having a hypothesis. It arises from the relationship between night science and day science, the two very distinct modes of activity in which scientific ideas are generated and tested, respectively [1, 2]. With a hypothesis in hand, the impressive strengths of day science are unleashed, guiding us in designing tests, estimating parameters, and throwing out the hypothesis if it fails the tests. But when we analyze the results of an experiment, our mental focus on a specific hypothesis can prevent us from exploring other aspects of the data, effectively blinding us to new ideas.
Keep digging
An Article by Ryan SingerThe hardest thing about customer interviews is knowing where to dig. An effective interview is more like a friendly interrogation. We don’t want to learn what customers think about the product, or what they like or dislike — we want to know what happened and how they chose... To get those answers we can’t just ask surface questions, we have to keep digging back behind the answers to find out what really happened.
Fast Path to a Great UX – Increased Exposure Hours
An Article by Jared SpoolAs we’ve been researching what design teams need to do to create great user experiences, we’ve stumbled across an interesting finding. It’s the closest thing we’ve found to a silver bullet when it comes to reliably improving the designs teams produce.
The solution? Exposure hours. The number of hours each team member is exposed directly to real users interacting with the team’s designs or the team’s competitor’s designs. There is a direct correlation between this exposure and the improvements we see in the designs that team produces.
Weighing up UX
An Article by Jeremy KeithMetrics come up when we’re talking about A/B testing, growth design, and all of the practices that help designers get their seat at the table (to use the well-worn cliché). But while metrics are very useful for measuring design’s benefit to the business, they’re not really cut out for measuring user experience.
Monkeys testing random designs
A Tweet by Jared SpoolA/B testing is an effective approach to use science to design and deliver deeply-frustrating user experiences.
A/B testing without upfront research is just random monkeys testing random designs to see which of those designs do “best” against random criteria.
If drug testing was actually implemented like most A/B tests, you’d give 2 drugs to 2 groups of people and pick the “winner” by whichever group had fewer deaths.
You and Your Research
A Speech by Richard HammingThis talk centered on Hamming's observations and research on the question "Why do so few scientists make significant contributions and so many are forgotten in the long run?"
A Search for Structure
Apologia
A ChapterGrain Shapes and Other Metallurgical Applications of Topology
An EssayStructure, Substructure, and Superstructure
An EssayThe Interpretation of Microstructures of Metallic Artifacts
An EssayMatter versus Materials: A Historical View
An EssayIconography
It is understandable that those students who must work from reproductions of works of art are usually more interested in iconography than in the more subtle questions of technique and quality, but it is regrettable that technical ignorance should so frequently prevent art historians from considering the whole experience of the artist.
Understanding technique
Technique is an essential aspect of any work of art from a trivial trinket to the greatest painting, and some specialized study of it is essential to full appreciation.
Though museum labels and catalogs refer to materials and processes — “bronze,” “fresco,” “parcel gilt,” “tempera,” “lacquer on wood,” and so on — they usually display only superficial attention to the essential details of the artist’s technique.
Bells
Most Japanese bells when hung still have on them one or more rough lines obviously arising in horizontal mold joints. These lines are not removed in fettling the bell, and they seem to be regarded not as defects but rather as a reminder of the reality of the founder’s interaction with his materials. One is reminded of the ceramics that are most treasured in Japan which usually have some unexpected tool marks or irregularity resulting from a kiln mishap.
Nearer to the surface
If in the following I overemphasize the Orient, this is simply because in the Far East the properties of materials are a little nearer to the surface, a little more consciously a part of what the artist is trying to show. The naturalistic aspects of Oriental philosophy encourage a sensitivity to the quality of materials — or is it the inverse, that an early enjoyment of stone, wood, clay, and fiber gave rise to the philosopher’s perception of the soul in all natural things comparable to man himself? Westerners tend to override materials, usually in ignorance, but sometimes proudly as a tour de force.
The drop press
The virtue of thin sheet metal in giving the greatest glitter for a grain of gold was exploited in the earliest days of metallurgy. However, before the days of rolled sheet and drawn wire, most metal objects were made by hammering and were basically three-dimensional in form.
[In contrast] look at the simple drop press — it’s unmodulated blow striking in a single direction symbolizes much of nineteenth-century mechanized production. To make multiple stampings, stacks of very thin metal sheets were superimposed under the hammer, and the final profile with moderately high relief was gradually achieved as finished sheets were removed from the bottom and new ones added at the top.
When the drop press was used to shape large areas of thin sheet metal, the aesthetic qualities of the surface became divorced from the underlying substance, and decoration became independent of the body needed to support it. In any object there is a natural relationship between the surface and the bulk, that is, between its one-, two-, and three-dimensional aspects. The fakery involved in applying gold or silver playing on a solid copper object is quite different from the deception of an ornately stamped piece of thin sheet brass. Compare a magnificent ormolu furniture fitting or even a gilded plaster picture frame with a cheap lamp base embossed in thin sheet brass. In the former, the surface is simply and honestly applied for its optical effect alone; in the latter the fakery is fundamental for it is dimensionally misleading.
Big things and little things
It is hardly possible that human beings could have decided logically that they needed to develop language in order to communicate with each other before they had experienced pleasurable interactive communal activities like singing and dancing. Aesthetic curiosity has been central to both genetic and cultural evolution.
All big things grow from little things, but new little things will be destroyed by their environment unless they are cherished for reasons more like love than purpose.
What's the difference?
I well remember an occasion in 1962 when in a remote Iranian village I asked a blacksmith famous for his superior penknives to tell me the difference between iron and steel. “What’s the difference?” he replied. “What’s the difference between an oak tree and a willow — they have different natures and one must adapt to them.” He did not accept the suggestion that some material absorbed from the fire’s charcoal might have something to do with it, and he would not have understood a word of any lecture I could have given him on diffusion, crystal structure, and phase transformations; yet he could make a good knife and I could not.
The scale of human experience
It is the scale of human experience, from which thought and imagination take off, and to which they must return.
The edifice from which they came
A list of types of bricks used in the Hagia Sophia may help one to build an interesting brick wall, but it poorly suggests the great edifice from which they came.
The interplay of pattern and texture
Some of the more enjoyable surfaces (for example, the grain of a fine mahogany table top or a Japanese sword) have an interplay between pattern and texture which, though two-dimensional, suggests the unseen internal three-dimensional array.
Resonances
The resonances arising in workmanship are often very subtle. The fact that the material itself guides the tool differently in different processes of working introduces changes in the overall relationship of curvatures. The smooth curves of surfaces approaching the edge of a jade axe that come about from innumerable abrasive particles moving against a slightly yielding and mechanically unconstrained backing would seem incongruous if other surfaces or outlines were present that had come from cleavage or from the geometric motions of a machine. These could be produced easily enough, but the eye would not establish larger resonances among them.
Fine arts and decorative arts
The fine arts are conscious and essentially individual in tradition.
The quantitative and economic aspects of the decorative arts, on the other hand, make them intrinsically repetitive. Because of this, their aesthetic qualities have a very intimate relationship to the technology of materials, and their design is thereby basically affected.
In addition to the qualitative need for repetitive detail in design, the decorative arts have a quantitative requirement, namely the imperative of covering large areas or making large numbers of individual objects.
Replication
Consider also the development of mass-production methods involving the casting of molten metals. Though the finest castings were made individually by the lost-wax process, the majority of casting from the earliest days have been designed expressly to facilitate molding. As with punches and dies, most foundry processes have the characteristic that the careful work of the master designer is involved only once, whereafter replication takes over.
Reproduction
The success of a mechanic’s, or a machine’s, reproduction of a thing depends on his, or its, sensitivity to whatever qualities are important, just as the skill of the designer lies in the proper appreciation of surface qualities in terms of structure and shape variation that come from the intended means of production.
The inner nature of material
The work of an artist in getting the details that he wants is greatly facilitated if he selects a material whose inner nature makes it want to take the desired shape.
The idea grows as they work
As they work, the experience of the material under the artist's fingers subtly interacts with the idea in their mind to give the finished work some quality that was rarely fully anticipated. A few artists seem to have such a feeling for their materials that the prevision needs little modification; most say that the idea grows as they work experimentally.
True artistry
The best of all examples of a satisfactory art form based upon the inner nature of a metal is provided by Japanese swords.
Our perception of beauty seems to involve the interaction of several patterns having origin and significance at many different levels of space, time, matter, and spirit. In the Japanese sword blade there is heterogeneity in both the macrostructure and the microstructure. The manner of forging, the heat treatment, and the final polishing operation are all uniquely Japanese techniques, and all make necessary contributions to the final quality of the blades. The shape along would be simplistic form; the forged texture of the steel without heat treatment would at best faintly echo the beauty of grained wood; the outlines of the quench-hardened zone at the edge would be sharp and uninteresting if it depended only on the control of cooling rate during quenching; and the polish would be uniform glitter if the metal were homogeneous. With true artistry all these are made to interact.
Simple variations of the parts
Symmetry, indeed, has been grossly overemphasized in both art and science: its main value is in giving meaning to its absence, dissymmetry, without which there could be no hierarchy.
The eye is repulsed by complexity if no order is detected, but it can be delighted by repetition, translation, rotation, reflection, magnification, and other simple variations of the parts.