Information & Information Architecture
A history of content and sources
Good annotation
Information displays should be annotated, combining words, images, graphics, whatever it takes to describe and explain something. Annotation calls out and explains information and, at the same time, explains to viewers how to read data displays. Good annotation is like a knowledgeable expert/teacher at the viewer's side pointing and saying, "Now see how this works with that, how this might explain that..."
An immense wordy diagram
In ~1560 Ettore Ausonia, a polymath with interests from mathematics to mirror-making, constructed an immense wordy diagram depicting reflections from concave spherical mirrors. Then, between 1592 and 1601, while teaching at the University of Padua, Galileo made this handwritten copy of the diagram, which was fortunate since Ausonio's original has since gone missing. Three helpful architectures for the off-the-grid sentences are deployed – word trees, stacklists, annotated linking lines.
No wonder you think it's complicated
We were very proud of our user interface and the fact that we had a way to browse 16,000 (!!) pages of documentation on a CD-ROM. But browsing the hierarchy felt a little complicated to us.
So we asked Tufte to come in and have a look, and were hoping perhaps for a pat on the head or some free advice. He played with our AnswerBook for 90 seconds, turned around, pronounced his review:
"Dr. Spock's Baby and Child Care is a best-selling owner's manual for the most complicated 'product' imaginable – and it has only 2 levels of headings. You have 8 levels of hierarchy and I haven't stopped counting yet. No wonder you think it's complicated."
Infinite varieties of contexts
Over the course of 10 years of using Are.na, I have fully adopted the view that any piece of information can be important to a person given the right context. And on Are.na, pieces of information can be arranged in infinite varieties of contexts – their respective meaning shifts as the proximate information shifts. In other words, the more connections a block has, the more opportunities it has to be a nodal point.
Nodal points
I started thinking about all the other important “nodal points” (I don’t know what else to call this) of people, places, books, albums, websites, etc. that all played a part in shaping who I am as a person and what I think is important. These points are a combination of seeking things out myself and getting a recommendation that felt like it was actually for me. A mixture of both passive and active knowledge acquisition.
ultimately, it's the totality of those “nodal points” that indicate one’s own unique perspective. It doesn’t matter if you specifically sought out the nodal point or not, it’s the recognition that counts. When you encounter a piece of life-changing information (no matter how large the change part is), you are simultaneously discovering and creating “yourself,” becoming incrementally more complete. Your perspective (where your gaze is directed) is made up of a meandering line through these points. Learning (or maybe some precursor to learning) is a lot about developing the intuition to recognize when something you find in the world is going to be a nodal point for you.
What is a commonplace?
In all cases, a commonplace is a method of compiling knowledge for later use. In digital or analog form, this continued growth of stored ideas and projects is a key driver of intellectual development. Any time you decide to work on a project, you should attempt to collect and categorise all information that is relevant and useful.
Reveling in infrastructure
Hunstanton Secondary School (1954) in Norfolk, England, designed by Alison and Peter Smithson. Photo by Anna Armstrong (2011)
When the Smithsons placed the water heater for the Hunstanton Secondary School prominently above the school’s roofline, they weren’t just revealing the building’s infrastructure, they were reveling in it. What does it look like to do this on the web?
Of course there’s no single answer, because the web is simultaneously a physical and digital medium. It is material and it isn’t. It depends on how literally you interpret the question. But taking it somewhere in-between, seeing the web as primarily an information medium, we can ask the question a little differently: what does it look like to design something that is true to the material of digital information?
The quality of thought
It is the quality of thought and the information we use that determines yield, not the size or quality of the site.
A dot went for a walk
A dot went for a walk and turned into a line.
The dot, the line, the dance, the story, and the painting had found connections. Memory became learning, learning became understanding.Learning is remembering what one is interested in. Learning, interest, and memory are the tango of understanding.
Creating a map of meaning between data and understanding is the transformation of big data into big understanding.
The dot had embraced understanding.
Understanding precedes action.
Each of us is a dot on a journey.The need to record
With collecting comes the need to record. A specimen without a label is simply a (sometimes) pretty object. Without its associated data it is scientifically worthless.
The lapse of many years
At this point I wish to emphasize what I believe will ultimately prove to be the greatest purpose of our museum. This value will not, however, be realized until the lapse of many years, possibly a century, assuming that our material is safely preserved. And this is that the student of the future will have access to the original record of faunal conditions in California and the west, wherever we now work. He will know the proportional constituency of our faunae by species, the relative numbers of each species and the extent of the ranges of species as they exist today.
— Joseph Grinnell, 1910
Information imposters
Information imposters: This is nonsense that masquerades as information because it is postured in the form of information. We automatically give a certain weight to data based on the form in which it is delivered to us. Because we don’t take the time to question this, we assume that we have received some information.
My favorite example of this is in cookbook recipes that call for you to “cook until done.” This doesn’t tell you very much. Why bother? Information imposters are fodder for administravitis.
Like a prism
When you look at phonemes, you look through the perspective of morphemes, which are one linguistic level higher. The higher level is like a prism that splits the light in two. What was one thing, like ‘length’ at the phoneme level, looks like two opposite things ‘long’ and ‘short’ from the perspective of the morphemes. In practice, when you find both a word and its opposite, then the phoneme is not about either of these two things, but about what is common to them.
Thinking in terms of outputs
In our use of digital and analogue filing tools, we classify information through folders. An article about railway construction gets filed under ‘infrastructure’ or ‘transport’. In Evernote we tag it with ‘rail’ or ‘construction’. This is thinking like a librarian and not like a writer. We are classifying the information as an input. The reason you take notes as a writer is to produce content. It makes sense, then, to take notes in line with this goal.
Traditional filing like this tends to fail when you attempt to write your content. You are stuck trying to figure out which categories will be relevant for your proposal, paper or blog post. Interesting writing often comes from connecting separate fields through a common idea. By revealing the common denominator. By unifying two seemingly-contradictory ideas. How can you possibly achieve this if you’re looking in the same category for your information? The categories simply do not fulfil the function required by the writer.
The notes you take and indeed, the way you process information, should be with a specific project or idea in mind. You must classify information in terms of its outputs. When you take notes on a book, think about how this could apply to a specific idea you had or how it argues against a paper you read last week. The premise is that you should be organising by context and always trying to connect the dots between the content you're consuming.
Off to the races
"You get to the point where you're about to place your wager; the race is about to be run. You evaluate the sum total of the information, which has to do with how the money has been bet, what the horses looked like on the track, all this information—and it's like you run your hand over the race—I've had this happen so many times, it's the only way to explain it—you run your hand over the race. All the information is logically there, but there's something wrong. You don't know why something is wrong, but something is not correct. Then I have to reevaluate everything in terms of this feeling I have about the thing, which is derived from information, but which is so complex and so intricate and so subtle that there's no way you can put a tag on it."
The pie has been made
"In today's world, boundaries are fixed, and most significant facts have been generated. Gentleman, the heroic frontier now lies in the ordering and deployment of those facts. Classification, organization, presentation. To put it another way, the pie has been made—the contest is now in the slicing."
The Visual Information Seeking Mantra
There are many visual design guidelines but the basic principle might be summarized as the Visual Information Seeking Mantra:
Overview first, zoom and filter, then details-on-demand
Overview first, zoom and filter, then details-on-demand
Overview first, zoom and filter, then details-on-demand
Overview first, zoom and filter, then details-on-demand
Overview first, zoom and filter, then details-on-demand
Overview first, zoom and filter, then details-on-demand
Overview first, zoom and filter, then details-on-demand
Overview first, zoom and filter, then details-on-demand
Overview first, zoom and filter, then details-on-demand
Overview first, zoom and filter, then details-on-demandEach line represents one project in which I found myself rediscovering this principle and therefore wrote it down it as a reminder. It proved to be only a starting point in trying to characterize the multiple information visualization innovations occurring at university, government, and industry research labs.
Envisioning Information
A Book by Edward TufteBeautiful Evidence
A Book by Edward TufteThe Visual Display of Quantitative Information
A Book by Edward TufteThe Ladder of Abstraction
An Essay by Bret VictorThe Elements of Graphing Data
A Book by William S. ClevelandUnderstanding Understanding
A Book by Richard Saul WurmanVisual Explanations
A Book by Edward TufteInformation Visualization: Perception for Design
A Book by Colin WareThe Eyes Have It
A Research Paper by Ben ShneidermanLooseleaf
A WebsiteWikipedia
A WebsiteTinderbox
An ApplicationTinderbox is a workbench for your ideas and plans, ands ideas. It can help you analyze and understand them today, and it will adapt to your changing needs and growing knowledge.
Your Tinderbox documents can help organize themselves, keeping your data clean. We believe in information gardening: as your understanding grows, Tinderbox grows with you.
The medium is the message
A Quote by Marshall McLuhanProduct Design Resources
A Reference Work by Brandon DornThings I‘ve read, people I‘ve tried to learn from, and things I‘ve done to become a better designer. This is an idiosyncratic list reflecting what has helped me along the way, rather than an exhaustive list of design classics.
Though the list leans toward theory — principles are more durable than technique — I offer a few ideas further down about how to practice design. It also leans toward information design, because the task of presenting rich, dense information in an accessible way is ultimately the task of any digital product.
Blogging with Version Control
An Article by Will DarwinI’ve been musing for a while now on the way blog posts are typically presented—in reverse chronological order. This format has never truly made sense and does not reflect the way good writing and thinking happens.
...The main issue with the ‘pile’ system is that this post is eventually buried beneath more recent pieces of writing; there is no incentive for revisiting or updating the work. Even worse, if an author does decide to unearth the piece and make some major changes, those who read the original piece are not made aware of these alterations. The sorting order is static.
Nobody gives a hoot about groupthink
An Article by Baldur BjarnasonTwo relatively common ‘fashions’ today are real-time collaboration and shared data repositories of one kind or another.
Both increase productivity in the naive sense. We work more; everybody is more active; the group feels more cohesive.
The downside is that they also both tend to reduce the quality of the work and increase busywork.
Two types of work
An Article by Jorge ArangoThere are two types of work: growth work and maintenance work.
Growth work involves making new things. It can be something big or small. In either case, growth work often follows a loose process.
Maintenance work is different. Maintenance work involves caring for the resources and instruments that make growth work possible. This includes tools, but also body and mind.
Maintenance is ultimately in service to growth. But effective growth can’t happen without maintenance. As with so many things, the ideal is a healthy balance — and it doesn’t come without struggle.
Open Transclude for Networked Writing
An Essay by Toby ShorinWebsites are not living rooms and other lessons for information architecture
An Essay by Sarah R. BarrettWhile there is a lot that IA can learn from actual architecture or city planning, websites aren’t buildings or cities, and they don’t have to work like them. Instead, they should be designed according to the same principles that people’s brains expect from physical experiences.
Web History Chapter 1: Birth
A Chapter by Jay HoffmannHow to Think About Notes
An Article by Will DarwinWhat we have known since long
A Quote by Ludwig WittgensteinThe problems are solved, not by giving new information, but by arranging what we have known since long.
Readings in Information Visualization: Using Vision to Think
A Book by Ben Shneiderman
The Art of Doing Science and Engineering: Learning to Learn
The Art of Doing Science and Engineering is the full expression of what "You and Your Research" outlined. It's a book about thinking; more specifically, a style of thinking by which great ideas are conceived.
Gifts of knowledge to humanity
There are many commonalities we can admire in these endeavors: the dazzling leap of imagination, the broad scope of applicability, the founding of a new paradigm. But let’s focus here on their form of distribution. These are all things that are taught. To “use” them means to learn them, understand them, internalize them, perform them with one’s own hands. They are free to any open mind.
In Hamming’s world, great achievements are gifts of knowledge to humanity.
Hamming-greatness
Hamming-greatness is tied, inseparably, with the conception of science and engineering as public service. This school of thought is not extinct today, but it is rare, and doing such work is not impossible, but fights a nearly overwhelming current.
It cannot be taught in words
How to be a great painter cannot be taught in words; one learns by trying many different approaches that seem to surround the subject. Art teachers usually let the advanced student paint, and then make suggestions on how they would have done it, or what might also be tried, more or less as the points arise in the student’s head—which is where the learning is supposed to occur!
Preparing for problems
I firmly believe in Pasteur’s remark, “Luck favors the prepared mind.” In this way I can illustrate how the individual’s preparation before encountering the problem can often lead to recognition, formulation, and solution.
Student's future, not teacher's past
Teachers should prepare the student for the student’s future, not for the teacher’s past.
If you know what you are doing
In science, if you know what you are doing, you should not be doing it.
In engineering, if you do not know what you are doing, you should not be doing it.The homogeneity of knowledge
The standard process of organizing knowledge by departments, and sub-departments, and further breaking it up into separate courses, tends to conceal the homogeneity of knowledge, and at the same time to omit much which falls between the courses.
Another goal of the course is to show the essential unity of all knowledge rather than the fragments which appear as the individual topics are taught. In your future anything and everything you know might be useful, but if you believe the problem is in one area you are not apt to use information that is relevant but which occurred in another course.
An information service society
Society is steadily moving from a material goods society to an information service society. At the time of the American Revolution, say 1780 or so, over 90% of the people were essentially farmers—now farmers are a very small percentage of workers.
What will the situation be in 2020? As a guess I would say less than 25% of the people in the civilian workforce will be handling things; the rest will be handling information in some form or other. In making a movie or a tv program you are making not so much a thing, though of course it does have a material form, as you are organizing information.
From hands to machines
It has rarely proved practical to produce exactly the same product by machines as we produced by hand. Mechanization requires you produce an equivalent product, not identically the same one.
A matter of choice and balance
More than ever before, engineering is a matter of choice and balance rather than just doing what can be done. And more and more it is the human factors which will determine good design—a topic which needs your serious attention at all times.
Central planning gives poor results
Central planning has been repeatedly shown to give poor results (consider the Russian experiment, for example, or our own bureaucracy). The persons on the spot usually have better knowledge than can those at the top and hence can often (not always) make better decisions if things are not micromanaged.
"Real programmers"
At the time the Symbolic Assembly Program (SAP) first appeared I would guess about 1% of the older programmers were interested in it—using SAP was “sissy stuff,” and a real programmer would not stoop to wasting machine capacity to do the assembly.
Using your own expertise
Almost all professionals are slow to use their own expertise for their own work. The situation is nicely summarized by the old saying, “The shoemaker’s children go without shoes.”
History tends to be charitable
History tends to be charitable. It gives credit for understanding what something means when we first do it. But there is a wise saying, “Almost everyone who opens up a new field does not really understand it the way the followers do.”
The reason this happens so often is the creators have to fight through so many dark difficulties, and wade through so much misunderstanding and confusion, they cannot see the light as others can, now the door is open and the path made easy.
Mass production of variable products
Computers have opened the door much more generally to the mass production of a variable product, regardless of what it is: numbers, words, word processing, making furniture, weaving, or what have you. They enable us to deal with variety without excessive standardization, and hence we can evolve more rapidly to a desired future!
Thinking is a matter of degree
Perhaps “thinking” is not a yes/no thing, but maybe it is a matter of degree.
Making coal miners into programmers
Many humans at present are not equipped to compete with machines—they are unable to do much more than routine jobs. There is a widespread belief (hope?) that humans can compete, once they are given proper training. However, I have long publicly doubted you could take many coal miners and make them into useful programmers.
A minimum size to fish
There is the famous story by Eddington about some people who went fishing in the sea with a net. Upon examining the size of the fish they had caught, they decided there was a minimum size to the fish in the sea! Their conclusion arose from the tool used and not from reality.
Spelled with a lowercase letter
I used to tease John Tukey that you are famous only when your name was spelled with a lowercase letter such as watt, ampere, volt, fourier (sometimes), and such.
Why it can't be done
Moral: when you know something cannot be done, also remember the essential reason why, so later, when the circumstances have changed, you will not say, “It can’t be done.”
When you decide something is not possible, don’t say at a later date it is still impossible without first reviewing all the details of why you originally were right in saying it couldn’t be done.
Intellectual shelf life
Let lab equipment lie idle for some time, and suddenly it will not work properly! This is called “shelf life,” but it is sometimes the shelf life of the skills in using it rather than the shelf life of the equipment itself! I have seen it all too often in my direct experience. Intellectual shelf life is often more insidious than is physical shelf life.
Beware of jargon
Beware of jargon—learn to recognize it for what it is, a special language to facilitate communication over a restricted area of things or events. But it also blocks thinking outside the original area it was designed to cover. Jargon is both a necessity and a curse.
You cannot consume what is not produced
The only law of economics that I believe in is Hamming’s law: “You cannot consume what is not produced.” There is not another single reliable law in all of economics I know of which is not either a tautology in mathematics or else sometimes false.
I walked the crest of the dune
Thus piece by piece I walked the crest of the dune, and each time the solution slipped on one side or the other I knew what to do to get back on the track.
God loved sand
“God loved sand, He made so much of it.” I heard, inside myself, that we were already having to exploit lower-grade copper mines, and could only expect to have an increasing cost for good copper as the years went by, but the material for glass is widely available and is not likely to ever be in short supply.
The Hawthorne effect
At the Hawthorne plant of Western Electric, long, long ago, some psychologists were trying to improve productivity by making various changes in the environment. They painted the walls an attractive color, and productivity rose. They made the lighting softer, and productivity rose. Each change caused productivity to rise. One of the men got a bit suspicious and sneaked a change back to the original state, and productivity rose! Why? It appears that when you show you care, the person on the other end responds more favorably than if you appear not to care. The workers all thought the changes were being made for their benefit and they responded accordingly. In the field of education, if you tell the students you are using a new method of teaching, then they respond by better performance, and so, incidentally, does the professor. A new method may or may not be better, indeed it may be worse, but the Hawthorne effect, which is not small in the educational area, is likely to indicate that here is a new, important, improved teaching method. It hardly matters what the new method is; its trial will produce improvements if the students perceive it as being done for their benefit.
What you learn for yourself
What you learn from others you can use to follow;
What you learn for yourself you can use to lead.The unreasonable effectiveness of mathematics
We now see that all this “truth” which is supposed to reside in mathematics is a mirage. It is all arbitrary, human conventions.
But we then face the unreasonable effectiveness of mathematics. Having claimed there was neither “truth” nor “meaning” in the mathematical symbols, I am now stuck with explaining the simple fact that mathematics is used and is an increasingly central part of our society, especially in science and engineering. We have passed from absolute certain truth in mathematics to the state where we see there is no meaning at all in the symbols—but we still use them! We put the meaning into the symbols as we convert the assumptions of the problem into mathematical symbols, and again when we interpret the results. Hence we can use the same formula in many different situations—mathematics is sort of a universal mental tool for clear thinking.
What can be put into words
It is not evident, though many people, from the early Greeks on, implicitly act as if it were true, that all things, whatsoever they may be, can be put into words—you could talk about anything: the gods, truth, beauty, and justice. But if you consider what happens in a music concert, then it is obvious that what is transmitted to the audience cannot be put into words—if it could, then the composer and musicians would probably have used words. All the music critics to the contrary, what music communicates cannot (apparently) be put into words. Similarly, but to a lesser extent, for painting. Poetry is a curious field where words are used but the true content of the poem is not in the words!
Initial psychological distance
Creativity seems, among other things, to be “usefully” putting together things which were not perceived to be related before, and it may be the initial psychological distance between the things which counts most.
Tossing an idea around
Can we do anything to increase creativity? There are training courses, and books, as well as “brainstorming sessions” which are supposed to do this. Taking the brainstorming sessions first, while they were very fashionable at one time, they have generally been found to be not much good when formally done, when a brainstorming session is carefully scheduled. But we all have had the experience of “tossing an idea around” with a friend, or a few friends (but not a large group, generally), from which insight, creativity, or whatever you care to call it, arises and we make progress.
Prepare your mind for the future
Probably the most important tool in creativity is the use of an analogy. Something seems like something else which we knew in the past. Wide acquaintance with various fields of knowledge is thus a help—provided you have the knowledge filed away so it is available when needed, rather than to be found only when led directly to it. This flexible access to pieces of knowledge seems to come from looking at knowledge while you are acquiring it from many different angles, turning over any new idea to see its many sides before filing it away. This implies effort on your part not to take the easy, immediately useful “memorizing the material” path, but to prepare your mind for the future.
Stuck with a problem
If you cannot drop a wrong problem, then the first time you meet one you will be stuck with it for the rest of your career.
Experts and impossibility
If an expert says something can be done he is probably correct, but if he says it is impossible then consider getting another opinion.
Always time to fix it later
As the saying goes:
There is never time to do the job right, but there is always time to fix it later,
especially in computer software!
The average adult
Averages are meaningful for homogeneous groups (homogeneous with respect to the actions that may later be taken), but for diverse groups averages are often meaningless. As earlier remarked, the average adult has one breast and one testicle.
Solution to evaluation and back again
A second reason the systems engineer’s design is never completed is the solution offered to the original problem usually produces both deeper insight and dissatisfactions in the engineers themselves.
Furthermore, while the design phase continually goes from proposed solution to evaluation and back again and again, there comes a time when this process of redefinement must stop and the real problem be coped with—thus giving what they realize is, in the long run, a suboptimal solution.
The heart of systems engineering
While the client has some knowledge of his symptoms, he may not understand the real causes of them, and it is foolish to try to cure the symptoms only. Thus while the systems engineers must listen to the client, they should also try to extract from the client a deeper understanding of the phenomena. Therefore, part of the job of a systems engineer is to define, in a deeper sense, what the problem is and to pass from the symptoms to the causes.
Just as there is no definite system within which the solution is to be found, and the boundaries of the problem are elastic and tend to expand with each round of solution, so too there is often no final solution, yet each cycle of input and solution is worth the effort. A solution which does not prepare for the next round with some increased insight is hardly a solution at all.
I suppose the heart of systems engineering is the acceptance that there is neither a definite fixed problem nor a final solution, rather evolution is the natural state of affairs. This is, of course, not what you learn in school, where you are given definite problems which have definite solutions.