Our Quantified Life
The primary measure of progress
SAFe is oriented around volume, not value
Outcomes decide
Design as an engineering problem
Obsessed with absolute numbers
Lost purposes
The case against heatmaps
It's All Over
An Essay by Justin E. H. SmithIt has come to seem to me recently that this present moment must be to language something like what the Industrial Revolution was to textiles. A writer who works on the old system of production can spend days crafting a sentence, putting what feels like a worthy idea into language, only to find, once finished, that the internet has already produced countless sentences that are more or less just like it, even if these lack the same artisanal origin story that we imagine gives writing its soul. There is, it seems to me, no more place for writers and thinkers in our future than, since the nineteenth century, there has been for weavers.
Time-based analytics
An Article by Ryan SingerAnalytics apps don't tell you much about usage behavior. You might be able to see how many users performed an event, or how many times they did it. But none of the analytics packages out there are good at showing you how often people do things. Are they using to-dos once a week? Every day? Only signing into the app once a month but happily paying for years?
Time matters. You can't understand usage without time.
Fast Path to a Great UX – Increased Exposure Hours
An Article by Jared SpoolAs we’ve been researching what design teams need to do to create great user experiences, we’ve stumbled across an interesting finding. It’s the closest thing we’ve found to a silver bullet when it comes to reliably improving the designs teams produce.
The solution? Exposure hours. The number of hours each team member is exposed directly to real users interacting with the team’s designs or the team’s competitor’s designs. There is a direct correlation between this exposure and the improvements we see in the designs that team produces.
Metrics have a strange hold on the imagination
A Fragment by Shawn WangOnce in place, metrics have a strange hold on the imagination: I've seriously had a CTO carelessly reject my genuine idea out of hand because "it doesn't help OKRs", the same OKRs we previously agreed should not describe all that we do.
I agree with Amir Shevat that we should "do the right things over the easy to measure things."
How would you feel if you could no longer use the product?
An ArticleThe product/market fit definitions I had found were vivid and compelling, but they were lagging indicators — by the time investment bankers are staking out your house, you already have product/market fit. Instead, Ellis had found a leading indicator: just ask users “how would you feel if you could no longer use the product?” and measure the percent who answer “very disappointed.”
Site performance is potentially the most important metric
A Fragment by Kealan ParrSite performance is potentially the most important metric. The better the performance, the better chance that users stay on a page, read content, make purchases, or just about whatever they need to do. A 2017 study by Akamai says as much when it found that even a 100ms delay in page load can decrease conversions by 7% and lose 1% of their sales for every 100ms it takes for their site to load which, at the time of the study, was equivalent to $1.6 billion if the site slowed down by just one second.
The McNamara fallacy
A DefinitionThe McNamara fallacy, named for Robert McNamara, the US Secretary of Defense from 1961 to 1968, involves making a decision based solely on quantitative observations (or metrics) and ignoring all others. The reason given is often that these other observations cannot be proven.
The fallacy refers to McNamara's belief as to what led the United States to defeat in the Vietnam War—specifically, his quantification of success in the war (e.g., in terms of enemy body count), ignoring other variables.
Artifice, blindness, and suicide
A QuoteThe first step is to measure whatever can be easily measured. This is OK as far as it goes. The second step is to disregard that which can't be easily measured or to give it an arbitrary quantitative value. This is artificial and misleading. The third step is to presume that what can't be measured easily really isn't important. This is blindness. The fourth step is to say that what can't be easily measured really doesn't exist. This is suicide.
Weighing up UX
An Article by Jeremy KeithMetrics come up when we’re talking about A/B testing, growth design, and all of the practices that help designers get their seat at the table (to use the well-worn cliché). But while metrics are very useful for measuring design’s benefit to the business, they’re not really cut out for measuring user experience.
Predicted Mean Vote
A DefinitionThe predicted mean vote (PMV) was developed by Povl Ole Fanger at Kansas State University and the Technical University of Denmark as an empirical fit to the human sensation of thermal comfort. It was later adopted as an ISO standard. It predicts the average vote of a large group of people on the a seven-point thermal sensation scale where:
- +3 = hot
- +2 = warm
- +1 = slightly warm
- 0 = neutral
- -1 = slightly cool
- -2 = cool
- -3 = cold
What Do Metrics Want? How Quantification Prescribes Social Interaction on Facebook
A Research Paper by Benjamin GrosserWhat are the effects of this enumeration, of these metrics that count our social interactions? In other words, how are the designs of Facebook leading us to act, and to interact in certain ways and not in others? For example, would we add as many friends if we weren’t constantly confronted with how many we have? Would we “like” as many ads if we weren’t told how many others liked them before us? Would we comment on others’ statuses as often if we weren’t told how many friends responded to each comment?
In this paper, I question the effects of metrics from three angles. First I examine how our need for personal worth, within the confines of capitalism, transforms into an insatiable “desire for more.” Second, with this desire in mind, I analyze the metric components of Facebook’s interface using a software studies methodology, exploring how these numbers function and how they act upon the site’s users. Finally, I discuss my software, born from my research-based artistic practice, called Facebook Demetricator (2012-present). Facebook Demetricator removes all metrics from the Facebook interface, inviting the site’s users to try the system without the numbers and to see how that removal changes their experience. With this free web browser extension, I aim to disrupt the prescribed sociality produced through metrics, enabling a social media culture less dependent on quantification.
Understanding Understanding
A dot went for a walk
A dot went for a walk and turned into a line.
The dot, the line, the dance, the story, and the painting had found connections. Memory became learning, learning became understanding.Learning is remembering what one is interested in. Learning, interest, and memory are the tango of understanding.
Creating a map of meaning between data and understanding is the transformation of big data into big understanding.
The dot had embraced understanding.
Understanding precedes action.
Each of us is a dot on a journey.Admitting ignorance
The most essential prerequisite to understanding is to be able to admit when you don't know something. Striving to be the dumbest person in the room.
When you don’t have to filter your inquisitiveness through a smoke screen of intellectual posturing, you can genuinely receive or listen to new information. If you are always trying to disguise your ignorance of a subject, you will be distracted from understanding it.
Information imposters
Information imposters: This is nonsense that masquerades as information because it is postured in the form of information. We automatically give a certain weight to data based on the form in which it is delivered to us. Because we don’t take the time to question this, we assume that we have received some information.
My favorite example of this is in cookbook recipes that call for you to “cook until done.” This doesn’t tell you very much. Why bother? Information imposters are fodder for administravitis.
Michaelangelo's hammer
A young man named Michelangelo stands in front of a huge granite monolith. He stands there at a time in history before the technologies that brought us the hammer and chisel have occurred. He gazes at the rock. He dreams his dream and the best that he is able to say is, What a wonderful stone you are.
…
Michaelangelo now stands in front of the same rock. Thrust into his hands are a hammer in one and a chisel in the other. He looks at his hands, at the technological tools that they hold, and gazing at the same stone, with epiphanic zeal, says I must let Moses out.
I won't get
If I don't ask, I won't get.
Talking with Clinton
When you are talking with Clinton, he is not looking over your shoulder to see who else is in the room. You can tell he is not thinking about how he is going to respond to you. He is there, present and listening.
By the way, when you scramble the letters in the word listen, it becomes a new word: silent. We’re so often wrapped up in our own self-talk, we forget to listen and learn the information in the first place…and you can’t remember or understand something you never observed.
Scales of change
To understand revolutionary change in its full complexity – not just what happened, but why it happened – we need a model that works across multiple scales, and the disciplines that traverse them.
The method
Well no, see, that’s the tricky part. I always try to come up with things that when they find out the method, the method is as interesting as the effect itself. — David Blaine
Selling your own ignorance
When you sell your expertise - and what I mean by sell is to move ahead in a corporation, or sell an idea to a publisher, or sell an ability to a client - by definition, you’re selling from a limited repertoire.
However, when you sell your ignorance to move ahead, when you sell your desire to create and explore and navigate paths to knowledge, when you sell your curiosity - you sell from a bucket with an infinitely deep bottom that represents an unlimited repertoire. And, you sell in a way that’s not intimidating, in a way that joins the explanation to the fascination that comes with understanding.
You only understand something relative to something you already understand
A good question is better than a brilliant answer
The eyes of a traveler
We’ve all heard that travel broadens the mind. But beneath this cliché lies a deep truth. Things stand out because they’re different, so we notice every detail, from street signs to mailboxes to two you pay at a restaurant. We learn a lot when we travel, not because we are any smarter on the road but because we pay such close attention. On a trip, we become our own version of Sherlock Holmes, intensely observing the environment around us. We are continuously trying to figure out a world that is foreign and new.
Too often, we go through our day-to-day life on cruise control, oblivious to huge swaths of our surroundings. To notice friction points – and therefore opportunities to do things better – it helps to see the world with fresh eyes. When you meet creative people with lots of ideas constantly bubbling to the surface, you often come away feeling that they are operating on a different frequency. And they are, most of the time. They have all their receptors on — and frequently turned up to eleven. But the fact is, we are all capable of this mode. Try to engage a beginner’s mind. For kids, everything is novel, so they ask lots of questions, and look at the world wide-eyed, soaking it all in. Everywhere they turn, they tend to think, Isn’t that interesting? rather than, I already know that.
By adopting the eyes of a traveler and a beginner’s mindset, you will notice a lot of details that you might normally have overlook. You put aside assumptions and are fully immersed in the world around you. In this receptive mode, you’re ready to start actively searching out inspiration.
Cart before the horse
It seemed to him that in pursuit of an all-purpose, all-serving health care plan, the country was designing an ocean liner before it even understood why boats float.
The What and the How
How many aspects of problem solving and design solutions are there? Many, many might answer.
But there are actually just two: What to do and how to do it.
Before anything else, before you consider how you’re going to get it done or how much you’ll have to pay for it or how you’ll get permission to do it — before anything else, you have to decide what you want. You have to decide what kind of place you want to live in, what kind of community, what kind of city.
We don’t pay enough attention to the old adage: Be careful what you wish for, because you just may get it.
Thinking with the hand
The idea of thinking with your hands is not the exclusive domain of sculptors or engineers. In healthcare, for exams, surgeons have a powerful link between the head and the hands. Of course, like all healthcare professionals, their work involves a lot of deep knowledge and understanding. But it’s not all in their brain. If you were in medical school, learning to be a surgeon, for example, would you want your professor to be someone who writes about surgery or would you rather be taught by a surgeon? Many surgeons don’t publish scholarly articles. They spent time perfecting their skill with their hands. In some ways, the relationship between surgery and the larger field of medicine is analogous to the relationship between design and the larger field of engineering. Designers — and design thinkers —often think with their hands.
A pattern of understandings
The clock has no finished design and it has been made without any careful drawings or mathematical calculations. The pieces are only made if I can hold their details in my head as I make them, without reference to any set of external measures. I do make rough sketches of some parts as a path to understanding them, but never use these during the making of the parts. The clock gradually grows through trial and error and lots of physical work with metal, but out of this has come a set of principles of making that were not clear to me before doing the clock. I have finally realized that what I am actually making is a pattern of understandings of the process of making rather than the things that are actually being made. — Richard Benson
#15
How different am I, making clock number 15, from the process of natural selection laboring under changing conditions to generate the biological constructs? That ancient evolutionary system works on the basis of trial and error repeated in huge numbers over immense spans of time, with the failures discarded and the successes retained. At times it seems to me that my clock making is quite similar, as my mind, just barely thinking, sorts through huge numbers of possibilities and discards them as failures before even trying them, so the few that are made have a pretty good chance of success. Is this foresight some form of understanding? I think not. No revelation here, just enough thinking to spur the maker on to cut some piece of metal which, once made, might fail or succeed. Yet — in either case — the thing made and its creation remains the sole root of any real understanding that takes place. The clock is crude but gets built, and even in its base simplicity teaches its maker how to understand what must be understood for something to be made. — Richard Benson
A classroom without walls
The city is education – and the architecture of education rarely has much to do with the building of schools. The city is a schoolhouse, and its ground floor is both bulletin board and library. The graffiti of the city are its window displays announcing themselves, telling about what they’re doing and why and where they’re doing it. Everything we do – if described, made clear, and made observable – is education: the Show and Tell, the city itself. It is a classroom without walls, an open university for people of all ages offering a boundless curriculum with unlimited expertise. If we can make our urban environment comprehensible and observable, we will have created classrooms with endless windows on the world.