Our Quantified Life
The primary measure of progress
SAFe is oriented around volume, not value
Outcomes decide
Design as an engineering problem
Obsessed with absolute numbers
Lost purposes
The case against heatmaps
It's All Over
An Essay by Justin E. H. SmithIt has come to seem to me recently that this present moment must be to language something like what the Industrial Revolution was to textiles. A writer who works on the old system of production can spend days crafting a sentence, putting what feels like a worthy idea into language, only to find, once finished, that the internet has already produced countless sentences that are more or less just like it, even if these lack the same artisanal origin story that we imagine gives writing its soul. There is, it seems to me, no more place for writers and thinkers in our future than, since the nineteenth century, there has been for weavers.
Time-based analytics
An Article by Ryan SingerAnalytics apps don't tell you much about usage behavior. You might be able to see how many users performed an event, or how many times they did it. But none of the analytics packages out there are good at showing you how often people do things. Are they using to-dos once a week? Every day? Only signing into the app once a month but happily paying for years?
Time matters. You can't understand usage without time.
Fast Path to a Great UX – Increased Exposure Hours
An Article by Jared SpoolAs we’ve been researching what design teams need to do to create great user experiences, we’ve stumbled across an interesting finding. It’s the closest thing we’ve found to a silver bullet when it comes to reliably improving the designs teams produce.
The solution? Exposure hours. The number of hours each team member is exposed directly to real users interacting with the team’s designs or the team’s competitor’s designs. There is a direct correlation between this exposure and the improvements we see in the designs that team produces.
Metrics have a strange hold on the imagination
A Fragment by Shawn WangOnce in place, metrics have a strange hold on the imagination: I've seriously had a CTO carelessly reject my genuine idea out of hand because "it doesn't help OKRs", the same OKRs we previously agreed should not describe all that we do.
I agree with Amir Shevat that we should "do the right things over the easy to measure things."
How would you feel if you could no longer use the product?
An ArticleThe product/market fit definitions I had found were vivid and compelling, but they were lagging indicators — by the time investment bankers are staking out your house, you already have product/market fit. Instead, Ellis had found a leading indicator: just ask users “how would you feel if you could no longer use the product?” and measure the percent who answer “very disappointed.”
Site performance is potentially the most important metric
A Fragment by Kealan ParrSite performance is potentially the most important metric. The better the performance, the better chance that users stay on a page, read content, make purchases, or just about whatever they need to do. A 2017 study by Akamai says as much when it found that even a 100ms delay in page load can decrease conversions by 7% and lose 1% of their sales for every 100ms it takes for their site to load which, at the time of the study, was equivalent to $1.6 billion if the site slowed down by just one second.
The McNamara fallacy
A DefinitionThe McNamara fallacy, named for Robert McNamara, the US Secretary of Defense from 1961 to 1968, involves making a decision based solely on quantitative observations (or metrics) and ignoring all others. The reason given is often that these other observations cannot be proven.
The fallacy refers to McNamara's belief as to what led the United States to defeat in the Vietnam War—specifically, his quantification of success in the war (e.g., in terms of enemy body count), ignoring other variables.
Artifice, blindness, and suicide
A QuoteThe first step is to measure whatever can be easily measured. This is OK as far as it goes. The second step is to disregard that which can't be easily measured or to give it an arbitrary quantitative value. This is artificial and misleading. The third step is to presume that what can't be measured easily really isn't important. This is blindness. The fourth step is to say that what can't be easily measured really doesn't exist. This is suicide.
Weighing up UX
An Article by Jeremy KeithMetrics come up when we’re talking about A/B testing, growth design, and all of the practices that help designers get their seat at the table (to use the well-worn cliché). But while metrics are very useful for measuring design’s benefit to the business, they’re not really cut out for measuring user experience.
Predicted Mean Vote
A DefinitionThe predicted mean vote (PMV) was developed by Povl Ole Fanger at Kansas State University and the Technical University of Denmark as an empirical fit to the human sensation of thermal comfort. It was later adopted as an ISO standard. It predicts the average vote of a large group of people on the a seven-point thermal sensation scale where:
- +3 = hot
- +2 = warm
- +1 = slightly warm
- 0 = neutral
- -1 = slightly cool
- -2 = cool
- -3 = cold
What Do Metrics Want? How Quantification Prescribes Social Interaction on Facebook
A Research Paper by Benjamin GrosserWhat are the effects of this enumeration, of these metrics that count our social interactions? In other words, how are the designs of Facebook leading us to act, and to interact in certain ways and not in others? For example, would we add as many friends if we weren’t constantly confronted with how many we have? Would we “like” as many ads if we weren’t told how many others liked them before us? Would we comment on others’ statuses as often if we weren’t told how many friends responded to each comment?
In this paper, I question the effects of metrics from three angles. First I examine how our need for personal worth, within the confines of capitalism, transforms into an insatiable “desire for more.” Second, with this desire in mind, I analyze the metric components of Facebook’s interface using a software studies methodology, exploring how these numbers function and how they act upon the site’s users. Finally, I discuss my software, born from my research-based artistic practice, called Facebook Demetricator (2012-present). Facebook Demetricator removes all metrics from the Facebook interface, inviting the site’s users to try the system without the numbers and to see how that removal changes their experience. With this free web browser extension, I aim to disrupt the prescribed sociality produced through metrics, enabling a social media culture less dependent on quantification.
The Pale King
We change them and are changed
"We fill pre-existing forms and when we fill them we change them and are changed."
— Frank Bidart, Borges and I
Displacement
...the man fitted to his job like a man to the exact pocket of space he displaces.
What's wrong?
Pay attention, boy. The next suitable person you're in light conversation with, you stop suddenly in the middle of the conversation and look at the person closely and say, "What's wrong?" You say it in a concerned way. He'll say, "What do you mean?" You say, "Something's wrong. I can tell. What is it?" And he'll look stunned and say, "How did you know?" He doesn't realize something's always wrong, with everybody. Often more than one thing.
Narrative codes
The idea, as both sides' counsel worked it out, is that you will regard features like shifting p.o.v.s, structural fragmentation, willed incongruities, & c. as simply the modern literary analogs of 'Once upon a time...' or 'Far, far away, there once dwelt...' or any of the other traditional devices that signaled the reader that what was under way was fiction and should be processed accordingly. For as everyone knows, whether consciously or not, there's always a kind of unspoken contract between a book's author and its reader; and the terms of this contract always depend on certain codes and gestures that the author deploys in order to signal the reader what kind of book it is, i.e., whether it's made up vs. true. And these codes are important, because the subliminal contract for nonfiction is very different from the one for fiction.
An enormous machine
The couple of years in question here saw one of the largest bureaucracies anywhere undergo a convulsion in which it tried to reconceive itself as a non- or even anti-bureaucracy, which at first might sound like nothing more than an amusing bit of bureaucratic folly. In fact, it was frightening; it was a little like watching an enormous machine come to consciousness and start trying to think and feel like a real human.
Abstruse dullness
Consider, from the Service's perspective, the advantages of the dull, the arcane, the mind-numbingly complex. The IRS was one of the very first government agencies to learn that such qualities help insulate them against public protest and political opposition, and that abstruse dullness is actually a much more effective shield than is secrecy. For the great disadvantage of secrecy is that it's interesting.
To hide or dissemble
Fact: The birth agonies of the New IRS led to one of the great and terrible PR discoveries in modern democracy, which is that if sensitive issues of governance can be made sufficiently dull and arcane, there will be no need for officials to hide or dissemble, because no one not directly involved will pay enough attention to cause trouble.
Distraction
To me, at least in retrospect, the really interesting question is why dullness proves to be such a powerful impediment to attention. Why we recoil from the dull. Maybe it's because dullness is intrinsically painful; maybe that's where phrases like 'deadly dull' or 'excruciatingly dull' come from. But there might be more to it. Maybe dullness is associated with psychic pain because something that's dull or opaque fails to provide enough stimulation to distract people from some other, deeper type of pain that is always there, if only in an ambient, low-level way, and which most of us spend nearly all our time and energy trying to distract ourselves from feeling, or at least from feeling directly or with our full attention.
The Manual
I don't believe I have anything to say that isn't in the code or Manual.
In a stare
Being in a stare referred to staring fixedly and without expression at something for extensive periods of time. It can happen when you haven't had enough sleep, or too much sleep, or if you've overeaten, or are distracted, or merely daydreaming. It is not daydreaming, however, because it involved gazing at something. Staring at it. Usually straight ahead—a shelf on a bookcase, or the centerpiece on the dining room table, or your daughter or child. But in a stare, you are not really looking at this thing you are seeming to stare at, you are not even really noticing it—however, neither are you thinking of something else. You in truth are not doing anything, mentally, but you are doing it fixedly, with what appears to be intent concentration. It is as if one's concentration becomes stuck the way an auto's wheels can be stuck in the snow, turning rapidly without going forward, although it looks like intense concentration. And now I too do this.
We infantilize ourselves
Here in the US, we expect government and law to be our conscience. Our superego, you could say. It has something to do with liberal individualism, and something to do with capitalism, but I don't understand much of the theoretical aspect—what I see is what I live in. Americans are in a way crazy. We infantilize ourselves. We don't think of ourselves as citizens—parts of something larger to which we have profound responsibilities. We think of ourselves as citizens when it comes to our rights and privileges, but not our responsibilities. We abdicate our civic responsibilities to the government and expect the government, in effect, to legislate morality.
Doubling
Obetrolling didn't make me self-conscious. But it did make me much more self-aware. If I was in a room, and had taken an Obetrol or two with a glass of water and they'd taken effect, I was now not only in the room, but I was aware that I was in the room. In fact, I remember I would often think, or say to myself, quietly but very clearly, 'I am in this room.' It's difficult to explain this. At the time, I called it 'doubling', but I'm still not entirely sure what I meant by this, nor why it seemed so profound and cool to not only be in a room but be totally aware that I was in the room.
Strings and clots
The walls' texture was mostly smooth, but if you really focused your attention there were also a lot of the little embedded strings and clots which painters tend to leave when they're paid by the job and not the hour and thus have no motivation to hurry. If you really look at something, you can almost always tell what type of wage structure the person who made it was on.
More by accident
In an intentional bout of concentrated major thinking, where you sit down with the conscious intention of confronting major questions like 'Am I currently happy?' or 'What, ultimately, do I really care about and believe in?' or— particularly if some kind of authority figure has just squeezed your shoes—'Am I essentially a worthwhile, contributing type of person or a drifting, indifferent, nihilistic person?', then the questions often end up not answered but more like beaten to death, so attacked from every angle and each angle's different objections and complications that they end up even more abstract and ultimately meaningless than when you started. Nothing is achieved this way, at least that I've ever heard of. Certainly, from all evidence, St. Paul, or Martin Luther, or the authors of The Federalist Papers, or even President Reagan never changed the direction of their lives this way—it happened more by accident.
Wisdom
This remains largely theory, but my best guess as to his never dispensing wisdom like other dads is that my father understood that advice—even wise advice—actually does nothing for the advisee, changes nothing inside, and can actually cause confusion when the advisee is made to feel the wide gap between the comparative simplicity of the advice and the totally muddled complication of his own situation and path.
No-nonsense
Admittedly, though, however alert and aware I felt, I was probably more aware of the effects the lecture seemed to be having on me than of the lecture itself, much of which was over my head, and yet was almost impossible to look away from or not feel stirred by. This was partly due to the substitute's presentation, which was rapid, organized, undramatic, and dry in the way of people who know that what they are saying is too valuable in its own right to cheapen with concern about delivery or 'connecting' with the students. In other words, the presentation had a kind of zealous integrity that manifested not as style but as the lack of it. I felt that I suddenly, for the first time, understood the meaning of my father's term 'no-nonsense', and why it was a term of approval.
The pie has been made
"In today's world, boundaries are fixed, and most significant facts have been generated. Gentleman, the heroic frontier now lies in the ordering and deployment of those facts. Classification, organization, presentation. To put it another way, the pie has been made—the contest is now in the slicing."
Midwest sunset
For those who've never experienced a sunrise in the rural Midwest, it's roughly as soft and romantic as someone's abruptly hitting the lights in a dark room. This is because the land is so flat that there is nothing to impede or gradualize the sun's appearance. It's just all of a sudden there.
Test anxiety
It was part of a larger discussion about younger examiners and television and the theory that America had some vested economic interest in keeping people over-stimulated and unused to silence and single-point concentration. Shackleford's observation was that the real object of the crippling anxiety in 'test anxiety' might well be a fear of the tests' associated stillness, quiet, and lack of time for distraction. Without distraction, or even the possibility of distraction, certain types of people feel dread—and it's this dread, not so much the test itself, that people feel anxious about.
To fill in the gaps
It would be easy to impose on the office a whole welter of detail, explanation, and background that was actually gleaned only later and not part of my arrival and dazed scurrying about with the Iranian Crisis at all. Which is a quirk of temporal memory—one tends to fill in gaps with data acquired only later, sort of the same way the brain automatically works to fill in the visual gap caused by the optical cord's exit through the back of the retina.
Every love story is a ghost story
What hell is
He felt in a position to say he knew now that hell had nothing to do with fires or frozen troops. Lock a fellow in a windowless room to perform rote tasks just tricky enough to make him have to think, but still rote, tasks involving numbers connected to nothing he'd ever see or care about, a stack of tasks that never went down, and nail a clock to the wall where he can see it, and just leave the man there to his mind's own devices.
No place it hadn't already been
He imagined that the clock's second hand possessed awareness and knew that it was a second hand and that its job was to go around and around inside a circle of numbers forever at the same slow unvarying machinelike rate, going no place it hadn't already been a million times before, and imagining the second hand was so awful it made his breath catch in his throat and he looked quickly around to see if any of the examiners around him had heard it or were looking at him.
The word invents itself
Posits certain neologisms as arising from their own cultural necessity—his words, I believe. Yes, he said. When the kind of experience that you're getting a man-sized taste of becomes possible, the word invents itself.
Unborable
The underlying bureaucratic key is the ability to deal with boredom. To function effectively in an environment that precludes everything vital and human. To breathe, so to speak, without air.
The key is the ability, whether innate or conditioned, to find the other side of the rote, the picayune, the meaningless, the repetitive, the pointlessly complex. To be, in a word, unborable. I met, in the years 1984 and '85, two such men.
It is the key to modern life. If you are immune to boredom, there is literally nothing you cannot accomplish.
Institutional structure
'That was all he said it seemed like I needed, just to talk to somebody with no bullshit, which was what the Zeller Center doctors didn't realize, or like they couldn't realize it because then the whole structure would come down, that here the doctors had spent four million years in medical school and residency and the insurance companies were paying all this money for diagnosis and OT and therapy protocols, it was all an institutional structure, and once things became institutionalized then it all became this artificial, like, organism and started trying to survive and serve its own needs just like a person, only it wasn't a person, it was the opposite of a person, because there was nothing inside it except the will to survive and grow as an institution.'