Observe data collection at the moment of measurement See, observe, learn how data are collected at moment and place of measurement. "You never learn more about a process than when you directly observe how data are actually measured," said Cuthbert Daniel, a superb applied statistician. See with fresh eyes. Walk around what you want to learn about. Talk to those who do measurements. See how numbers came to be. Do those measuring know the desired answer? Are those measuring skilled, alert, honest, biased, incompetent, sloppy, tired and emotional?...Artifacts and errors in measurements measured? How are outliers adjudicated? Edward Tufte, Seeing With Fresh Eyes uxmeasurement
We are surrounded by ghosts An Article by David R. MacIver notebook.drmaciver.com I'd like to call the more general phenomenon that this is a specific instance of "ghost knowledge": It is knowledge that is present somewhere in the epistemic community, and is perhaps readily accessible to some central member of that community, but it is not really written down anywhere and it's not clear how to access it. Roughly what makes something ghost knowledge is two things: It is readily discoverable if you have trusted access to expert members of the community. It is almost completely inaccessible if you are not. In this sense, most knowledge is ghost, particularly if you take an expansive view of what counts as an epistemic community. knowledge