Field note · October 26, 2023

Reader question — The anatomy of a silent failure

A walk through a real class of incident — the kind where every job is green, every test passes, and the number has been wrong for six weeks.

1 min read ·Data quality ·practice

Reader question on The anatomy of a silent failure, and the answer belongs somewhere more findable than an email.

A walk through a real class of incident — the kind where every job is green, every test passes, and the number has been wrong for six weeks.

The question was, roughly, "when does this stop applying?" — which is the right question and the one lessons routinely fail to answer. Every technique has a range of validity, and stating it is what separates a lesson from a recipe.

It sits in the Data quality and trust module. The exercise is a thinking one rather than a query one — some of this material is about deciding what to compute, and that does not need a keyboard.

Ordering matters here more than in most courses. It follows Testing data like you test code and leads into The first hour with an unfamiliar dataset, and reading it out of sequence mostly works but costs you the setup.

Free means free, and it also means we can rewrite it whenever it is wrong. No edition, no errata PDF, nothing to repurchase. The whole course is 36 lessons and the fixes land the day we find them.