Sampling QA Without Pretending You Shipped a Census

Sampling is not shameful; pretending full coverage when you only peeked is. We teach analysts to headline the frame: time window, platform, known exclusions, and the rate of dropped events instead of burying it appendix-style.

During critiques, we interrupt friendly decks the way executives do. If the answer relies on “we checked a few,” we rewrite the claim or widen the sample until language tightens.

Warehouse-ready teams extend the ethic to incremental loads: watermark timestamps, late-arriving facts, and the blunt phrase “known drift” belong beside freshness badges. Glossing delays erodes trust faster than a ugly chart.

We close with documentation you can paste into internal wikis without blush. If it sounds like marketing, it fails review. If it sounds like engineering, it ships.