Measurement and reporting
Domain 02 of the eight in the NBOP standard. This page explains what the domain is and how it fails. It does not say how much the domain is worth, because that has not been decided yet and will not be decided here.
Its number in the published standard, which is an order rather than a ranking.
The standard is at version 0.9. The weight of this domain is not set.
Domains you need personal accountability in to be eligible. This is one of the eight.
The standard an assessment is built from, readable in full, permanently.
What the standard says
Selecting measures that reflect the health of the operation rather than the convenience of the reporter. Building reporting that changes decisions. Distinguishing leading from lagging indicators in a live business.
That is the whole of the published entry. Everything below expands it and is not itself the standard. Where the two ever disagree, the standard is the document that governs.
What this domain is
Measurement and reporting is what the organisation can perceive about itself, and how much of that is true. Every measure is a proxy for something that cannot be observed directly. This domain is choosing proxies that stay honest when the business is under pressure, and putting them in front of the person who can act on them at the moment acting is still possible.
The reporting half is not presentation. A report that is accurate, timely, beautifully built and attached to no decision is a cost with no return, and most reporting suites contain several.
What it looks like when it is working
- Every recurring report has a decision attached to it, and somebody can say what would change if the number moved.
- Measures survive the quarter they were designed in, because they were chosen against the operation rather than against a reporting deadline.
- When two functions disagree about a number, they resolve it by comparing definitions rather than by arguing about intent.
- Somebody can tell you which indicators lead and which lag, and is right.
How it fails
The common failure is reporting that measures the reporting. The number that is easiest to produce becomes the number that is watched, then the number that is managed, and the operation drifts toward whatever that proxy rewards.
The second is a measure that was true when it was chosen and then became a target, at which point it stopped being a measure and became a thing people optimise directly.
Why competent operators miss it
Because the reports look excellent. They are complete, they arrive on time, they are well designed, and no one asks the only question that matters, which is what decision any of them last changed. A reporting function is easy to assess on craft and hard to assess on consequence, so it usually gets assessed on craft.
What accountability here actually means
Eligibility for NBOP-CP asks for personal accountability in at least four of the eight domains. Personal is the operative word. Having worked somewhere that did this well is not accountability, and neither is having been consulted. The test is whether the decision was yours to make and yours to answer for.
For this domain, that looks like at least one of the following.
- You chose measures rather than only producing them.
- You have killed a report that somebody liked, and survived it.
- You have changed a definition and taken the argument that followed.
What NBOP does not claim about this domain yet
Not how much it is worth. The weight of each domain is being set by a job task analysis of practising operators, rating tasks on criticality and on frequency, and the weights are derived from those paired ratings rather than from editorial preference. Until that closes, the standard states equal provisional weighting and says so on its face.
Not what an assessment will ask about it. The examination blueprint follows the analysis. Publishing an item count now would mean inventing one and quietly changing it later.
Not that this description is finished. Version 0.9 is a draft and is expected to change materially before ratification. If you hold operational responsibility and think this domain is described wrongly, that is the input worth having.
The eight domains
Each governs a different part of how an operation is run. They are numbered for reference, not for importance.
Set the weight of this domain
The weighting is decided by operators rating the work, not by NBOP deciding what matters.
The analysis is open now. It takes about twenty minutes, because every task is rated twice, and the results are published in aggregate including the findings that contradict the current draft. If you have held operational responsibility, your rating counts toward the weight this domain ends up carrying.