NBOP National Board of Operations Professionals

Part two. The Mill

Why you cannot see a loop from inside it

Every instrument you have was generated by the thing you are trying to measure.

0:57. Captions on by default. Everything said here is also written above, so nothing is only in the video.

Read the transcript

The reason a competent operator cannot detect the Mill by looking harder is that looking harder uses the same instruments, and those instruments came out of the loop. Work through where a typical operating dashboard came from. Someone chose the metrics, based on what the organisation was doing at the time, and what the organisation was doing at the time was the loop. The reporting cadence was set to match the decision cadence, which was set to match the work cadence. The definitions of done were written by the people doing the work. None of that is corrupt. It is the normal way instruments get built, and it produces a measurement system exquisitely sensitive to variation inside the loop and structurally blind to the loop itself. It will tell you that this week was worse than last week. It cannot tell you that all fifty weeks were the same week.

The reason a competent operator cannot detect the Mill by looking harder is that looking harder uses the same instruments, and those instruments came out of the loop.

Work through where a typical operating dashboard came from. Someone chose the metrics, and they chose them based on what the organisation was doing at the time, and what the organisation was doing at the time was the loop. The reporting cadence was set to match the decision cadence, which was set to match the work cadence. The definitions of done were written by the people doing the work. The thresholds for "good" were set from last year's numbers, which were produced by the same process.

None of that is corrupt. It is the normal way instruments get built, and it produces a measurement system that is exquisitely sensitive to variation inside the loop and structurally blind to the loop itself. It will tell you that this week was worse than last week. It cannot tell you that all fifty weeks were the same week.

This is why "we need better visibility" so often produces more dashboards and no new information. More instruments of the same provenance give you higher resolution on the states you could already distinguish, and none at all on the states you could not.

The way out is not more measurement. It is one measurement from outside, which is the subject of the third part of this course.

Two things worth doing, neither of which costs anything

Read the standard in full, free and in the open, before you pay anything or give anyone an address.