
For your company
Foundations
Module · Does anyone check if it worked?
The Outcome Loop Check
Most companies produce recommendations and never learn whether they worked. A closed loop runs from recommendation to action to a measured outcome and back again, and it is the single mechanism that lets AI improve instead of just repeating itself. This module checks whether even one such loop exists, and where your chains break.
What the five levels look like
Every dimension in this assessment is scored 1 to 5. This is what the levels mean, dimension by dimension. The graded report diagnoses where your own answers land and what to do about it.
A closed loop exists
- 1None exist
- 2Cannot name one
- 3One, informally
- 4A few loops
- 5Loops everywhere
At the low end: Without a single closed loop, your AI cannot learn from consequences, only from inputs. Build one end to end on a low-stakes decision before scaling anything. What good looks like: Multiple closed loops mean your system learns from reality, not just data. Protect the measurement step; it is the first thing that quietly gets dropped.
Outcomes, not outputs
- 1Outputs only
- 2Activity metrics
- 3Some outcomes
- 4Outcomes tracked
- 5Outcomes drive next step
At the low end: Measuring activity instead of results tells you effort, not effect. Pick one recurring decision and define the single outcome that would prove it worked. What good looks like: Outcomes that drive the next decision are the definition of a learning organisation. Keep the outcome definitions honest; vanity metrics reopen the loop silently.
Recommendations reach action
- 1Die in decks
- 2Rarely actioned
- 3Sometimes actioned
- 4Usually actioned
- 5Action is default
At the low end: Recommendations that never become action make the whole loop impossible downstream. Track the action rate first; you may find the problem is not your models at all. What good looks like: When action is the default, the rest of the loop becomes worth building. Watch for silent vetoes where action is logged but nothing actually changes.
You know where it breaks
- 1No idea
- 2Vague sense
- 3One chain mapped
- 4Chains mapped
- 5Breaks monitored
At the low end: If you cannot see where the chain breaks, every fix is a guess. Map one chain link by link and mark the exact step where the trail goes cold. What good looks like: Knowing your break points means you fix loops instead of blaming algorithms. Monitor them, because break points move as processes change.
Someone closes the loop
- 1Nobody owns it
- 2Model team only
- 3Unclear ownership
- 4Named owner
- 5Owner with authority
At the low end: An unowned loop will not close itself; the measurement step has no natural champion. Name one person accountable for the whole chain, not just the model. What good looks like: A loop owner with authority is what keeps the chain closed under pressure. Make sure they can change the recommendation, not just report on it.