Did It Work?
Public organizations report what they did far more easily than what changed. This brief argues that outcome quality is set before action: define the change, establish where things stand, declare what will be read again, and return to it. Comparable readings show change. On their own, they do not establish cause.
- 01Outputs are not outcomes.
Actions completed show delivery. Only a change in conditions answers whether it worked.
- 02Outcomes need their context.
A result read without the structure and process behind it is a number. Read with them, it is evidence.
- 03Outcome quality is designed before the work begins.
Define, baseline and declare first, then read again on comparable terms.
- DefineThe change the decision is meant to produce.
- BaselineWhere things stand before acting.
- DeclareWhat will be read again, and when.
- Read againOn comparable terms.
- LearnKeep, adjust or stop.
Systems answer slowly. The return is planned before the work, not after.
An outcome read without its structure and process is a number. Read with them, it is evidence.
Questions to ask.
Before the next decision reaches the table.
- What change is this decision meant to produce?
- Where do things stand today?
- What will we read again, and on what terms?
- What would tell us to adjust, or stop?
References and limits
This brief does not claim
- Comparable readings establish change, not cause.
- It makes no outcome claim about any specific organization.
- Federal evidence requirements cited apply to federal agencies.
- Hatry, H. P. (2006). Performance measurement: Getting results (2nd ed.). Urban Institute Press.
- Donabedian, A. (1988). The quality of care: How can it be assessed? JAMA, 260(12), 1743–1748. doi:10.1001/jama.1988.03410120089033
- Meadows, D. H. (2008). Thinking in systems: A primer. Chelsea Green.
- Campbell, D. T. (1979). Assessing the impact of planned social change. Evaluation and Program Planning, 2(1), 67–90. doi:10.1016/0149-7189(79)90048-X
- Office of Management and Budget. (2019). Phase 1 implementation of the Foundations for Evidence-Based Policymaking Act of 2018 (M-19-23). Executive Office of the President.
Cite this briefHampton Wilson Institute. (2026). Did it work? Outcome quality in public organizations (Research Brief 03). EVOLVRS. https://evolvrshq.com/research/did-it-work/
See clearly. Decide with evidence.
Bring the decision. The Institute will help you test what the evidence can carry.