Measuring Research Impact: From Outputs to Outcomes and Public Value

Begin with the change you hope to support

An impact plan should identify a plausible change and the people or organisations who might experience it. A report, dataset, workshop or prototype is usually an output. An outcome might be a revised practice, an adopted tool or a better-informed decision. Longer-term benefit requires evidence that those changes mattered in context.

UKRI's reporting guidance asks award holders to describe outputs or outcomes and, where possible, their impact. ^[1] That distinction is useful beyond any particular funding system. It prevents institutions from describing every completed activity as a demonstrated benefit. The reporting obligations for a specific grant must still be checked in its award conditions.

Build a practical pathway of contribution

Write a short sequence connecting the research, the engagement activity, the intended user action and the expected benefit. Add assumptions between the stages. A study may be relevant to curriculum design, but curriculum committees need time, authority and resources to act. The pathway is an explanation to test, not a promise that change will occur.

Identify alternative influences. A policy may change because of several studies, public pressure, administrative priorities and available funding. Record what the project plausibly contributed and what cannot be separated from those other influences. Use language that matches the evidence, such as informed, supported, adapted or contributed to, rather than claiming sole causation.

Select evidence before the story is written

Choose indicators that relate to the intended change. Attendance records can show participation, but they do not establish that participants changed practice. A revised institutional guideline, dated implementation records and interviews with decision-makers may help establish a stronger account of use. Ask permission before collecting or publishing identifiable testimony.

NHMRC's impact position distinguishes verifiable research outcomes from anticipated effects. ^[2] Use that distinction to label evidence honestly. Record baseline conditions where feasible, specify when follow-up will occur and explain the limits of any comparison. Small projects need proportionate evaluation, not elaborate measurement that consumes the resources intended for the work itself.

Illustrative example: research on assessment feedback

Imagine a team studies how students interpret written feedback. It produces a report and holds a faculty workshop. These are outputs. A department then revises its feedback template and introduces staff discussion sessions. Those decisions are potential outcomes, documented by meeting records and revised materials.

To explore benefit, the team follows up on whether students understand the feedback and can use it in later work. It also checks staff workload and whether some learners remain excluded. A finding of improved understanding would need appropriate evidence and consideration of other changes. Workshop attendance alone would not justify claiming improved academic achievement across the university.

Create an impact evidence register

Maintain a simple record containing the claim, supporting evidence, date, source, permission status and limitations. Link evidence to a specific project or contribution. Store confidential material securely and prepare a public version that removes information that should not be disclosed.

• Record what changed and who experienced the change.
• Keep a dated account of the project's involvement.
• Distinguish independent corroboration from the team's own account.
• Explain how participants or organisations were selected for follow-up.
• Record negative, uneven or unintended effects.
• Identify gaps that prevent a stronger conclusion.

Review the register periodically. Evidence gathered years later can be difficult to reconstruct accurately, particularly when project staff or external partners have moved on.

Consider value, distribution and time

A beneficial change for one group may impose costs on another. A digital service can save administrative time while making access harder for people with limited connectivity. Include these trade-offs in evaluation instead of treating total uptake as sufficient evidence of public value.

Some contributions emerge slowly or indirectly. Basic research, cultural work and capacity development may influence later activity that cannot be traced through a short linear chain. Choose an evaluation period suited to the project and explain why. Where no outcome is yet demonstrated, report credible progress and remaining uncertainty rather than manufacturing a success story.

Write a defensible impact account

A strong account states the problem, identifies the research contribution, describes the change and presents evidence proportionate to the claim. Separate observed results from expected future benefits. Include the institutional or social context that limits transfer to other settings.

Impact assessment does not replace research quality assessment, nor does every valuable study need an immediate commercial or policy outcome. Used carefully, it helps researchers learn how knowledge travels and helps institutions explain their contribution with greater precision.