Evaluating Teaching Effectiveness: Learning Evidence, Peer Review and Student Feedback

State the purpose before collecting evidence

Teaching evaluation may support course improvement, professional development, promotion or institutional accountability. These purposes require different processes. An informal mid-course conversation should not quietly become a high-stakes performance measure. Explain the purpose, evidence, criteria and decision-makers before the evaluation begins.

Carnegie Mellon's assessment resources distinguish assessing learning from examining teaching practice.^[1] A useful institutional approach considers both while recognising that student outcomes are influenced by prior preparation, resources and many factors beyond an individual teacher. Evaluation should investigate contribution and context rather than assume a simple causal relationship.

Examine evidence of learning

Review a sample of student work against the intended outcomes. Look for patterns: concepts students misunderstand, reasoning they can demonstrate and skills that remain underdeveloped. Compare assessment requirements with what was taught and practised. High marks alone do not establish strong learning if the assessment was too easy or poorly aligned.

Where comparisons across cohorts are made, consider changes in student intake, assessment design and course delivery. A consistent rubric can improve interpretability, but it does not make different groups identical. Discuss unexpected results with the teacher and include their explanation in the record. Use anonymised work and follow applicable data-handling rules.

Use student feedback for the questions it can answer

Students can describe the clarity of instructions, accessibility of materials, usefulness of feedback and experience of the learning environment. They may have less information about the academic standard across a discipline or the long-term value of difficult content. Ask focused questions and distinguish experience from overall popularity.

Vanderbilt publishes formal guidelines for its course and teaching evaluation process.^[2] Institutions should similarly make their own process clear. Record response rates and timing, avoid overinterpreting small samples and examine comments for recurring, specific issues. Abusive or discriminatory remarks should not be treated as legitimate evidence of teaching quality.

Organise peer review around agreed criteria

Peer review can examine course design, assessment materials, classroom practice or feedback. Choose reviewers who understand the discipline and the purpose of the exercise. A pre-review discussion should establish the class context and the aspects on which feedback is sought. One observation provides a narrow view and should not be treated as a complete account of teaching.

Ask reviewers to describe what they observed and why it matters for learning. Separate observation from interpretation. A quiet classroom, for example, may reflect individual problem-solving rather than disengagement. Give the teacher an opportunity to clarify and respond. For high-stakes decisions, use a documented process with moderation and appropriate review rights.

Illustrative example: conflicting evidence

Imagine a lecturer whose students report that a course feels demanding, while their analytical work improves across the semester. Peer review finds well-aligned assignments but identifies instructions that are difficult to navigate. A single satisfaction score might suggest weak teaching; marks alone might suggest that no change is needed.

A balanced review concludes that the intellectual challenge should remain while the assignment guidance is improved. The lecturer introduces a clearer brief, a worked example and a scheduled question session. The next review examines student understanding of the task and the quality of the resulting work. This is an illustrative improvement process, not a claim that one intervention guarantees better outcomes.

Combine evidence through reasoned judgement

Create a concise evidence summary showing what each source supports and where uncertainty remains. Do not automatically average incompatible measures into a single score. A peer judgement, response percentage and student performance trend have different meanings. If a composite measure is required, explain its rationale and limitations and examine how weighting affects conclusions.

Include a reflective account from the teacher, supported by examples. This allows the evaluation to consider choices, constraints and changes already made. Reviewers should assess the evidence rather than reward persuasive self-presentation. Clear criteria and calibration help maintain fairness across departments and teaching formats.

Turn findings into a development plan

Agree a small number of priorities, the support required and a review date. Improvements might involve assessment redesign, mentoring, workload changes or better access to learning technology. Assign responsibility for institutional barriers instead of placing every problem on the teacher.

Keep the evaluation record secure and share it only for its stated purpose. Review the system itself: does it encourage better teaching, create disproportionate workload or penalise particular teaching contexts? Teaching evaluation is most useful when it produces an explainable judgement and a realistic route to improvement, while respecting the limits of the available evidence.