Understanding the context in which assessment and feedback developments occur is important. When we introduce interventions to address concerns we have about assessment and feedback we should evaluate their impact in a robust way.

Not all interventions or changes need to be substantial or major, substantial effects can be obtained by changing the way in which information is communicated to students, or involving students to rewrite guidelines and/or criteria; engaging actively with students to help them understand an underpinning concept for the assessment; using more team-based moderation processes to make the assessment more robust and equitable.
Larger changes, where the assessment itself is substantially revised, or a wider assessment strategy for the School/Department of institution, will have wider impacts.
The EAT-Erasmus Case Studies provide examples of both small and large changes to assessment approaches, and reviews of the impacts they have had.
Impact of changes and interventions can be evaluated at a range of levels vis a vis the assessment effect on stakeholders.
Activity: See the EAT guide to measuring impact at:
· Institutional level
· School/department/faculty level
· Module/course level
· Individual assessment level
Evaluations can also address a range of issues, such as
· Changes to personal practice
· Changes to team practices/perceptions
· Changes to student behaviours/perceptions
· Changes to student outcomes
What you are looking for in an evaluation, and how you define a ‘high quality’ activity are key elements to consider. These elements are addressed in the next activity:
ACQUISITION ACTIVITY
This recording of one of the EAT-Erasmus Webinar Series discusses the ways of measuring impact of interventions and changes in assessment.
Activity: Review the first 16 minutes of the recording, and note down the different ways in which evaluation of impact can be addressed.
Consider the Foci (factors which might change as a result of the intervention); Reach (the extent of the impact) and the Subjects (people involved/affected by the assessment)
Activity: Examine another approach to auditing the impact of an assessment.
This approach provides educators with a series of reflective questions regarding the following areas:
· Outcomes: Performance; skills development; products
o Student learning outcomes
o Impact on behaviours and beliefs
o Student satisfaction
o Assessment design/performance
o Impact on educator behaviours
o Impact on policy
· Sustainability and longer-term gains
· Transferability
· Personal reflections from the experience of applying the change/intervention
The critical question asked in this review of impact is to encourage the educator to consider “How would you measure this?” – encouraging educators to reflect on the range of data sources we mentioned earlier in this module.