By Gill Chudley
Are you teaching arts, design or physical and health education in the IB Middle Years Programme (MYP)? As you will soon be assessing your students’ work, we have put together some tips and guidance to help you through this important process. You will also find the advice useful for the personal project.
Let’s start with standardization, what is it?
It’s important that where more than one teacher is responsible for marking work in a subject/language that they apply the assessment criteria in the same way. We call this process standardization.
To ensure that examiners apply a common interpretation of the strand achievement levels* (I refer to these as ‘levels’ in the rest of this post) we ask the principal examiner for each subject to mark some sample student work. They then annotate it and produce a commentary to explain both why they awarded a particular level for each strand and how they came to the overall level for each criterion. The rest of the examining team can study the principal examiner’s work to learn the interpretation—what we call the definitive global standard—and apply it to their own assessment work.
In the next stage of the process, the teachers have moderated the work and the school has submitted their sample to the IB for examiner review. Where the examiner is in agreement with the levels awarded by the school for their sample, no change is made to the school’s levels. They remain as awarded for every student whether or not they were in the sample – this is the best outcome for the students, their teachers, and for us.
What happens when the examiner does not agree with the school’s marking?
Where the school applies their standard consistently, but perhaps are a little harsh or a little generous in comparison to the IB’s global standard, the school’s totals for each student in the cohort can be adjusted to reflect this by applying a moderation factor. This adjustment might increase the criterion level total for each student by one or two. The examiner will supply feedback via IBIS to the school in this instance. The feedback should help the school understand the reasons for the adjustment, and allow them to work toward achieving the global standard with their next cohort.
Alternatively, where the standard has not been consistently applied—for example, where the top range within the sample has been marked harshly and the lower range has been marked generously—the moderation factor will adjust some criterion level totals upwards and some downwards. This will bring the inconsistency across the cohort in line with the same adjustments. The examiner will also provide feedback to the school in this situation via IBIS.
How will the school and the examiner know which strands to apply to which aspect of the work?
We produce partially-completed unit planners—each year on 1 November for the following May session, and each year on 1 May for the next November session—which indicate where the primary focus will be for each strand. Examiners won’t ignore evidence that is demonstrated elsewhere, of course, but the primary focus will be clearly indicated.
What tips can you give students to help the assessment process?
Student work must be legible, audible and/or viewable for the examiner to be able to consider it properly, ensuring that pages are correctly orientated to be read on-screen.
1. Handwritten work should be scanned or copied carefully to make sure the outer areas have not been cropped.
2.The maximum limits for pages or minutes should be observed – work that is beyond the maximum limit will not be considered, and valuable evidence for a strand or strands might therefore not feature in the assessment.
3.Remember, although the teacher would recognize their student in a video recording, the examiner will not know who they are and won’t even be aware of their name while undertaking the assessment – work is anonymous. Teachers will need to ensure that they refer to students in group work in a way that identifies them when writing their comments, so students could help their teachers by ensuring that they are clearly discernible in some way e.g. “girl in the red shirt.”
What strengths did you find in the work submitted by schools in the 2014 trial for ePortfolio assessment?
Examiners were impressed with:
- good teaching that guided students while allowing them to follow a personal interest, as that led to strong motivation;
- units that had been developed to encapsulate clearly the inquiry section of the partially-completed unit planner to ensure conceptual understanding;
- schools who had been creative in developing the units within the mandatory elements;
- the opportunity for students to work in a variety of electronic and paper formats;
- deep research that led to interesting outcomes;
- a good use of technology to record the evidence to be assessed.
Trials lead to greater understanding. Were there other points of advice from examiners for schools to make improvements?
The examiners in the trial were keen to make recommendations toward the very best of practice in all areas for everyone which are listed on the trial report for each subject.
One thing highlighted by examiners in all subjects is for schools to ensure their students have access to the highest appropriate achievement levels. For example, ensuring they use pre-created templates for responding to summative assessment tasks as differentiating tools rather than asking all students to work with them.
How might the strands being assessed in each task and each session within the partially-completed unit planners differ to the “typical” example in the Guide to eAssessment?
The example written for the Guide to eAssessment is exactly that – a typical example. If schools always use the partially-completed unit planner for the correct session as their guideline, they will be correct.
Available on the subject page of the OCC: Coming soon: Gill Chudley is the IB’s Subject Manager for MYP Arts, Design, PHE and Personal Project.
*Each assessment strand has a descriptor at each level 1-2, 3-4, 5-6 and 7-8. Teachers use the descriptors against evidence in the work to decide which level to award the student per strand, and after all strands of a criterion have been attended to, to come to a holistic level for that criterion.
Available on the subject page of the OCC:
Gill Chudley is the IB’s Subject Manager for MYP Arts, Design, PHE and Personal Project.