# Rubric Calibration & Moderation (Workshop) > A ready-to-run PD workshop on calibrating scoring so a team grades consistently. Run-of-show, handout, follow-up. *A ready-to-run professional learning workshop from K12 Academics. Source page: https://pd.k12academics.com/rubric-calibration-moderation-workshop.html* A great rubric means nothing if two teachers score the same work differently. Calibration, scoring sample work together and resolving differences until you agree, makes grades consistent and fair across a team, and sharpens everyone's sense of quality. A rubric only produces fair, consistent grades if teachers score the same way; calibration, scoring samples together and resolving differences, builds that consistency and sharpens everyone's judgment. ## Why it works Even with a shared rubric, teachers often score the same work differently, which makes grades unfair and common assessments uninterpretable. Calibration (or moderation), scoring sample student work together, comparing scores, and discussing until the team agrees on how the rubric applies, builds inter-rater consistency and, just as valuably, a shared, sharpened understanding of what quality looks like. Research on assessment reliability supports it as essential for fair, comparable grading. **The research:** Research on scoring reliability and moderation. ## The run-of-show ### Staff meeting (15 minutes) A fast introduction to plant one routine. **Goal:** everyone leaves with one thing to try. | Start | Length | Segment | What happens | Facilitator note | | --- | --- | --- | --- | --- | | 0:00 | 3 min | Hook | Would you and a colleague score the same essay the same? Name it. | You are surfacing inconsistency. | | 0:03 | 5 min | Mini-teach | Shared rubric needs shared scoring. One slide. | | | 0:08 | 5 min | Plan one | Score a short sample independently. Turn and talk. | | | 0:13 | 2 min | Commit | Each team commits to calibrating. | | ### PLC / team meeting (45 minutes) The standard version. **Goal:** every teacher leaves with something designed for a real upcoming lesson. | Start | Length | Segment | What happens | Facilitator note | | --- | --- | --- | --- | --- | | 0:00 | 5 min | Hook | Same rubric, different scores. What does that do to grades? | Let them see the unfairness. | | 0:05 | 8 min | Mini-teach | The calibration process and anchor papers. | | | 0:13 | 12 min | See it in action | Score samples, compare, and discuss differences. | Resolve them. | | 0:25 | 12 min | Design | Agree scoring and set anchor papers. | Protect the full time. | | 0:37 | 5 min | Share | Re-score a sample; check agreement improved. | Keep it collaborative. | | 0:42 | 3 min | Commit + follow-up | Lock it in and set the next calibration. | | ### Half-day institute (~3 hours) A deep session for a PD day. **Goal:** built, practiced, and a rollout planned. | Start | Length | Segment | What happens | Facilitator note | | --- | --- | --- | --- | --- | | Block 1 | 45 min | Experience + why | Inconsistent scoring, then the research. | | | | 15 min | Break | | | | Block 2 | 60 min | Calibrate | Teams score, compare, and agree on anchors. | Group by course. | | Block 3 | 45 min | Practice | Re-score to confirm consistency. | Agreement is the goal. | | Close | 15 min | Plan the rollout | Set a calibration cadence; set the check-in. | | ## The core activity: calibrate scoring as a team Teams leave scoring consistently, with anchor papers for each level. - Take a rubric and sample student work. - Have everyone score the same samples independently. - Compare scores and discuss the differences. - Agree on how the rubric applies and anchor with example papers at each level. ## Facilitator notes - Score samples independently, then compare. - Discuss and resolve differences, anchoring with exemplars. - Calibrate periodically. ## Adapt it - **Elementary and secondary:** the same process. - **Teams:** bring common work. - **All settings:** independent scoring, discussion, agreement. ## Participant handout One page for every teacher. Print it, or save it as a PDF. ### Calibration: score the same **Fair, comparable grades:** score samples independently, resolve differences, and anchor each level with exemplars. - The rubric and sample work: __________ - The independent scores and where they differed: __________ - How we resolved the differences: __________ - The anchor papers for each level: __________ - How often we will calibrate: __________ ## Make it stick - Calibrate scoring. - Anchor with exemplars. - Bring calibrated scoring to common assessments. ## Common questions **We all have the same rubric, isn't that enough?** No. Teachers interpret rubrics differently, so the same work gets different scores. Calibration, scoring samples together and agreeing, is what makes grades consistent and fair. **What does calibration look like?** The team independently scores the same sample work, compares scores, discusses differences, and agrees on how the rubric applies, often anchoring with example papers at each level. **Isn't this just extra work?** It makes grades fair and common assessments meaningful, and it sharpens everyone's sense of quality, which improves teaching and feedback. It is high-leverage, not busywork. ## Go deeper - [The Learning Scientists](https://www.learningscientists.org) ## Build it into a bigger day - [Rubric Design](https://pd.k12academics.com/rubric-design-workshop.html) - [Common Formative Assessments](https://pd.k12academics.com/common-formative-assessments-workshop.html) - [Analyzing Student Work](https://pd.k12academics.com/analyzing-student-work-workshop.html) --- Full workshop page: https://pd.k12academics.com/rubric-calibration-moderation-workshop.html All workshops: https://pd.k12academics.com/