Overview

There are several important goals of the RTE. The first goal is to gather as a team to discuss the rating rubric; by discussing the rubric together, we can (a) improve how consistently we rate within ourselves and (b) minimize some rating discrepancies across categories. Remember: We all differ in how we rate, and that’s normal! The second goal is to provide an opportunity for the team to voice questions or concerns about the rating process.

Some Fun Tips

- Don't worry about how your ratings compare with others'.
- Judges grant 65% more bail after lunch; think about when you rate.
- Set aside a time to rate each day (and let Dorcina know when that is).
- Remember: We rate the performance and not the person! 
- IELTS doesn't matter; it's if the rubric works for us.

Objectives

  1. Discuss our rating process and share “tips and tricks”
  2. Rate two anchored essays with the IELTS-Writing rubric
  3. Provide a forum for asking questions and addressing concerns
  4. Obtain feedback about the RTE workshop

Plan for the Day

Structure

  • Settle in 5 min
  • Warm-Up: Share rating process 20 min
  • Pre-task: Rate two essays 40 min
  • Main task: Share ratings, ask questions, discuss 40 min
  • Wrap-Up: Review take-aways and share with all 8 min

Warm-Up

  • Ask raters if they have any tips for rating
  • What does their rating process look like?
  • For example, do you always rate in the afternoon?
  • How can we rate more consistently with ourselves?

Pre-Task Input

  • Share the essay rubric and essays with the team
  • Explain that the two essays were rated high and low
  • Ask raters to rate both essays in one go
  • Explain there are two breakout rooms: Room 1 and Room 2
  • Room 1 is for rating, and Room 2 means ‘I’m done’
  • Once everyone has moved to Room 2, we will move on
  • Ask raters to jot down other questions they might have

Main Task

  • Exit back to main room and share Miro link with everyone
  • Give everyone a chance to open the board and get oriented
  • Point out tool bar, rubric, instructions, and place for Qs
  • Explain that this is space to ask questions about anything
  • We can also get a sense of how we rate, comparatively
  • Go through category by category; give each person chance to talk

Post-Task Reporting

  • Summarize the main take-aways from the meeting
  • Explain that you will share the Miro board with everyone
  • We will write up take-aways and share with everyone
  • I will also send out a feedback questionnaire via Qualtrics
  • Responses are anonymous, so no IP addresses or lat long info