Assessment literacy tool

The assessment literacy tool can be used to expand student understanding of assessment criteria.

Students are presented with a sample of student work, and asked to provide a mark and feedback for each criterion set by the subject coordinator. Students are subsequently presented with expert (subject coordinator) marks and feedback for comparison.

The assessment literacy tool can be used to help familiarise students with assessment criteria for their assessment tasks or the criteria to be used in peer review activities. The image below shows one example of a use case for the assessment literacy tool.

  1. Students are presented with criteria provided by the teacher that they will use to assess an essay.
  2. The student provides a grade for the criterion based on the provided criteria description.
  3. The student justifies the grade awarded.
  4. After the student submits their grade and justification, they are shown the teacher awarded grade and justification.
Example use case for the assessment literacy tool
Example use case for the assessment literacy tool

Request the installation of the assessment literacy tool into your subject

Whether you are using the tool for the very first time in your subject, or if you are using it again in a subsequent semester, you will need to request the installation of the tool into your LMS subject.

Please submit a Learning Environments support request:

  • Request details: Learning Management System (LMS)
  • Enquiry type: General
  • Subject code: The full subject code of your LMS subject
  • Further details: State that you require the installation of the Assessment Literacy tool in your subject
  • Click Submit when done.

The support team will let you know when the tool has been installed in your subject.

Initialise the assessment literacy tool dashboard

Multiple tasks can be built from the same assessment literacy tool dashboard. To start building tasks, the tool needs to be initialised. This can be done via LMS Assignments or Modules.  If you wish to use the assessment literacy tool for a hurdle requirement or assessment purposes, initialise it as an Assignment. Otherwise, you can initialise it via Modules for self-assessment purposes.  If the Display grade as assignment setting is set to Complete/incomplete, a green tick in the grade book will indicate which students have completed all the tasks in that assignment, and allows staff to bulk email students who have not yet completed it.

Assignments

To initialise the assessment literacy tool via assignments:

  1. Navigate to Assignments.
  2. Click +Assignment.
  3. Using the Submission Type dropdown menu, select External Tool.
  4. Click Find.
  5. Select Assessment Literacy Tool V2 and click Select.
  6. Click Save or Save & Publish.

You will be taken to the assessment literacy tool dashboard, continue to create the assessment literacy task below for instructions on how to create a new task.

You can now add this assignment to your modules if you require your students to access it from there.

Modules

To initialise the assessment literacy tool via modules:

  1. Navigate to Modules.
  2. Click the + button on the module where you want to add the task.
  3. Using the Add dropdown menu, select External Tool.
  4. Select Assessment Literacy Tool V2 and click Add Item.
  5. Click on the Assessment Literacy Tool V2 link in the module.

You will be taken to the assessment literacy tool dashboard, continue to create the assessment literacy task below for instructions on how to create a new task.

Create the assessment literacy task

Once you have chosen where to initialise  your task (assignments or modules) and initialised the tool, to add the document, criteria and feedback to the task:

  1. Click +Add assessment task on the assessment literacy task dashboard.
  2. In the Enter task title text box, type the name of the task.
  3. Type the instructions for the task into the Enter task description text box.
  4. Click Browse and follow the prompts to locate and select the file containing the sample of student work. The file can be a Microsoft Word, Microsoft Excel or PDF document.
  5. Click Create task.
  6. Click OK.
Add assessment task details and instructions
Add assessment task details and instructions

Create the marking guide

The next set of menu options allows you to set or upload a marking guide.

To create a new marking guide, use the Editor tab and:

  1. Select the grading type you wish to use:
    1. Weighted marking guide: Specify the weight each criterion contributes to the final mark.
    2. Points based marking guide: Provide point values for each criterion. Selecting Points will give you the option to display criterion grades as percentages or points.
  2. Provide overall feedback. This is your overall feedback on the sample of student work. This feedback will be shown to students once they have finished reviewing the sample.
  3. Set the default maximum points per criterion.
  4. Click +Add Section to initialise the marking guide editor and follow the prompts to set up the marking scheme. Sections can be used to group criteria. For example, you might have a “writing style” section that comprises flow, grammar and punctuation criteria.
  5. Set:
    1. Section no. This can be letters or numbers and contain up to five characters.
    2. Section title. This is a description of the section.
  6. Click Add section followed by OK.
  1. Repeat steps 4 and 5 for as many sections as needed.
  2. For each Section, set the criteria.
    1. Click + Add Criterion.
    2. Give the criterion a title.
    3. Provide a description of the criterion. This is seen by the student and helps to provide an accurate rating for the criterion. e.g. this could be achievement level descriptors from a rubric.
    4. In the Mark box, enter the teacher awarded mark. Students will only see this value after they have submitted their own mark and feedback.
    5. Set the maximum possible points for the criterion.
    6. If you chose to use a weighted marking guide, insert the fraction that the criterion contributes to the final grade.
    7. Provide teacher feedback on the student sample. Students will only see this feedback after they have submitted their own mark and feedback.
    8. Click Add criterion.
    9. Click OK.
    10. Repeat steps a to g as many times as needed (i.e. once for each criterion per Section).
Add the criteria title and description, grading information and feedback
Add the criteria title and description, grading information and feedback

The set-up of the activity is now complete. The tool will calculate the final mark based on your marks for each criterion. If you use a weighted marking guide, ensure that each weight adds to 1.

View statistics and student responses

Records of student responses are available. From the Assessment Literacy Tool dashboard, click the Views dropdown menu.

  • Select Preview marking guide to see the student view of your task. Click through the task and provide answers where prompted to experience the task as a student.
  • Select Student progress to see a summary of which students have started, not started or completed the task.
  • Select Statistics to see a comparison between student and teacher scores for each criterion. A plot of marks is also shown for each criterion, with the teacher mark in green, the average student mark in purple and student responses in grey.

Copy an assessment literacy tool task

Assessment literacy tool tasks cannot be directly copied within the LMS. To copy a marking scheme from one task to another:

  1. Navigate to the assessment literacy tool dashboard of the task you want to copy.
  2. Click Actions followed by Edit.
  3. If students have completed this activity, a warning will pop up stating that student attempts exist. Click OK.
  4. Click the Edit (pencil) icon next to Marking guide.
  5. Click Export marking guide. This will download an Excel spreadsheet containing expert marks and feedback of the original task.
  6. Create a new assessment literacy tool task in the desired location by following the ‘Initialise the assessment literacy tool dashboard’ instructions above.
  7. Input the task details by following create the assessment literacy task instructions above.
  8. Click the Upload tab.
  9. Click Browse and select the Excel document downloaded in step 5.
  10. Click Upload followed by OK. You can now edit the marking guide copied from the previous task or use it as is.

Resources

This guide was last updated 20 Oct 2022.
Please report any errors or omissions in this guide by submitting an LMS support request.

Print this guide