6 July 2020 - Paul Anderson Speaker Paul Anderson Title Supporting Criteria-Based Marking Watch a recording of the talk Abstract A criteria-based marking scheme (such as the one used for Informatics projects) awards grades based on the demonstration (or not) of explicit attributes, rather than the sum of marks for various components. This provides a direct relationship to the learning outcomes which has been shown to give a more reliable assessment, and clearer feedback to the students. Producing a numerical mark from such a scheme is less straightforward. A coarse-grained result can be derived from a few simple rules, but an authentic assessment requires more complex rules, and the University requires finer grained results (the Common Marking Scheme). PMark is a tool which allows finer-grained decision rules to be stated explicitly and evaluated automatically. It also provides specific feedback, and an interpolation algorithm to produce marks on a finer grained scale. This has been used sucessfully on a big programming course (INF1B) and is currently being evaluated in other subject areas. I will talk a little about the background of criteria-based marking, describe the PMark tool, and briefly show some examples. I would also like to discuss the interpolation algorithm and solicit feedback on how this might be improved. Slides Document AIAI seminar 6 July 2020 (947.03 KB / PDF) Jul 06 2020 14.00 - 15.00 6 July 2020 - Paul Anderson Supporting Criteria-Based Marking Online
6 July 2020 - Paul Anderson Speaker Paul Anderson Title Supporting Criteria-Based Marking Watch a recording of the talk Abstract A criteria-based marking scheme (such as the one used for Informatics projects) awards grades based on the demonstration (or not) of explicit attributes, rather than the sum of marks for various components. This provides a direct relationship to the learning outcomes which has been shown to give a more reliable assessment, and clearer feedback to the students. Producing a numerical mark from such a scheme is less straightforward. A coarse-grained result can be derived from a few simple rules, but an authentic assessment requires more complex rules, and the University requires finer grained results (the Common Marking Scheme). PMark is a tool which allows finer-grained decision rules to be stated explicitly and evaluated automatically. It also provides specific feedback, and an interpolation algorithm to produce marks on a finer grained scale. This has been used sucessfully on a big programming course (INF1B) and is currently being evaluated in other subject areas. I will talk a little about the background of criteria-based marking, describe the PMark tool, and briefly show some examples. I would also like to discuss the interpolation algorithm and solicit feedback on how this might be improved. Slides Document AIAI seminar 6 July 2020 (947.03 KB / PDF) Jul 06 2020 14.00 - 15.00 6 July 2020 - Paul Anderson Supporting Criteria-Based Marking Online
