Improving the Effectiveness and Benefits of Peer Review

Abstract: 

Critical thinking and reflection are difficult to facilitate/ assess in professional education. Peer review is an active technique that provides students opportunities to build these skills and we will introduce unique methods for both preparing students for peer review and assessing their learning through a technology tool supporting double-looped feedback.

Extended Abstract: 

In professional education, testing has traditionally been the prime way to evaluate student learning. Unfortunately, most testing decontextualizes the tested material and reduces the evaluation to a single score rather than a more holistic assessment. Now, the testing era is slowly changing to include more formative and summative assessments which create more active learning environments, giving students opportunities for critical thinking, evaluation and reflection. One example of an active technique is peer review, which is formative and encourages students to become more responsible and reflective thinkers.

TUSDM piloted an online-based peer-review tool in the Research Methodology course that allows for double-looped feedback. Students switch between the roles of active evaluator and receiver, while the faculty plays the role of the facilitator.  Peer review is a way for students to receive feedback as they work on a project, granting them the ability to make adjustments before the final submission. This kind of formative feedback is critical to allowing students to improve their work by reflecting on constructive feedback and supports development of 21st century skills. Peer review also provides mental “scaffolding” that allows student to build on each other’s learning for a more effective learning experience.

Some of the most salient shortcomings of peer review is in properly preparing students for the peer review strategy and the uneven quality of feedback. Student evaluators are often afraid to give negative feedback and may be unsure how much feedback to share, while students receiving feedback may feel that it is not relevant. The pilot program employed preparation strategies and a technology tool that allowed a double-looped review, whereby student evaluators provide feedback and the student assesses the quality of the feedback received, creating benefit for both parties. We will share the pilots promising results, describe areas for improvement, and discuss quality constructive feedback, as well as students’ perception of evaluation process.

Activities:

1. The activity will focus on breaking down constructive feedback to how it makes a person feel and how both the giver and receiver might interpret/react to feedback. (20 min)

Learning Objective:

  • Faculty will gain an understanding of four types of verbal feedback: positive feedback, negative feedback, absence of feedback and directed positive feedback.

2. The activity will introduce faculty to peer review of writing and using a peer review technology tool. (40 min)

Learning Objectives:

  • Faculty will learn the concept of collaborative peer review
  • Faculty will understand appropriate practices of peer review
  • Faculty will practice conducting peer review and double-looped feedback
  • Faculty will be introduced to an interactive peer-assessment technology-based tool

 

 

 

 

Conference Track: 
Pedagogical Innovation
Session Type: 
Workshop
Intended Audience: 
Administrators
Faculty
Instructional Support
Technologists