{"id":9582,"date":"2023-07-06T11:27:24","date_gmt":"2023-07-06T10:27:24","guid":{"rendered":"https:\/\/blogs.sussex.ac.uk\/tel\/?p=9582"},"modified":"2023-07-06T12:16:15","modified_gmt":"2023-07-06T11:16:15","slug":"buddycheck-get-ready-for-a-new-peer-evaluation-tool-to-support-group-work-at-sussex","status":"publish","type":"post","link":"https:\/\/blogs.sussex.ac.uk\/tel\/2023\/07\/06\/buddycheck-get-ready-for-a-new-peer-evaluation-tool-to-support-group-work-at-sussex\/","title":{"rendered":"Buddycheck: Get ready for a new peer evaluation tool to support group work at Sussex"},"content":{"rendered":"\n<p>Coming soon to Canvas \u2013 Buddycheck is new peer evaluation and feedback tool that can help make group work fairer, more transparent and reduce workloads for staff. It\u2019s Learning Tech that dreams are made of!&nbsp;&nbsp;<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-large\"><a href=\"https:\/\/blogs.sussex.ac.uk\/tel\/files\/2023\/07\/buddycheck.jpg\"><img loading=\"lazy\" width=\"451\" height=\"301\" src=\"https:\/\/blogs.sussex.ac.uk\/tel\/files\/2023\/07\/buddycheck.jpg\" alt=\"View of five people working on laptops from above\" class=\"wp-image-9583\" srcset=\"https:\/\/blogs.sussex.ac.uk\/tel\/files\/2023\/07\/buddycheck.jpg 451w, https:\/\/blogs.sussex.ac.uk\/tel\/files\/2023\/07\/buddycheck-300x200.jpg 300w, https:\/\/blogs.sussex.ac.uk\/tel\/files\/2023\/07\/buddycheck-100x67.jpg 100w, https:\/\/blogs.sussex.ac.uk\/tel\/files\/2023\/07\/buddycheck-150x100.jpg 150w, https:\/\/blogs.sussex.ac.uk\/tel\/files\/2023\/07\/buddycheck-200x133.jpg 200w\" sizes=\"(max-width: 451px) 100vw, 451px\" \/><\/a><figcaption>Photo by <a href=\"https:\/\/unsplash.com\/@marvelous?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText\" target=\"_blank\" rel=\"noreferrer noopener\">Marvin Meyer<\/a> on <a href=\"https:\/\/unsplash.com\/photos\/SYTO3xs06fU?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText\" target=\"_blank\" rel=\"noreferrer noopener\">Unsplash<\/a>\u00a0<\/figcaption><\/figure><\/div>\n\n\n\n<p>Here I explain what it can do, what you can do now to find out more about the app, and the guidance and training we will be offering in September.&nbsp;&nbsp;<\/p>\n\n\n\n<h2>Why a peer evaluation tool?&nbsp;<\/h2>\n\n\n\n<p>Learning how to work effectively as part of inclusive groups and teams is a vital skill and one we need to help our students develop. The improved integration of group work at all levels of the curriculum, will contribute towards meeting Learn to Transform strategic priorities, and those emerging from the Curriculum Reimagined project, to put skills development and employability at the heart of the Sussex curriculum.&nbsp; Also, emerging best practice in assessment in response to the emergence of generative AI tools, such as ChatGPT, highlights further the need for an increased focus on curriculum design which embeds and expands the use of such <a href=\"https:\/\/staff.sussex.ac.uk\/teaching\/enhancement\/support\/assessment-design\/authentic\" target=\"_blank\" rel=\"noreferrer noopener\">authentic assessments.<\/a>&nbsp;<\/p>\n\n\n\n<p>However, when talking with academics, student dislike of group work is often cited as a reason not to include group work in the curriculum.&nbsp; This is in part due to concerns about group assessment being unfair or unrepresentative of group member\u2019s contributions. It likely also reflects that fact that group work is just difficult. However, this doesn\u2019t mean it should be avoided. Instead, we should strive to develop curricular that build our students\u2019 skills and confidence over time.&nbsp;&nbsp;<\/p>\n\n\n\n<p>To support group work and mitigate such student concerns, peer evaluation and scoring of individual contributions to group work is already used extensively at Sussex. However, existing approaches have several challenges:&nbsp;&nbsp;<\/p>\n\n\n\n<ul><li>Where students are asked to agree and allocate a share of marks amongst themselves the lack of anonymity can be stressful and put pressure on students, e.g. to allocate equal marks to peers&nbsp;<\/li><li>Staff are not party to the reasons for the decisions made within groups, or by individuals, about peer scores&nbsp;<\/li><li>Approaches that seek to preserve anonymous evaluation and scoring, eg by asking students to email scores for their peers to be collated by staff, are immensely time consuming&nbsp;<\/li><li>Students rarely receive feedback on their contributions to group work or how they might improve in the future&nbsp;<\/li><li>The approaches used for peer evaluation and scoring can be idiosyncratic and inconsistent over a course of study&nbsp;<\/li><\/ul>\n\n\n\n<h2>How can Buddycheck help?&nbsp;<\/h2>\n\n\n\n<p>Buddycheck is a simple to use peer evaluation and scoring tool, which will be integrated into Canvas from August this year. It will help you to:&nbsp;<\/p>\n\n\n\n<ul><li>Collect your students\u2019 scores and feedback on their own and their peers&#8217; contributions to group work&nbsp;&nbsp;<\/li><\/ul>\n\n\n\n<ul><li>Provide your students with automated yet personalised feedback on contributions to group work.&nbsp;&nbsp;<\/li><li>Use peer scores to calculate and apply individual weightings to marks awarded for group submissions.&nbsp;<\/li><\/ul>\n\n\n\n<p>It can be used formatively or linked to summative assessments. You can ask students to respond to pre-set questions on their contributions to a group project, or devise your own.&nbsp; You can also decide on the level of peer feedback and anonymity, and can adjust how peer scores are weighted and used to calculate individual marks.&nbsp; Other features include:&nbsp;&nbsp;<\/p>\n\n\n\n<ul><li>Automated reminder emails\u00a0\u00a0<\/li><li>Full integration into Canvas meaning it is easy to find, and updates easily when changes are made to group memberships\u00a0<\/li><li>The instructor dashboard labels flag high, low performing or over confident students\u00a0\u00a0<\/li><li>You can choose how to use peer feedback, I..e. for the tutors\u2019 eyes only or as peer-to-peer feedback\u00a0<\/li><li>Instructors can view all scores and feedback given and received by peers\u00a0\u00a0<\/li><li>You can &#8216;play&#8217; with applying self-scores and adjustment factors and weightings before finalising\u00a0<\/li><li>You can preview as student\u00a0\u00a0<\/li><li>If applying individual weightings you can overwrite the group marks in Gradebook, or create a new column\u00a0<\/li><\/ul>\n\n\n\n<p>An extract from a Buddycheck \u2018personal report\u2019 for a student user is provided below. Note how the spider plot demonstrates, to a somewhat overconfident student, the difference between how they rated themself (Self), how their teammates rated them (Received), and what the average rating was of the entire team (Team Avg). The personal report then breaks the scores by question with feedforward comments on how students might improve.\u00a0\u00a0<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-large\"><a href=\"https:\/\/blogs.sussex.ac.uk\/tel\/files\/2023\/07\/decorative-image.png\"><img loading=\"lazy\" width=\"539\" height=\"461\" src=\"https:\/\/blogs.sussex.ac.uk\/tel\/files\/2023\/07\/decorative-image.png\" alt=\"An extract from a Buddycheck \u2018personal report\u2019   Presented as a spider diagram\" class=\"wp-image-9584\" srcset=\"https:\/\/blogs.sussex.ac.uk\/tel\/files\/2023\/07\/decorative-image.png 539w, https:\/\/blogs.sussex.ac.uk\/tel\/files\/2023\/07\/decorative-image-300x257.png 300w, https:\/\/blogs.sussex.ac.uk\/tel\/files\/2023\/07\/decorative-image-100x86.png 100w, https:\/\/blogs.sussex.ac.uk\/tel\/files\/2023\/07\/decorative-image-150x128.png 150w, https:\/\/blogs.sussex.ac.uk\/tel\/files\/2023\/07\/decorative-image-200x171.png 200w, https:\/\/blogs.sussex.ac.uk\/tel\/files\/2023\/07\/decorative-image-450x385.png 450w\" sizes=\"(max-width: 539px) 100vw, 539px\" \/><\/a><figcaption>An extract from a Buddycheck \u2018personal report\u2019<\/figcaption><\/figure><\/div>\n\n\n\n<p>We road tested Buddycheck in Semester 1 of 2022\/23 with four Module Convenors from 3 schools, on modules with between 25 and 950 students, covering Levels 4,5,6 and 7.&nbsp; All four had a good journey and told us they found Buddycheck easy to use, that it simplified their peer assessment processes and they are happy to recommend it to colleagues.&nbsp;<\/p>\n\n\n\n<p><em>\u201c&#8230; a very user friendly tool that greatly simplifies my peer assessment process. The best point is that it integrates into Canvas very well, so each student receives a private and personal request to complete the evaluation. In this way, there is no longer \u2018the pressure to give equal peer marks\u2019 that I observed in the past years when I used my old peer assessment method, and I believe it has made the peer assessment fairer<\/em>.\u201d\u00a0  Hsi-Ming Ho, Lecturer in Theoretical Computer Science (Informatics)\u00a0<\/p>\n\n\n\n<h2>What support is available?&nbsp;<\/h2>\n\n\n\n<p>Buddycheck will be available from August along with \u2018how to\u2019 guidance and workshops from Educational Enhancement from September, along with guidance you can use with your students.&nbsp;&nbsp;<\/p>\n\n\n\n<p>We also plan to enhance <a href=\"https:\/\/staff.sussex.ac.uk\/teaching\/enhancement\/support\/modes\/group-work\" target=\"_blank\" rel=\"noreferrer noopener\">our current guidance on planning group work assignments<\/a> to include insights into how to encourage inclusive and productive group work, including using peer scoring and evaluation.&nbsp;&nbsp;<\/p>\n\n\n\n<p>However, <strong>if you would like to know more about Buddycheck now<\/strong>, e.g. to inform your curriculum development over the summer, you have three options:&nbsp;<\/p>\n\n\n\n<ol><li>Take a look at existing guidance:&nbsp;<\/li><\/ol>\n\n\n\n<ul><li>Two short films from Buddycheck&nbsp; showing \u2018<a href=\"https:\/\/vimeo.com\/385077463\" target=\"_blank\" rel=\"noreferrer noopener\">how to complete an evaluation as student<\/a>\u2019 and the <a href=\"https:\/\/vimeo.com\/385077547\" target=\"_blank\" rel=\"noreferrer noopener\">\u2018instructor dashboard and its features\u2019<\/a>.&nbsp;<\/li><li>Dr Andy Bates, from The University of Liverpool, <a href=\"https:\/\/youtu.be\/yOsK5A3Kimo?t=227\" target=\"_blank\" rel=\"noreferrer noopener\">talking about his pilot of Buddycheck<\/a> which shows the main features and student feedback on its use.&nbsp;<\/li><li><a href=\"https:\/\/sussex.box.com\/s\/xaal36cw7ndw9z5zmsqr2l5eov8ms6gw\" target=\"_blank\" rel=\"noreferrer noopener\">View my presentation<\/a> to our first Education Festival, held on May 4<sup>th <\/sup>(and yes, the presentation does reference Star Wars).&nbsp;<\/li><\/ul>\n\n\n\n<ol start=\"2\"><li>Join a 30 minute online briefing session for Sussex staff:&nbsp;<\/li><\/ol>\n\n\n\n<ul><li><strong><a href=\"https:\/\/www.eventbrite.co.uk\/e\/buddycheck-a-new-peer-evaluation-tool-to-support-group-work-at-sussex-tickets-671455871587?aff=oddtdtcreator\">Monday 10<sup>th<\/sup> July 13:00-13:30<\/a><\/strong>\u00a0<\/li><li><strong><a href=\"https:\/\/www.eventbrite.co.uk\/e\/buddycheck-a-new-peer-evaluation-tool-to-support-group-work-at-sussex-tickets-671462130307?aff=oddtdtcreator\">Thursday 13<sup>th<\/sup> July 10:00-10:30<\/a><\/strong>\u00a0<\/li><\/ul>\n\n\n\n<ol start=\"3\"><li>Or, just drop me a line and I will happily talk you through it. <a href=\"mailto:S.hemsley@sussex.ac.uk\" target=\"_blank\" rel=\"noreferrer noopener\">S.hemsley@sussex.ac.uk<\/a>&nbsp;&nbsp;<\/li><\/ol>\n","protected":false},"excerpt":{"rendered":"<p>Coming soon to Canvas \u2013 Buddycheck is new peer evaluation and feedback tool that can help make group work fairer, more transparent and reduce workloads for staff. It\u2019s Learning Tech that dreams are made of!&nbsp;&nbsp; Here I explain what it<span class=\"ellipsis\">&hellip;<\/span><\/p>\n<div class=\"read-more\"><a href=\"https:\/\/blogs.sussex.ac.uk\/tel\/2023\/07\/06\/buddycheck-get-ready-for-a-new-peer-evaluation-tool-to-support-group-work-at-sussex\/\">Read more &#8250;<\/a><\/div>\n<p><!-- end of .read-more --><\/p>\n","protected":false},"author":405,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[157016,98286,4843],"tags":[],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/blogs.sussex.ac.uk\/tel\/wp-json\/wp\/v2\/posts\/9582"}],"collection":[{"href":"https:\/\/blogs.sussex.ac.uk\/tel\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.sussex.ac.uk\/tel\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.sussex.ac.uk\/tel\/wp-json\/wp\/v2\/users\/405"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.sussex.ac.uk\/tel\/wp-json\/wp\/v2\/comments?post=9582"}],"version-history":[{"count":1,"href":"https:\/\/blogs.sussex.ac.uk\/tel\/wp-json\/wp\/v2\/posts\/9582\/revisions"}],"predecessor-version":[{"id":9586,"href":"https:\/\/blogs.sussex.ac.uk\/tel\/wp-json\/wp\/v2\/posts\/9582\/revisions\/9586"}],"wp:attachment":[{"href":"https:\/\/blogs.sussex.ac.uk\/tel\/wp-json\/wp\/v2\/media?parent=9582"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.sussex.ac.uk\/tel\/wp-json\/wp\/v2\/categories?post=9582"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.sussex.ac.uk\/tel\/wp-json\/wp\/v2\/tags?post=9582"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}