Buddycheck is a simple to set up and use peer evaluation tool which allows students to evaluate each team member’s performance in a group activity, as well as perform a self-assessment. The Instructor can create any number of performance criteria or select from a number of samples. Students are awarded an average score (excluding or including their self-score). Students will receive feedback on the group dynamic and their own performance against the group average. Buddycheck utilizes the research-based CATME framework for peer evaluation in groups.
Setting up Buddycheck
You can now create your first evaluation.
- Click Create Evaluation.
- Enter an Evaluation title or select a previously made evaluation as template.
- Enter an evaluation Start and End date.
- At the Group composition; selected if you want to Reuse groups or Create new groups.
Creating new groups: In order to add students/student groups to the evaluation you need to upload a .CSV file (Comma Separated Values File). Importing students and groups only works with a .CSV in the correct format. Please use the template to make sure all columns are exactly like the template. Please note that you have to use the TU Delft email of the students (@student.tudelft.nl) in order for students to have access to the peer review.
- Add your Peer questions (about the other group members) and Team questions (about the Team as a whole).
A set of Main questions is by default selected. These questions can be viewed, edited or deleted from your evaluation. You can change the order of questions using drag and drop. Move your mouse over the =-icon for the drag and drop symbol to appear.
- To create a new questions click Create question. Fill in the required question information and click Create question.
- Click on Select from library to import custom questions from an old course you were involved in as Course manager.
- You can choose to enable Open questions to ask students about the team or the course in general. This can also be used if you want students to send you a private message about the group. The reactions are only visible to the instructor.
- If you want students to send peers a message, enable Peer messages (you can choose to make the reactions anonymous to the receiver or not).
- Before you save you can click Open preview of evaluation.
- Click Create evaluation when done.
- The page will reload and you will see the new evaluation listed on the Peer evaluations page. You can create another by clicking the +Create evaluation button. All the evaluations wil be listed in the same Buddycheck link, so you don’t have to create multiple links (as mentioned in step 1).
If you need to add or remove a student to/from a group you should use the same .CSV file as when you created the groups in the previous step. Simply update the file first, by adding or removing the student(s) to/from the relevant groups.
This functionality cannot be used to change names!
- To change the group members for the evaluation, first update the CSV file to have the new combination of students in the groups.
Do NOT delete the groups from the file that do not need any changes
- Save the file.
- Go to the Buddycheck evaluation in Brightspace
- Click More and select Update using CSV Sync with course.
- Click on Upload .CSV file.
Important: this upload will replace the old groups. So when you ad a new group member, add this person to the .CSV file you used before.
- Double-check the changes that will be made in all tabs (new/changes/removed) and click on Start Sync.
- When students click on Buddycheck they will see the evaluations created in your course. To start, they will click Begin evaluation.
- The student selects a rating for each criterion. The student clicks Next to select ratings for the following criteria until they have the option to Submit evaluation.
- You will be able to monitor which individuals and groups have completed the task and what scores individuals have given and received.
- Although you have set a due date, students will be able to complete the evaluation until you Lock the evaluation. Students will see that their submission is overdue.
If students submit an evaluation after the due date, Buddycheck will indicate by how many days the evaluation is overdue.
- You can allow a grace period and Send a reminder to students who have not completed their evaluation, or simply click Lock evaluation.
- If a student needs a reminder to finish the evaluation or needs to make the evaluation again you can select the student and Send e-mail or Reopen. Clear removes the results added by the student, Remove removes the student from the list.
- To release feedback to students, select More and click Release results.
- Students will now be able to review their feedback within Buddycheck and receive an e-mail with a summary. Select More and click Export results to download a complete summary of the evaluation. You will be prompted as to whether you export results excluding or including their self-score.
- To view the students feedback or the group results, Select the student and click Personal Report or Group report.
- Students initially see a graphical representation of how they performed across all criteria.
- Students then see more detail on each criterion, comparing their self-score, received score and team average.
- You can choose to include or exclude the students’ Self-scores in the average score calculation in the Instructor view.
- Where certain team dynamics occurred, they will be labelled. See for example the Conflict label below.
- The label key can be found below.
- If you have enabled Peer messages to Instructor and received one, you will see this text/chat icon next to the student’s name .
- If you enabled Anonymous for receiving student when setting up the evaluation, the feedback will be visible to the student but without name of the sender.
Create your first evaluation
If you use Buddycheck from inside your Learning Environment, this article will explain how to get started. Make sure that you have added Buddycheck to your Course.
Only course instructors are allowed to create an evaluation. Creating an evaluation is easy. Here is a step-by-step explanation of creating an evaluation.
- Add students and groups to your course.
- Go to Buddycheck in your course. If Buddycheck is not yet enabled in your course, contact Brightspace Support to add Buddycheck to your course.
- Click ‘Create evaluation’.
- Fill in the Create Evaluation form. Start and End date should not be too far apart because students will forget about the deadline.
- Once you have created your first evaluation, click the Results button of this evaluation to see if all is added correctly.
During the evaluation
When the start date has passed, all students will receive an email from Buddycheck requesting them to evaluate their group. Each email has a unique link that enables the student to get started without having to go to Brightspace first. However, it is also possible for students to open their evaluation from within the Brightspace course and clicking the Buddycheck tab. As an instructor, you will see the progress and in the Results page of the evaluation you can monitor whether your students are filling in the evaluation correctly. This is important, because it can happen that some students do not take the evaluation seriously. In this case you can ask students to redo their evaluation.
Actions during the evaluation
In the results tab, you can select one or multiple students in the results table using the checkboxes on the left. By doing so, action buttons will appear on the top of the results page:
- Email: Use this button to email students.
- Clear: Use this button to clear/remove the results entered by the student
- Reopen: Use this button if you want students to fill out the survey again.
- Remove: Use this button if students have left the course in the meantime.
After the evaluation
When the evaluation deadline has passed, the evaluation is formally closed. However, students can still submit their survey. They will be marked red to indicate they were late. As soon as you are happy with the results, you can release the results to the students. After releasing, all students will receive an email with a link to look at their individual result. Students who haven’t submitted the survey will also get the results. Students will not see individual rating from group members. Just total average of all group members.
In the results tab, you might see Notes appear such as ‘High’ or ‘Low’ or ‘Under’. On the top of the page, you can find for information on each label. As an instructor, you can use the results to give credits to high performers and talk to low performers or teams with problems. You can use the Adjustment factors to update the course grades too. However, be careful not to directly copy all Adjustment factors, since it often requires human sense to correctly value the trustworthiness of the results and the assessments. The Adjustment Factors are visible on the right side of the Results tab. You have two types: Without Self and With Self. Without Self is the factor without his or her own (self) ratings. With Self is with the self ratings included. For example: the Adjustment factor is 1.05 and the student has a 7 (out of 10) as a course grade. You multiple 7 with 1.05, which means the final grade would be 7,35.
Yes, students can still submit after the deadline. Their submissions will be marked red to indicate they were late.
There are two options to make sure students cannot submit anymore: Lock evaluation or release results.
Go to results page and click ‘More ‘> ‘Lock evaluation’. Students cannot submit anymore, even if you reminded them or reopened the evaluation for some students.
Go to results page and click ‘More ‘> ‘Release results’. Once the results are released to the students, it not only becomes locked but you also send an email to all students with their results. You can see a preview of each student result page. Go to results page and expand a student row in the table and click ‘Preview result page’.
Go to the results page of the evaluation. Click ‘More’ > ‘Export results’ to download all results as in comma-separated format!
The CSV file will show the average scores as well as the raw survey data.
Go to the evaluation you created and click ‘More’ > ‘Sync with CVS’. Upload your updated CSV file with all students and groups included. Only in scenarios where a student has to do the evaluation again, an email will be sent.
The short answer: Yes, you can!
You can create questions in the Create Evaluation page or in the Edit Evaluation page. Click ‘Create question‘ in the middle of the form and a dialog opens where you can create new questions, edit those questions and even import custom questions from an old course you were involved in.
As an instructor, just go to Buddycheck in your course. When arriving, you see a page with one or more evaluations in a table. Click on the evaluation title and then you see a button ‘More‘. Click the button and click ‘Send a reminder’. This will send an email with link to the survey to each student who hasn’t completed the survey yet.
If a student does not complete the evaluation, there is less peer evaluation data in the group of this student. This means that the results will be less reliable especially if it is a small group or if there are more students in the same group that have not completed the evaluation.
That being said, an average and an adjustment factor of a student is simply calculated using completed evaluation data from the peers in the group. So you can just use all results even if not 100% of students have completed the evaluation. Students that have not submitted do get an average and an adjustment factor because peers probably did complete an evaluation with this person included.
Yes this is possible. The functionality is called ‘Peer messages’.
Peer messages allows you to ask your students to send optional feedback to each peer directly. Only the student that received the feedback will see the message if you release the results. You can chose it to be anonymous to the receiving student. Instructors can also see these messages.
Yes you can! Assuming you haven’t locked or released the results yet. If you locked the results, you have to unlock the evaluation first.
You go to your evaluation results where you see all students in a table. On the left of each student is a checkbox. Select each student evaluation you want to reopen and on the top of the page buttons appear, one of them being ‘Reopen’. Click on it and optionally tune the email text and send it.
Students will directly receive the email. With the link in it, they can double-check or adjust their evaluation and submit it again.
It can be that cookies are blocking your browser activity. Start by clearing all cookie settings and then try again. You will find more information about cookies, here: https://www.tudelft.nl/en/cookie-policy/. Also, using a different browser might help!
If it still doesn’t work, don’t hesitate to contact us at Brightspace Support.