Lab - Project peer review

Lab
Important

The project peer review is designed to be completed at the end of your lab section on Monday, November 27th. No submission on Gradescope needed, just post issues on GitHub by this time. All issues will be due by 11:59 on Monday, November 27th.

Note

Each group will create one issue per review and provide feedback within this issue. If you are not in lab, it is your responsibility to create a separate issue and provide additional feedback.

Learning goals

In this lab, you will…

  • Review others’ project drafts as a team and provide feedback
  • Post issues on GitHub using an issue template
  • Learn from others’ projects and improve your own project based on their strengths and weaknesses

Project peer review

Each team will review two other teams’ project. As a team you should spend ~30 minutes on each team’s project.

  • Find the names of the teams whose projects you’re reviewing below. You should already have access to this team’s repo.

  • Each team member should go to the repo of the team you’re reviewing.

  • Then,

    • 1-2 team members clone the team’s project and renders it to check for reproducibility.

    • 1-2 team members open the team’s project in their browser and starts reading through the project draft.

    • 1 team member opens an issue on the team’s repo using the peer review template.

    • All team members discuss the project based on the prompts on the issue template and one team member records the feedback and submits the issue.

  • To open an issue in the repo you’re reviewing, click on New issue, and click on Get started for the Peer review issue. Fill out this issue, answering the following questions:

    • Peer review by: [NAME OF TEAM DOING THE REVIEW]

    • Names of team members that participated in this review: [FULL NAMES OF TEAM MEMBERS DOING THE REVIEW]

    • Describe the goal of the project.

    • Describe the data used or collected, if any. If the proposal does not include the use of a specific dataset, comment on whether the project would be strengthened by the inclusion of a dataset.

    • Describe the approaches, tools, and methods that will be used.

    • Provide constructive feedback on how the team might be able to improve their project. Make sure your feedback includes at least one comment on the statistical reasoning aspect of the project, but do feel free to comment on aspects beyond the reasoning as well.

    • What aspect of this project are you most interested in and would like to see highlighted in the presentation.

    • Were you able to reproduce the project by clicking on Render Website once you cloned it? Were there any issues with reproducibility?

    • Provide constructive feedback on any issues with file and/or code organization.

    • What have you learned from this team’s project that you are considering implementing in your own project?

    • (Optional) Any further comments or feedback?

Review pairings

You have been given access to two teams in your github, those are the two teams you should be evaluating.

Note

The feedback issue will come from one team member on GitHub since you can’t collectively edit an issue. However it must represent the opinions of the entire team that is present in lab. It is not a single team member’s responsibility to provide feedback, they’re just the record keeper for the team.

Note

Attendance will be collected to clarify who is participating with the issues created during lab, and who still must contribute by creating their own issue outside of lab.

Grading

Peer reviews will be graded on an individual basis on the extent to which it comprehensively and constructively addresses the components of the reviewee’s team’s report. If you are in lab, you will be graded based on issues created during lab time. If you are not in lab, you have a responsibility to create a separate issue for your assigned teams.

All issues will be due on Monday, November 27th at 11:59 PM and be graded on the following:

  • 0 points: No peer review

  • 1 point: Only one peer review issue open, feedback provided is not constructive or actionable

  • 2 points: Both peer review issues open, feedback provided is not constructive or actionable

  • 3 points: Both peer review issues open, feedback provided is not sufficiently thorough

  • 4 points: Both peer review issues open, one of the reviews is not sufficiently thorough

  • 5 points: Both peer review issues open, both reviews are constructive, actionable, and sufficiently thorough