Peer reviews are used in a wide variety of disciplines. Nevertheless research investigating the impact of technology on peer-reviewing mainly derives from the field of writing classes. This paper presents an experimental study exploring the quality and kind of feedback given in a peer-reviewing task in an IT Project Management course. The study analyzes differences between the face-to-face and the online setting. The results show that students commented on fewer topics in the online version but described them in more detail than in the paper version. The online version was experienced as time-efficient and easy to fill out, while students found it significantly easier to express feedback in the paper version.