STAGE -- A Software Tool for Automatic Grading of Testing Exercises -- Case Study Paper

Pape, S.; Flake, J.; Beckmann, A. and Jürjens, J.

In Proceedings of the 38th International Conference on Software Engineering, ICSE 2016, Austin, TX, USA, May 14-22, 2016 - Companion Volume, pages 491-500, 2016, Acceptance rate: (22+4)/64 = (34.4 + 6.3) %.

Abstract

We report on an approach and associated tool-support for automatically evaluating and grading exercises in Software Engineering courses, by connecting various third-party tools to the online learning platform Moodle. In the case study presented here, the tool was used in several instances of a lecture course to automatically measure the test coverage criteria wrt. the test cases defined by the students for a given Java code. We report on empirical evidence gathered using this case-study (involving more than 250 students), including the results of a survey conducted after the exercises (which yielded positive feedback from the students), as well as a performance evaluation of our tool implementation.

PDFPresentation slidesDOILinkLinkLinkLinkBibtexsoftware engineering

Bibtex

@InProceedings{PFBJ16icse,
  author    = {Sebastian Pape and Julian Flake and Andreas Beckmann and Jan J{\"u}rjens},
  title     = {{STAGE} -- A Software Tool for Automatic Grading of Testing Exercises -- Case Study Paper},
  booktitle = {Proceedings of the 38th International Conference on Software Engineering, {ICSE} 2016, Austin, TX, USA, May 14-22, 2016 - Companion Volume},
  year      = {2016},
  pages     = {491--500},
  doi       = {10.1145/2889160.2889203},
  keywords  = {software engineering,select},
  url       = {https://doi.acm.org/10.1145/2889160.2889203},
}

PDF

Presentation Slides