A UCSD view on replication and reproducibility for CPS & IoT

Reproducibility and replicability (R&R) are important for research. Many communities are beginning efforts to reward, incentivize, and highlight projects as a motive to adopt R&R practices. This is clearly a good direction - we should all aim to make our research sound, replicable, and reproducible. Yet, this involves a lot of effort to document, debug, and generally make the systems that we build more usable. Interfacing with the Physical world and building custom Things exacerbates these challenges. Therein lies the dilemma: how does the CPS/IoT community reward and incentivize R&R efforts? This paper looks into the question of R&R in CPS/IoT. We survey efforts in other fields spanning computing to healthcare and highlight similarities and differences to CPS/IoT. We then discuss several exemplar CPS/IoT projects related to UCSD's research and highlight the R&R efforts in these projects, the potential ways that they could be improved, and best practices. We finish with recommendations and insights for R&R tailored to the CPS/IoT community.