MATTER: A Tool for Generating End-to-End IoT TestScripts
In the last few years, Internet of Things (IoT) systems have drastically increased their relevance in a multitude of fundamental sectors. For this reason, assuring their quality is of paramount importance, especially in safety-critical contexts. Unfortunately, few quality assurance proposals for assuring the quality of these complex systems are present in the literature.
In this paper, we extended and improved our previous approach for semi-automated model-based generation of executable test scripts. Our proposal is oriented to system-level acceptance testing of IoT systems. We have implemented a prototype tool taking in input a UML model of the system under test and some additional artefacts, and producing in output a test suite that checks if the behaviour of the system is compliant with such a model.
We empirically evaluated our tool employing two existing IoT systems: a mobile health IoT system for diabetic patients and a smart park management system part of a smart city project. Both systems involve sensors or actuators, smartphones, and a remote cloud server.
Results show that the test suites generated with our tool have been able to kill 91\% of the overall 260 considered mutants (i.e., artificial bugged versions of the two considered systems). Moreover, the optimisation introduced in this novel version of our proposal, based on a minimisation post-processing step, allowed to drastically reduce the time required for executing the entire test suites (about -20/25\%) with no adverse effect on the bug-detection capability.
All the material concerning MATTER can be found HERE
