Cost-Benefit Analysis of Using Dependency Knowledge at Integration TestingShow others and affiliations
2016 (English)In: Product-Focused Software Process Improvement / [ed] Pekka Abrahamsson, Andreas Jedlitschka, Anh Nguyen Duc, Michael Felderer, Sousuke Amasaki, Tommi Mikkonen, 2016, 7, Vol. 10027, p. 268-284Conference paper, Published paper (Refereed)
Abstract [en]
In software system development, testing can take considerable time and resources, and there are numerous examples in the literature of how to improve the testing process. In particular, methods for selection and prioritization of test cases can play a critical role in efficient use of testing resources. This paper focuses on the problem of selection and ordering of integration-level test cases. Integration testing is performed to evaluate the correctness of several units in composition. Further, for reasons of both effectiveness and safety, many embedded systems are still tested manually. To this end, we propose a process, supported by an online decision support system, for ordering and selection of test cases based on the test result of previously executed test cases. To analyze the economic efficiency of such a system, a customized return on investment (ROI) metric tailored for system integration testing is introduced. Using data collected from the development process of a large-scale safety-critical embedded system, we perform Monte Carlo simulations to evaluate the expected ROI of three variants of the proposed new process. The results show that our proposed decision support system is beneficial in terms of ROI at system integration testing and thus qualifies as an important element in improving the integration testing process.
Place, publisher, year, edition, pages
2016, 7. Vol. 10027, p. 268-284
Series
Lecture Notes in Computer Science (LNCS), ISSN 0302-9743 ; 10027
Keywords [en]
Decision support system, Integration testing, Optimization, Prioritization, Process improvement, Return on investment, Software testing, Test case selection
National Category
Computer and Information Sciences
Identifiers
URN: urn:nbn:se:ri:diva-21422DOI: 10.1007/978-3-319-49094-6_17Scopus ID: 2-s2.0-84998880972ISBN: 978-3-319-49093-9 (print)ISBN: 978-3-319-49094-6 (electronic)OAI: oai:DiVA.org:ri-21422DiVA, id: diva2:1041458
Conference
17th International Conference on Product-Focused Software Process Improvement (PROFES 2016), November 22 – 24, 2016, Trondheim, Norway
Projects
IMPRINT2016-10-312016-10-312023-10-04Bibliographically approved