Change search
Link to record
Permanent link

Direct link
BETA
Publications (8 of 8) Show all publications
Tahvili, S., Bohlin, M., Saadatmand, M., Larsson, S., Afzal, W. & Sundmark, D. (2016). Cost-Benefit Analysis of Using Dependency Knowledge at Integration Testing (7ed.). In: Pekka Abrahamsson, Andreas Jedlitschka, Anh Nguyen Duc, Michael Felderer, Sousuke Amasaki, Tommi Mikkonen (Ed.), Product-Focused Software Process Improvement: . Paper presented at 17th International Conference on Product-Focused Software Process Improvement (PROFES 2016), November 22 – 24, 2016, Trondheim, Norway (pp. 268-284). , 10027
Open this publication in new window or tab >>Cost-Benefit Analysis of Using Dependency Knowledge at Integration Testing
Show others...
2016 (English)In: Product-Focused Software Process Improvement / [ed] Pekka Abrahamsson, Andreas Jedlitschka, Anh Nguyen Duc, Michael Felderer, Sousuke Amasaki, Tommi Mikkonen, 2016, 7, Vol. 10027, p. 268-284Conference paper, Published paper (Refereed)
Abstract [en]

In software system development, testing can take considerable time and resources, and there are numerous examples in the literature of how to improve the testing process. In particular, methods for selection and prioritization of test cases can play a critical role in efficient use of testing resources. This paper focuses on the problem of selection and ordering of integration-level test cases. Integration testing is performed to evaluate the correctness of several units in composition. Further, for reasons of both effectiveness and safety, many embedded systems are still tested manually. To this end, we propose a process, supported by an online decision support system, for ordering and selection of test cases based on the test result of previously executed test cases. To analyze the economic efficiency of such a system, a customized return on investment (ROI) metric tailored for system integration testing is introduced. Using data collected from the development process of a large-scale safety-critical embedded system, we perform Monte Carlo simulations to evaluate the expected ROI of three variants of the proposed new process. The results show that our proposed decision support system is beneficial in terms of ROI at system integration testing and thus qualifies as an important element in improving the integration testing process.

Series
Lecture Notes in Computer Science (LNCS), ISSN 0302-9743 ; 10027
Keywords
Decision support system, Integration testing, Optimization, Prioritization, Process improvement, Return on investment, Software testing, Test case selection
National Category
Computer and Information Sciences
Identifiers
urn:nbn:se:ri:diva-21422 (URN)10.1007/978-3-319-49094-6_17 (DOI)978-3-319-49093-9 (ISBN)978-3-319-49094-6 (ISBN)
Conference
17th International Conference on Product-Focused Software Process Improvement (PROFES 2016), November 22 – 24, 2016, Trondheim, Norway
Projects
IMPRINT
Available from: 2016-10-31 Created: 2016-10-31 Last updated: 2019-07-10Bibliographically approved
Tahvili, S., Saadatmand, M., Larsson, S., Afzal, W., Bohlin, M. & Sundmark, D. (2016). Dynamic Integration Test Selection Based on Test Case Dependencies (15ed.). In: 2016 IEEE Ninth International Conference on Software Testing, Verification and Validation Workshops (ICSTW): . Paper presented at 9th IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW 2016), April 10-15, 2016, Chicago, US (pp. 277-286).
Open this publication in new window or tab >>Dynamic Integration Test Selection Based on Test Case Dependencies
Show others...
2016 (English)In: 2016 IEEE Ninth International Conference on Software Testing, Verification and Validation Workshops (ICSTW), 2016, 15, p. 277-286Conference paper, Published paper (Refereed)
Abstract [en]

Prioritization, selection and minimization of test cases are well-known problems in software testing. Test case prioritization deals with the problem of ordering an existing set of test cases, typically with respect to the estimated likelihood of detecting faults. Test case selection addresses the problem of selecting a subset of an existing set of test cases, typically by discarding test cases that do not add any value in improving the quality of the software under test. Most existing approaches for test case prioritization and selection suffer from one or several drawbacks. For example, they to a large extent utilize static analysis of code for that purpose, making them unfit for higher levels of testing such as integration testing. Moreover, they do not exploit the possibility of dynamically changing the prioritization or selection of test cases based on the execution results of prior test cases. Such dynamic analysis allows for discarding test cases that do not need to be executed and are thus redundant. This paper proposes a generic method for prioritization and selection of test cases in integration testing that addresses the above issues. We also present the results of an industrial case study where initial evidence suggests the potential usefulness of our approach in testing a safety-critical train control management subsystem.

National Category
Computer and Information Sciences
Identifiers
urn:nbn:se:ri:diva-24552 (URN)10.1109/ICSTW.2016.14 (DOI)978-1-5090-3674-5 (ISBN)
Conference
9th IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW 2016), April 10-15, 2016, Chicago, US
Projects
IMPRINT
Available from: 2016-10-31 Created: 2016-10-31 Last updated: 2019-06-20Bibliographically approved
Larsson, S. & Ranjbar, Z. (2016). Service idag och i framtiden: slutrapport för projektet Framtidens Underhållstekniker (6ed.). Kista, Sweden: Swedish Institute of Computer Science
Open this publication in new window or tab >>Service idag och i framtiden: slutrapport för projektet Framtidens Underhållstekniker
2016 (Swedish)Report (Other academic)
Abstract [sv]

Detta projekt har haft som mål att undersöka möjligheten att genomföra ett FUI-projekt som fokuserar på hur framtidens service- och underhållstekniker arbetar. Projektet har undersökt fler processindustrier för att kartlägga synergier mellan olika branscher vad gäller innovationer och förbättringar för framtidens service- och underhållstekniker. Projektet har drivits av SICS Swedish ICT i samarbete med SSAB och ABB Service. Prevas och ATM Notation har dessutom deltagit som leverantör av varor och tjänster. Projektet har stämt av deltagarnas visioner mot existerande underhållslösningar och tillgänglig teknik. Vi har också identifierat behov av ytterligare innovationer inom processer, metoder och teknik. Projektet ingår i Strategiska innovationsprogrammet Processindustriell IT och Automation, PiiA, med stöd från VINNOVA.

Place, publisher, year, edition, pages
Kista, Sweden: Swedish Institute of Computer Science, 2016 Edition: 6
Series
SICS Technical Report, ISSN 1100-3154 ; 2016:04
National Category
Computer and Information Sciences
Identifiers
urn:nbn:se:ri:diva-24573 (URN)
Available from: 2016-10-31 Created: 2016-10-31 Last updated: 2018-08-15Bibliographically approved
Tahvili, S., Afzal, W., Saadatmand, M., Bohlin, M., Sundmark, D. & Larsson, S. (2016). Towards Earlier Fault Detection by Value-Driven Prioritization of Test Cases Using Fuzzy TOPSIS (9ed.). In: Information Technology: New Generations: . Paper presented at 13th International Conference on Information Technology : New Generations ITNG 2016 (pp. 745-759). , 448
Open this publication in new window or tab >>Towards Earlier Fault Detection by Value-Driven Prioritization of Test Cases Using Fuzzy TOPSIS
Show others...
2016 (English)In: Information Technology: New Generations, 2016, 9, Vol. 448, p. 745-759Conference paper, Published paper (Refereed)
Abstract [en]

In industrial software testing, development projects typically set up and maintain test suites containing large numbers of test cases. Executing a large number of test cases can be expensive in terms of effort and wall-clock time. Moreover, indiscriminate execution of all available test cases typically lead to sub-optimal use of testing resources. On the other hand, selecting too few test cases for execution might leave a large number of faults undiscovered. Limiting factors such as allocated budget and time constraints for testing further emphasizes the importance of test case prioritization in order to identify test cases that enable earlier detection of faults while respecting such constraints. In this paper, we propose a multi-criteria decision making approach for prioritizing test cases in order to detect faults earlier. This is achieved by applying the TOPSIS (Technique for Order of Preference by Similarity to Ideal Solution) decision making technique combined with fuzzy principles. Our solution is based on important criteria such as fault detection probability, execution time, complexity, and other test case properties. By applying the approach on a train control management subsystem from Bombardier Transportation in Sweden, we demonstrate how it helps, in a systematic way, to identify test cases that can lead to early detection of faults while respecting various criteria.

Series
Advances in Intelligent Systems and Computing (AISC), ISSN 2194-5357 ; 448
Keywords
Software testing, Fault detection, Test Cases Prioritization, Optimization, Fuzzy logic, MCDM, TOPSIS, Failure rate
National Category
Computer and Information Sciences
Identifiers
urn:nbn:se:ri:diva-24551 (URN)10.1007/978-3-319-32467-8_65 (DOI)978-3-319-32466-1 (ISBN)978-3-319-32467-8 (ISBN)
Conference
13th International Conference on Information Technology : New Generations ITNG 2016
Projects
IMPRINT
Available from: 2016-10-31 Created: 2016-10-31 Last updated: 2019-06-26Bibliographically approved
Fröberg, J., Larsson, S. & Marklund, U. (2015). Analyzing Improvements for a Mine Maintenance System of Connected Equipment and Machines - The Value and Benefits of Data Sharing (16ed.). In: 2015 IEEE International Symposium on Systems Engineering (ISSE): . Paper presented at 1st IEEE International Symposium on Systems Engineering (ISSE 2015), September 28-30, 2015, Rome, Italy (pp. 237-241). , Article ID 7302763.
Open this publication in new window or tab >>Analyzing Improvements for a Mine Maintenance System of Connected Equipment and Machines - The Value and Benefits of Data Sharing
2015 (English)In: 2015 IEEE International Symposium on Systems Engineering (ISSE), 2015, 16, p. 237-241, article id 7302763Conference paper, Published paper (Refereed)
Abstract [en]

A modern mine involves increasingly smart and connected products that are integrated in a mine automation system. Integration enable many possible applications that could substantially aid in achieving the goals of increased safety and productivity of the mine operation including the machine maintenance process. What data will be shared by the involved organizations and products, heavily affects how successful improvements of operation can be accommodated. We have devised a method to map out and evaluate envisioned new collaborative functions for a complex System-of-systems such as the mine maintenance operation. The proposed method map user stories for the involved stakeholders and estimate the value of fulfillment based on different candidates of data sharing architectures. The method is explained and exemplified by a realistic example based the real case. There seems to be a need for a method such as the presented one just to map out what new applications are really feasible. By estimating value in terms of stakeholder benefits and identifying possible showstoppers in terms of protected data, the method seems to help reveal what improvements in the mine operation is in fact possible. Deciding on a data-sharing architecture for a collaborative mine seems to provide useful design prerequisites to a developing organization improving their smart connected products.

Keywords
Organizations, Maintenance engineering, Collaboration, Stakeholders, Automation, Production
National Category
Computer and Information Sciences
Identifiers
urn:nbn:se:ri:diva-24481 (URN)10.1109/SysEng.2015.7302763 (DOI)978-1-4799-1920-8 (ISBN)
Conference
1st IEEE International Symposium on Systems Engineering (ISSE 2015), September 28-30, 2015, Rome, Italy
Projects
Wroomm
Available from: 2016-10-31 Created: 2016-10-31 Last updated: 2019-07-10Bibliographically approved
Fröberg, J., Larsson, S., Dersten, S. & Nordlander, P.-Å. (2014). Defining a method for identifying architectural candidates as part of engineering a system architecture (14ed.). In: : . Paper presented at Systems Conference (SysCon), 2014 8th Annual IEEE (pp. 266-271).
Open this publication in new window or tab >>Defining a method for identifying architectural candidates as part of engineering a system architecture
2014 (English)Conference paper, Published paper (Refereed)
Abstract [en]

Engineering system architectures for complex systems involves the tasks of analyzing architectural drivers, identifying architectural concerns, identifying valid architecture candidates, and evaluation of alternatives. One problem to overcome when architecting a system is the identification of valid of architectural candidates. We have developed a step-wise method for performing system architecture analysis and tested it on a sub-system in a project developing a drive system for heavy automotive applications. In this paper we present the complete method of nine steps for engineering an architecture and we elaborate in detail on the procedure to identify architectural candidates based on previously identified architectural drivers. We present a diagram depicting the proposed information model, its concepts and their relationships. In addition, the expectations on such a method as expressed by practitioners have been elicited, and we elaborate on the validity by examining how well the method indicate fulfillment. Our conclusion is that the proposed method does not fail to deliver on any of the needs and this gives an indication of usefulness. When identifying architectural candidates it is important to use proper criteria in the process. Our conclusion is that the practitioners should focus on candidates that affect the system at hand (within system boundaries), and on the candidates that address the architecturally significant system use. This is reflected in our method where we prescribe evaluation of the design candidates by validating that they solve only the right problem and by ensuring that they address the system at hand.

National Category
Computer and Information Sciences
Identifiers
urn:nbn:se:ri:diva-24390 (URN)10.1109/SysCon.2014.6819268 (DOI)2-s2.0-84902489588 (Scopus ID)
Conference
Systems Conference (SysCon), 2014 8th Annual IEEE
Available from: 2016-10-31 Created: 2016-10-31 Last updated: 2019-08-09Bibliographically approved
Wallin, P., Larsson, S., Fröberg, J. & Axelsson, J. (2012). Problems and their mitigation in system and software architecting (6ed.). Information and Software Technology, 54, 686-700
Open this publication in new window or tab >>Problems and their mitigation in system and software architecting
2012 (English)In: Information and Software Technology, Vol. 54, p. 686-700Article in journal (Refereed) Published
Abstract [en]

Context: Today, software and embedded systems act as enablers for developing new functionality in traditional industries such as the automotive, process automation, and manufacturing automation domains. This differs from 25–30 years ago when these systems where based on electronics and electro-mechanical solutions. The architecture of the embedded system and of the software is important to ensure the qualities of these applications. However, the effort of designing and evolving the architecture is in practice often neglected during system development, whilst development efforts are centered on implementing new functionality. Objective: We present problems and success factors that are central to the architectural development of software intensive systems in the domain of automotive and automation products as judged by practitioners. Method: The method consisted of three steps. First, we used semi-structured interviews to collect data in an exploratory manner. As a second step, a survey based on problems extracted from the interview data was used to investigate the occurrence of these problems at a wider range of organizations. In order to identify and suggest how to mitigate the problems that were considered important, we finally performed root cause analysis workshops, and from these a number of success factors were elicited. Results: A total of 21 problems have been identified based on the interview data, and these are related to the technical, organizational, project, and agreement processes. Based on the survey results, the following four problems were selected for a root cause analysis: (1) there is a lack of process for architecture development, (2) there is a lack of method or model to evaluate the business value when choosing the architecture, (3) there is a lack of clear long-term architectural strategy, and (4) processes and methods are less valued than knowledge and competence of individuals. Conclusion: In conclusion, the following identified success factors are crucial components to be successful in developing software intensive systems: (1) define an architectural strategy, (2) implement a process for architectural work, (3) ensure authority for architects, (4) clarify the business impact of the architecture, and (5) optimize on the project portfolio level instead of optimizing each project.

Place, publisher, year, edition, pages
Elsevier, 2012 Edition: 6
National Category
Computer and Information Sciences
Identifiers
urn:nbn:se:ri:diva-24067 (URN)
Available from: 2016-10-31 Created: 2016-10-31 Last updated: 2018-08-16Bibliographically approved
Cedergren, S., Larsson, S., Wall, A. & Norström, C. (2010). Towards Integrating Perceived Customer Value in the Evaluation of Performance in Product Development (7ed.). In: : . Paper presented at Portland International Conference on Management of Engineering and Technology (PICMET '10), 18-22 July 2010, Phuket, Thailand. IEEE
Open this publication in new window or tab >>Towards Integrating Perceived Customer Value in the Evaluation of Performance in Product Development
2010 (English)Conference paper, Published paper (Refereed)
Abstract [en]

Product delivering companies invest resources in product development activities in order to create value. Still, when performance in product development is to be evaluated, time, cost, and quality are in focus, especially in the later stages of the development when it is expensive and difficult to make any changes. Time, cost, and quality are important dimensions of performance but they are not revealing the complete picture. Missing is the value perspective. This paper outlines a method for how perceived customer value can be used to evaluate performance in product development and describes how it is verified through a case study. By using the perceived customer value of requirements, the value propagation throughout the development is possible to monitor based on both market and scope changes. In addition, a measure of productivity can be calculated by relating the perceived value to the spent effort. This information is used in order to visualize the value propagation and performance during the development. Hence, through this method it is possible to evaluate the productivity of activities from initial ideas to a final product. The paper is concluded with a discussion of managerial implications and how this method contributes to theory.

Place, publisher, year, edition, pages
IEEE, 2010 Edition: 7
National Category
Computer and Information Sciences
Identifiers
urn:nbn:se:ri:diva-23834 (URN)
Conference
Portland International Conference on Management of Engineering and Technology (PICMET '10), 18-22 July 2010, Phuket, Thailand
Available from: 2016-10-31 Created: 2016-10-31 Last updated: 2018-08-15Bibliographically approved
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0002-0921-0878

Search in DiVA

Show all publications
v. 2.35.7