Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Robustness testing of embedded software systems: An industrial interview study
RISE, Swedish ICT, SICS.
RISE, Swedish ICT, SICS. Mälardalen University, Sweden.
University of Skövde, Sweden.
University of Skövde, Sweden.
2016 (English)In: IEEE Access, E-ISSN 2169-3536, Vol. 4, p. 1859-1871Article in journal (Refereed) Published
Abstract [en]

Embedded software is at the core of current and future telecommunication, automotive, multimedia, and industrial automation systems. The success of practically any industrial application depends on the embedded software system's dependability, and one method to verify the dependability of a system is testing its robustness. The motivation behind this paper is to provide a knowledge base of the state of the practice in robustness testing of embedded software systems and to compare this to the state of the art. We have gathered the information on the state of the practice in robustness testing from seven different industrial domains (telecommunication, automotive, multimedia, critical infrastructure, aerospace, consumer products, and banking) by conducting 13 semi-structured interviews. We investigate the different aspects of robustness testing, such as the general view of robustness, relation to requirements engineering and design, test execution, failures, and tools. We highlight knowledge from the state of the practice of robustness testing of embedded software systems. We found different robustness testing practices that have not been previously described. This paper shows that the state of the practice, when it comes to robustness testing, differs between organizations and is quite different from the state of the art described in the scientific literature. For example, methods commonly described in the literature (e.g., the fuzzy approach) are not used in the organizations we studied. Instead, the interviewees described several ad hoc approaches that take specific scenarios into account (e.g., power failure or overload). Other differences we found concern the classification of robustness failures, the hypothesized root causes of robustness failures, and the types of tools used for robustness testing. This paper is a first step in capturing the state of the practice of robustness testing of embedded software systems. The results can be used by both researchers and practitioners. Researchers can use our findings to understand the gap between the state of the art and the state of the practice and develop their studies to fill this gap. Practitioners can also learn from this knowledge base regarding how they can improve their practice and acquire other practices.

Place, publisher, year, edition, pages
IEEE , 2016, 8. Vol. 4, p. 1859-1871
Keywords [en]
Automotive engineering, Embedded system, Industrial automation, Multimedia communication, Robustness, Software development, Telecommunication services, Testing, embedded systems, interviews, robustness, state of the art, state of the practice, survey, testing
National Category
Computer and Information Sciences
Identifiers
URN: urn:nbn:se:ri:diva-24547DOI: 10.1109/ACCESS.2016.2544951Scopus ID: 2-s2.0-84979823446OAI: oai:DiVA.org:ri-24547DiVA, id: diva2:1043631
Projects
TOCSYCAvailable from: 2016-10-31 Created: 2016-10-31 Last updated: 2025-09-23Bibliographically approved

Open Access in DiVA

fulltext(646 kB)1238 downloads
File information
File name FULLTEXT01.pdfFile size 646 kBChecksum SHA-512
3b411e04d1b530a454de9049ca845b348cd82a7b668e521f966bc65d4bac230b46677d54f593c1bc1b5cd63297a0c0b00b8481e126a527f34ca155c5c29353b5
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus
By organisation
SICS
In the same journal
IEEE Access
Computer and Information Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 1241 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 183 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf