Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Similarity-based prioritization of test case automation
Mälardalen University, Sweden.ORCID iD: 0000-0001-8096-3592
RISE - Research Institutes of Sweden, ICT, SICS.ORCID iD: 0000-0003-2165-7039
Mälardalen University, Sweden.
Mälardalen University, Sweden.
Show others and affiliations
2018 (English)In: Software quality journal, ISSN 0963-9314, E-ISSN 1573-1367, Vol. 26, no 4, p. 1421-1449Article in journal (Refereed) Published
Abstract [en]

The importance of efficient software testing procedures is driven by an ever increasing system complexity as well as global competition. In the particular case of manual test cases at the system integration level, where thousands of test cases may be executed before release, time must be well spent in order to test the system as completely and as efficiently as possible. Automating a subset of the manual test cases, i.e, translating the manual instructions to automatically executable code, is one way of decreasing the test effort. It is further common that test cases exhibit similarities, which can be exploited through reuse when automating a test suite. In this paper, we investigate the potential for reducing test effort by ordering the test cases before such automation, given that we can reuse already automated parts of test cases. In our analysis, we investigate several approaches for prioritization in a case study at a large Swedish vehicular manufacturer. The study analyzes the effects with respect to test effort, on four projects with a total of 3919 integration test cases constituting 35,180 test steps, written in natural language. The results show that for the four projects considered, the difference in expected manual effort between the best and the worst order found is on average 12 percentage points. The results also show that our proposed prioritization method is nearly as good as more resource demanding meta-heuristic approaches at a fraction of the computational time. Based on our results, we conclude that the order of automation is important when the set of test cases contain similar steps (instructions) that cannot be removed, but are possible to reuse. More precisely, the order is important with respect to how quickly the manual test execution effort decreases for a set of test cases that are being automated. 

Place, publisher, year, edition, pages
2018. Vol. 26, no 4, p. 1421-1449
Keywords [en]
Effort, Prioritization, Reuse, Software-testing, Test-case automation, Automation, Computer software reusability, Heuristic methods, Computational time, Global competition, Meta-heuristic approach, System integration, Test case, Software testing
National Category
Natural Sciences
Identifiers
URN: urn:nbn:se:ri:diva-33511DOI: 10.1007/s11219-017-9401-7Scopus ID: 2-s2.0-85043389019OAI: oai:DiVA.org:ri-33511DiVA, id: diva2:1192839
Available from: 2018-03-23 Created: 2018-03-23 Last updated: 2023-06-02

Open Access in DiVA

fulltext(3386 kB)491 downloads
File information
File name FULLTEXT01.pdfFile size 3386 kBChecksum SHA-512
bc60c73a36979e1971e4fc49d695b859ab4aa3f26b4698dd5c3ce3a772bdb46c276173863220e604a2cb269b83186dd676616aad6010a3df188079c419b6c221
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Flemström, DanielPotena, PasqualinaBohlin, Markus

Search in DiVA

By author/editor
Flemström, DanielPotena, PasqualinaBohlin, Markus
By organisation
SICS
In the same journal
Software quality journal
Natural Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 491 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 130 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf