Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Requirements Ambiguity Detection and Explanation with LLMS: An Industrial Study
RISE Research Institutes of Sweden, Digital Systems, Industrial Systems. RISE Research Institutes of Sweden AB, Gothenburg, Vastra Gotaland, Sweden, Mälardalen University, Vasteras, Västmanland, Sweden;.ORCID iD: 0009-0006-8512-6412
University College Dublin, Dublin, Leinster, Ireland;.
RISE Research Institutes of Sweden, Digital Systems, Industrial Systems.
Westermo Network Technologies AB, Vasteras, Vastmanlands, Sweden;.
Show others and affiliations
2025 (English)Conference paper, Published paper (Refereed)
Abstract [en]

Developing large-scale industrial systems requires high-quality requirements to avoid costly rework and project delays. However, linguistic ambiguities in natural language (NL) requirements have been a long-standing challenge, often introducing misinterpretations and inconsistencies that propagate throughout the development lifecycle. Such ambiguous NL requirements necessitate early detection and well-reasoned explanations to clarify and prevent further misunderstandings among stakeholders. While solutions have been developed to detect ambiguities in NL requirements, the advent of generative large language models (LLMs) offers new avenues for explanation-augmented requirements ambiguity detection. This paper empirically investigates LLMs for ambiguity detection and explanation in real-world industrial requirements by adopting an in-context learning paradigm. Our results from three industrial datasets show that LLMs achieve a 20.2% average performance increase in classifying ambiguous requirements when prompted with ten relevant in-context demonstrations (10 -shot), compared to no demonstrations (0 -shot). Additionally, we conducted human evaluations of the LLM-generated outputs with eight industry experts along four dimensions-naturalness, adequacy, usefulness and relevance-to gain practical insights. The results show an average rating of 3.84 out of 5 across evaluation criteria, indicating that the approach is effective in providing supporting explanations for requirement ambiguities

Place, publisher, year, edition, pages
2025. p. 620-631
Keywords [en]
in-context learning, large language models, requirements ambiguity, requirements classification
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:ri:diva-79889DOI: 10.1109/ICSME64153.2025.00063Scopus ID: 2-s2.0-105022457767ISBN: 9798331595876 (print)OAI: oai:DiVA.org:ri-79889DiVA, id: diva2:2018820
Conference
41st IEEE International Conference on Software Maintenance and Evolution, ICSME 2025
Available from: 2025-12-04 Created: 2025-12-04 Last updated: 2025-12-04Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Bashir, SarmadSaadatmand, Mehrdad

Search in DiVA

By author/editor
Bashir, SarmadSaadatmand, Mehrdad
By organisation
Industrial Systems
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 67 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf