Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
AquaLang: A Dataflow Programming Language
KTH Royal Institute of Technology, Sweden.
RISE Research Institutes of Sweden, Digital Systems, Data Science. KTH Royal Institute of Technology, Sweden.ORCID iD: 0000-0002-6718-0144
RISE Research Institutes of Sweden, Digital Systems, Data Science. KTH Royal Institute of Technology, Sweden.ORCID iD: 0000-0002-9351-8508
2024 (English)In: DEBS 2024 - Proceedings of the 18th ACM International Conference on Distributed and Event-Based Systems, Association for Computing Machinery, Inc , 2024, p. 42-53Conference paper, Published paper (Refereed)
Abstract [en]

Dataflow systems are widely used today for building and running continuous data-intensive applications. However, the unavoidable semantic gap between the host languages of dataflow system libraries and the dataflow model creates programmability limitations that hinder performance, safety, and ease of use. We propose AquaLang, a new language designed for dataflow systems. Programs in AquaLang blend strongly typed relational and functional syntax and are verified using an effect system that prevents undefined behaviour that can occur when introducing user-defined logic that violates dataflow semantics. Unverified external code is also feasible in AquaLang through the novel use of sandboxing. Furthermore, on top of standard dataflow optimisations employed by current systems, AquaLang’s ability to analyze algebraic properties of user-defined functions further unlocks the potential of deeper dataflow program re-writing. In our evaluation, we measure up to one order of magnitude speedup for Nexmark queries against hand-written Flink programs attributed to pushdown and window incrementalisation techniques. .

Place, publisher, year, edition, pages
Association for Computing Machinery, Inc , 2024. p. 42-53
Keywords [en]
Computer programming languages; Data flow analysis; Continuous data; Data flow modeling; Data stream; Data-intensive application; Dataflow; Dataflow programming; Dataflow system; Performance; Programmability; Semantic gap; Semantics
National Category
Computer and Information Sciences
Identifiers
URN: urn:nbn:se:ri:diva-74846DOI: 10.1145/3629104.3666030Scopus ID: 2-s2.0-85200659561OAI: oai:DiVA.org:ri-74846DiVA, id: diva2:1892500
Conference
18th ACM International Conference on Distributed and Event-Based Systems, DEBS 2024 Villeurbanne, France. 25 June 2024 through 28 June 2024
Note

The research behind Aqualang was supported by Vinnova (GrantNo.: 2022-03036), the Swedish Foundation of Strategic Research(Grant No.: BD15-0006), Wallenberg AI NEST (DataBound Computing) and the Swedish e-Science Research Centre (SeRC)

Available from: 2024-08-27 Created: 2024-08-27 Last updated: 2025-09-23Bibliographically approved

Open Access in DiVA

fulltext(957 kB)71 downloads
File information
File name FULLTEXT01.pdfFile size 957 kBChecksum SHA-512
c550a39834f0eb19489225300a9d7ff8502f540c00cd135a93015e7c519ad074924f6cdeb00f221761170d31e0c4b2b7ad5a723dc77836d7b8f7f4d6e93d48fe
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Haridi, SeifCarbone, Paris

Search in DiVA

By author/editor
Haridi, SeifCarbone, Paris
By organisation
Data Science
Computer and Information Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 71 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 250 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf