Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
A survey on the evolution of stream processing systems
Delivery Hero Research, Germany.
RISE Research Institutes of Sweden, Digital Systems, Data Science. KTH Royal Institute of Technology, Sweden.ORCID iD: 0000-0002-9351-8508
Boston University, USA.ORCID iD: 0000-0001-8219-4862
Delft University of Technology, Netherlands.
2024 (English)In: The VLDB journal, ISSN 1066-8888, E-ISSN 0949-877X, Vol. 33, no 2, p. 507-541Article in journal (Refereed) Published
Abstract [en]

Stream processing has been an active research field for more than 20 years, but it is now witnessing its prime time due to recent successful efforts by the research community and numerous worldwide open-source communities. This survey provides a comprehensive overview of fundamental aspects of stream processing systems and their evolution in the functional areas of out-of-order data management, state management, fault tolerance, high availability, load management, elasticity, and reconfiguration. We review noteworthy past research findings, outline the similarities and differences between the first (’00–’10) and second (’11–’23) generation of stream processing systems, and discuss future trends and open problems. 

Place, publisher, year, edition, pages
Springer Science and Business Media Deutschland GmbH , 2024. Vol. 33, no 2, p. 507-541
Keywords [en]
Electric loads; Information management; Cloud applications; Functional areas; Open source communities; Out of order; Prime time; Research communities; Research fields; Stream processing; Stream processing systems; Streaming analytic; Fault tolerance
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:ri:diva-68129DOI: 10.1007/s00778-023-00819-8Scopus ID: 2-s2.0-85177547566OAI: oai:DiVA.org:ri-68129DiVA, id: diva2:1816032
Funder
Google, DAPA
Note

We thank the anonymous VLDBJ reviewers for their detailed and valuable feedback on prior drafts of this paper. This work was partially supported by a Google DAPA award, WASP NESTS (Data-Bound Computing), and the Dutch Research Council (NWO) Vidi project No. 19708.

Available from: 2023-11-30 Created: 2023-11-30 Last updated: 2024-06-11Bibliographically approved

Open Access in DiVA

fulltext(1660 kB)3 downloads
File information
File name FULLTEXT01.pdfFile size 1660 kBChecksum SHA-512
3eccc0b0a941cdaeab95bd6954ea0b651c63221b203198d9cb31444614abce0fdd4b6f26c2e0a5bafd9893e421ff453397edac93f67a4c1d7b2608a30cdad850
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Carbone, Paris

Search in DiVA

By author/editor
Carbone, ParisKalavri, Vasiliki
By organisation
Data Science
In the same journal
The VLDB journal
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 3 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 142 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf