Planned maintenance
A system upgrade is planned for 10/12-2024, at 12:00-13:00. During this time DiVA will be unavailable.
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Arcon: Continuous and deep data stream analytics
RISE - Research Institutes of Sweden (2017-2019), ICT, SICS.
KTH Royal Institute of Technology, Sweden.
KTH Royal Institute of Technology, Sweden.ORCID iD: 0000-0002-1200-0177
RISE - Research Institutes of Sweden (2017-2019), ICT, SICS.ORCID iD: 0000-0002-9351-8508
Show others and affiliations
2019 (English)In: ACM International Conference Proceeding Series, Association for Computing Machinery , 2019Conference paper, Published paper (Refereed)
Abstract [en]

Contemporary end-to-end data pipelines need to combine many diverse workloads such as machine learning, relational operations, stream dataflows, tensor transformations, and graphs. For each of these workload types, there exists several frontends (e.g., SQL, Beam, Keras) based on different programming languages as well as different runtimes (e.g., Spark, Flink, Tensorflow) that optimize for a particular frontend and possibly a hardware architecture (e.g., GPUs). The resulting pipelines suffer in terms of complexity and performance due to excessive type conversions, materialization of intermediate results, and lack of cross-framework optimizations. Arcon aims to provide a unified approach to declare and execute tasks across frontend-boundaries as well as enabling their seamless integration with event-driven services at scale. In this demonstration, we present Arcon and through a series of use-case scenarios demonstrate that its execution model is powerful enough to cover existing as well as upcoming real-time computations for analytics and application-specific needs. © 2019 Copyright held by the owner/author(s).

Place, publisher, year, edition, pages
Association for Computing Machinery , 2019.
Keywords [en]
Data flow analysis, Information analysis, Object oriented programming, Program processors, Application specific, Framework optimization, Hardware architecture, Intermediate results, Real-time computations, Relational operations, Seamless integration, Tensor transformation, Pipelines
National Category
Natural Sciences
Identifiers
URN: urn:nbn:se:ri:diva-40454DOI: 10.1145/3350489.3350492Scopus ID: 2-s2.0-85072806432ISBN: 9781450376600 (print)OAI: oai:DiVA.org:ri-40454DiVA, id: diva2:1361272
Conference
13th International Workshop on Real-Time Business Intelligence and Analytics, BIRTE 2019, in conjunction with the VLDB 2019 Conference, 26 August 2019
Available from: 2019-10-15 Created: 2019-10-15 Last updated: 2023-06-07Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Kroll, LarsCarbone, ParisHaridi, Seif

Search in DiVA

By author/editor
Kroll, LarsCarbone, ParisHaridi, Seif
By organisation
SICS
Natural Sciences

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 36 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf