SpanEdge: Towards unifying stream processing over central and near-the-edge data centers
2016 (English)In: Proceedings - 1st IEEE/ACM Symposium on Edge Computing, SEC 2016, Institute of Electrical and Electronics Engineers Inc. , 2016, p. 168-178Conference paper, Published paper (Refereed)
Abstract [en]
In stream processing, data is streamed as a continuous flow of data items, which are generated from multiple sources and geographical locations. The common approach for stream processing is to transfer raw data streams to a central data center that entails communication over the wide-area network (WAN). However, this approach is inefficient and falls short for two main reasons: i) the burst in the amount of data generated at the network edge by an increasing number of connected devices, ii) the emergence of applications with predictable and low latency requirements. In this paper, we propose SpanEdge, a novel approach that unifies stream processing across a geo-distributed infrastructure, including the central and near-the-edge data centers. SpanEdge reduces or eliminates the latency incurred by WAN links by distributing stream processing applications across the central and the near-the-edge data centers. Furthermore, SpanEdge provides a programming environment, which allows programmers to specify parts of their applications that need to be close to the data source. Programmers can develop a stream processing application, regardless of the number of data sources and their geographical distributions. As a proof of concept, we implemented and evaluated a prototype of SpanEdge. Our results show that SpanEdge can optimally deploy the stream processing applications in a geo-distributed infrastructure, which significantly reduces the bandwidth consumption and the response latency.
Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers Inc. , 2016. p. 168-178
Keywords [en]
Edge computing, Edge-based analytics, Geo-distributed infrastructure, Geo-distributed stream processing, Computer programming, Distributed parameter control systems, Geographical distribution, Wide area networks, Bandwidth consumption, Distributed infrastructure, Distributed stream processing, Edge-based, Geographical locations, Programming environment, Stream processing, Data handling
National Category
Engineering and Technology
Identifiers
URN: urn:nbn:se:ri:diva-43890DOI: 10.1109/SEC.2016.17Scopus ID: 2-s2.0-85010817816ISBN: 9781509033218 (print)OAI: oai:DiVA.org:ri-43890DiVA, id: diva2:1420983
Conference
1st IEEE/ACM Symposium on Edge Computing, SEC 2016, 27 October 2016 through 28 October 2016
2020-04-012020-04-012023-05-08Bibliographically approved