Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Distributed vertex-cut partitioning
RISE, Swedish ICT, SICS. KTH Royal Institute of Technology, Sweden.
RISE, Swedish ICT, SICS.ORCID iD: 0000-0002-2748-8929
KTH Royal Institute of Technology, Sweden.
RISE, Swedish ICT, SICS.ORCID iD: 0000-0002-6718-0144
2014 (English)In: Lecture Notes in Computer Science, Springer Verlag , 2014, p. 186-200Conference paper, Published paper (Refereed)
Abstract [en]

Graph processing has become an integral part of big data analytics. With the ever increasing size of the graphs, one needs to partition them into smaller clusters, which can be managed and processed more easily on multiple machines in a distributed fashion. While there exist numerous solutions for edge-cut partitioning of graphs, very little effort has been made for vertex-cut partitioning. This is in spite of the fact that vertex-cuts are proved significantly more effective than edge-cuts for processing most real world graphs. In this paper we present Ja-be-Ja-vc, a parallel and distributed algorithm for vertex-cut partitioning of large graphs. In a nutshell, Ja-be-Ja-vc is a local search algorithm that iteratively improves upon an initial random assignment of edges to partitions. We propose several heuristics for this optimization and study their impact on the final partitioning. Moreover, we employ simulated annealing technique to escape local optima. We evaluate our solution on various graphs and with variety of settings, and compare it against two state-of-the-art solutions. We show that Ja-be-Ja-vc outperforms the existing solutions in that it not only creates partitions of any requested size, but also requires a vertex-cut that is better than its counterparts and more than 70% better than random partitioning.

Place, publisher, year, edition, pages
Springer Verlag , 2014. p. 186-200
Keywords [en]
Big data, Graphic methods, Interoperability, Iterative methods, Simulated annealing, Data analytics, Graph processing, Local search algorithm, Multiple machine, Parallel and distributed algorithms, Random assignment, Real-world graphs, Simulated annealing techniques, Graph theory
National Category
Engineering and Technology
Identifiers
URN: urn:nbn:se:ri:diva-45563DOI: 10.1007/978-3-662-43352-2_15Scopus ID: 2-s2.0-84902593727ISBN: 9783662433515 (print)OAI: oai:DiVA.org:ri-45563DiVA, id: diva2:1457027
Conference
3 June 2014 through 5 June 2014, Berlin
Note

Conference code: 105614

Available from: 2020-08-10 Created: 2020-08-10 Last updated: 2023-06-07Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Payberah, Amir H.Haridi, Seif

Search in DiVA

By author/editor
Payberah, Amir H.Haridi, Seif
By organisation
SICS
Engineering and Technology

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 34 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf