Locality-aware task scheduling and data distribution on NUMA systems
2013 (English) In: Lecture Notes in Computer Science, 2013, Vol. 8122, p. 156-170Conference paper, Published paper (Refereed)
Abstract [en]
Modern parallel computer systems exhibit Non-Uniform Memory Access (NUMA) behavior. For best performance, any parallel program therefore has to match data allocation and scheduling of computations to the memory architecture of the machine. When done manually, this becomes a tedious process and since each individual system has its own peculiarities this also leads to programs that are not performance-portable. We propose the use of a data distribution scheme in which NUMA hardware peculiarities are abstracted away from the programmer and data distribution is delegated to a runtime system which is generated once for each machine. In addition we propose using task data dependence information now possible with the OpenMP 4.0RC2 proposal to guide the scheduling of OpenMP tasks to further reduce data stall times. We demonstrate the viability and performance of our proposals on a four socket AMD Opteron machine with eight NUMA nodes. We identify that both data distribution and locality-aware task scheduling improves performance compared to default policies while still providing an architecture-oblivious approach for the programmer.
Place, publisher, year, edition, pages 2013. Vol. 8122, p. 156-170
Keywords [en]
Data allocation, Data dependence, Data distribution, Data distribution schemes, Individual systems, Non uniform memory access, Parallel computer systems, Parallel program, Electric equipment, Memory architecture, Multitasking, Scheduling, Scheduling algorithms, Application programming interfaces (API)
National Category
Engineering and Technology
Identifiers URN: urn:nbn:se:ri:diva-48578 DOI: 10.1007/978-3-642-40698-0_12 Scopus ID: 2-s2.0-84883296523 ISBN: 9783642406973 (print) OAI: oai:DiVA.org:ri-48578 DiVA, id: diva2:1474394
Conference 16 September 2013 through 18 September 2013, Canberra, ACT
2020-10-082020-10-082020-12-01 Bibliographically approved