1. [Publications](/publications) 2. Control Replication: Compiling Implicit Parallelism to Efficient SPMD with Logical Regions # Control Replication: Compiling Implicit Parallelism to Efficient SPMD with Logical Regions ![Publication image](/sites/default/files/styles/wide/public/default_images/default.jpeg?itok=qUFsuJCP "Publication image") We present control replication, a technique for generating high-performance and scalable SPMD code from implicitly parallel programs. In contrast to traditional parallel programming models that require the programmer to explicitly manage threads and the communication and synchronization between them, implicitly parallel programs have sequential execution semantics and naturally avoid the pitfalls of explicitly parallel code. However, without optimizations to distribute control overhead, scalability is often poor. Performance on distributed-memory machines is especially sensitive to communication and synchronization in the program, and thus optimizations for these machines require an intimate understanding of a program’s memory accesses. Control replication achieves particularly effective and predictable results by leveraging language support for first-class data partitioning in the source programming model. We evaluate an implementation of control replication for Regent and show that it achieves up to 99% parallel efficiency at 1024 nodes with absolute performance comparable to hand-written MPI(+X) codes. ## Authors Elliott Slaughter (Stanford University) Wonchan Lee (Stanford University) Sean Treichler (NVIDIA) Wen Zhang (Stanford University) [Michael Bauer](/person/mike-bauer) Galen Shipman (Los Alamos National Laboratory) Patrick McCormick (Los Alamos National Laboratory) Alex Aiken (Stanford University) ## Publication Date Sunday, November 12, 2017 ## Published in [ International Conference for High Performance Computing and Communications (SC…](https://dl.acm.org/doi/10.1145/3126908.3126949) ## Research Area [High Performance Computing](/research-area/high-performance-computing) [Programming Languages, Systems and Tools](/research-area/programming-languages-systems) ## External Links [ACM Digital Library](https://dl.acm.org/doi/10.1145/3126908.3126949) ## Uploaded Files [Published manuscript](https://d1qx31qr3h6wln.cloudfront.net/publications/SC_2017_Control_Replication.pdf "Open file in new window")555.4 KB ## Copyright Copyright by the Association for Computing Machinery, Inc. Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, to republish, to post on servers, or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from Publications Dept, ACM Inc., fax +1 (212) 869-0481, or . The definitive version of this paper can be found at ACM's Digital Library .