## Programming Languages, Systems and Tools ### Associated Publications ### 2026 [Hunting CUDA Bugs at Scale with cuFuzz](/index.php/publication/2026-03_hunting-cuda-bugs-scale-cufuzz) [Mohamed Tarek Ibn Ziad](/index.php/person/mohamed-tarek-ibn-ziad), [Christos Kozyrakis](/index.php/person/christos-kozyrakis) [International Conference on Object-Oriented Programming Systems, Languages, and…](https://doi.org/10.1145/3798231) ### 2025 [Task-Based Tensor Computations on Modern GPUs](/publication/2025-06_task-based-tensor-computations-modern-gpus) Rohan Yadav, [Michael Garland](/person/michael-garland), Alex Aiken, [Michael Bauer](/person/mike-bauer) [PLDI](https://pldi25.sigplan.org/) [Adaptive Algebraic Reuse of Reordering in Cholesky Factorizations with Dynamic Sparsity Patterns](/publication/2025-06_adaptive-algebraic-reuse-reordering-cholesky-factorizations-dynamic-sparsity) Behrooz Zarebavani, Danny Kaufman, David Levin, [Maryam Mehri Dehnavi](/person/maryam-mehri-dehnavi) [SIGGRAPH 2025](https://s2025.siggraph.org/) [Composing Distributed Computations Through Task and Kernel Fusion](/publication/2025-03_composing-distributed-computations-through-task-and-kernel-fusion) Rohan Yadav, Shiv Sundrum, Wonchan Lee, [Michael Garland](/person/michael-garland), [Michael Bauer](/person/mike-bauer), Alex Aiken, Fredrik Kjolstad [ASPLOS](https://www.asplos-conference.org/asplos2025/) [Automatic Tracing in Task-Based Runtime Systems](/publication/2025-03_automatic-tracing-task-based-runtime-systems) Rohan Yadav, [Michael Bauer](/person/mike-bauer), David Broman, [Michael Garland](/person/michael-garland), Alex Aiken, Fredrik Kjolstad [ASPLOS](https://www.asplos-conference.org/asplos2025/) ### 2023 [Legate Sparse: Distributed Sparse Computing in Python](/publication/2023-11_legate-sparse-distributed-sparse-computing-python) Rohan Yadav, Wonchan Lee, [Melih Elibol](/person/melih-elibol), [Taylor Patti](/person/taylor-patti), Manolis Papadakis, [Michael Garland](/person/michael-garland), Alex Aiken, Fredrik Kjolstad, [Michael Bauer](/person/mike-bauer) [Supercomputing](https://sc23.supercomputing.org/presentation/?id=pap119&sess=sess172) [cuCatch: A Debugging Tool for Efficiently Catching Memory Safety Violations in CUDA Applications](/index.php/publication/2023-06_cucatch-debugging-tool-efficiently-catching-memory-safety-violations-cuda) [Mohamed Tarek Ibn Ziad](/index.php/person/mohamed-tarek-ibn-ziad), [Sana Damani](/index.php/person/sana-damani), [Aamer Jaleel](/index.php/person/aamer-jaleel), [Stephen W. Keckler](/index.php/person/stephen-keckler), [Mark Stephenson](/index.php/person/mark-stephenson) [ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI)](https://dl.acm.org/doi/10.1145/3591225) [Visibility Algorithms for Dynamic Dependence Analysis and Distributed Coherence](/publication/2023-02_visibility-algorithms-dynamic-dependence-analysis-and-distributed-coherence) [Michael Bauer](/person/mike-bauer), Elliott Slaughter, Sean Treichler, Wonchan Lee, [Michael Garland](/person/michael-garland), Alex Aiken [PPoPP](https://conf.researchr.org/home/ppopp-2023) [Parsimony: Enabling SIMD/Vector Programming in Standard Compiler Flows](/publication/2023-02_parsimony-enabling-simdvector-programming-standard-compiler-flows) Vijay Kandiah, [Daniel Lustig](/person/daniel-lustig), Oreste Villa, [David Nellans](/person/david-nellans), Nikos Hardavellas [International Symposium on Code Generation and Optimization](https://dl.acm.org/doi/10.1145/3579990.3580019) ### 2022 [Demystifying Map Space Exploration for NPUs](/publication/2022-11_demystifying-map-space-exploration-npus) Sheng-Chun Kao, [Angshuman Parashar](/person/angshuman-parashar), [Po-An Tsai](/person/po-an-tsai), Tushar Krishna [International Symposium on Workload Characterization (IISWC)](https://ieeexplore.ieee.org/document/9975389) [Slang Shading Language Advances](/index.php/publication/2022-04_slang-shading-language-advances) Yong He, [Petrik Clarberg](/index.php/person/petrik-clarberg), Theresa Foley [Video on YouTube](https://youtu.be/DUOn9ek0bdI) [Research Advances Toward Real-Time Path Tracing](/publication/2022-03_research-advances-toward-real-time-path-tracing) [Petrik Clarberg](/person/petrik-clarberg), [Simon Kallweit](/person/simon-kallweit), [Craig Kolb](/person/craig-kolb), Pawel Kozlowski, Yong He, [Lifan Wu](/person/lifan-wu), Edward Liu [GDC 2022](https://gdconf.com/) [Marvel: A Data-Centric Approach for Mapping Deep Learning Operators on Spatial Accelerators](/index.php/publication/2022-03_marvel-data-centric-approach-mapping-deep-learning-operators-spatial) Prasanth Chatarasi, Hyoukjun Kwon, [Angshuman Parashar](/index.php/person/angshuman-parashar), [Michael Pellauer](/index.php/person/michael-pellauer), Tushar Krishna, Vivek Sarkar [Transactions on Architecture and Code Optimization (TACO)](https://dl.acm.org/doi/full/10.1145/3485137) ### 2021 [Union: A Unified HW-SW Co-Design Ecosystem in MLIR for Evaluating Tensor Operations on Spatial Accelerators](/publication/2021-09_union-unified-hw-sw-co-design-ecosystem-mlir-evaluating-tensor-operations) Geonhwa Jeong, Gokcen Kestor, Prasanth Chatarasi, [Angshuman Parashar](/person/angshuman-parashar), [Po-An Tsai](/person/po-an-tsai), Sivasankaran Rajamanickam, Roberto Gioiosa, Tushar Krishna [Parallel Architectures and Compilation Techniques (PACT)](https://ieeexplore.ieee.org/document/9563040) [Cooperative Profile Guided Optimization](/publication/2021-07_cooperative-profile-guided-optimization) [Mark Stephenson](/person/mark-stephenson), Ram Rangan, [Steve Keckler](/person/stephen-keckler) [ Computer Graphics Forum (Proceedings of High Performance Graphics)](https://www.highperformancegraphics.org/2021/) [Efficient Multi-GPU Shared Memory via Automatic Optimization of Fine-Grained Transfers](/publication/2021-06_efficient-multi-gpu-shared-memory-automatic-optimization-fine-grained-transfers) [Harini Muthukrishnan](/person/harini-muthukrishnan), [David Nellans](/person/david-nellans), [Daniel Lustig](/person/daniel-lustig), Jeffrey Fessler, Thomas Wenisch [International Symposium on Computer Architecture (ISCA)](https://ieeexplore.ieee.org/document/9499752) [PGZ: Automatic Zero-Value Code Specialization](/publication/2021-03_pgz-automatic-zero-value-code-specialization) [Mark Stephenson](/person/mark-stephenson), Ram Rangan [International Conference on Compiler Construction (CC)](https://dl.acm.org/doi/10.1145/3446804.3446845) [Scaling Implicit Parallelism via Dynamic Control Replication](/publication/2021-02_scaling-implicit-parallelism-dynamic-control-replication) [Michael Bauer](/person/mike-bauer), Wonchan Lee, Elliott Slaughter, Zhihao Jia, Mario Di Renzo, Manolis Papadakis, Galen Shipman, Patrick McCormick, [Michael Garland](/person/michael-garland), Alex Aiken [Principles and Practices of Parallel Programming (PPoPP)](https://ppopp21.sigplan.org/) [Hardware Abstractions for Targeting EDDO Architectures with the Polyhedral Model](/index.php/publication/2021-01_hardware-abstractions-targeting-eddo-architectures-polyhedral-model) [Angshuman Parashar](/index.php/person/angshuman-parashar), Prasanth Chatarasi, [Po-An Tsai](/index.php/person/po-an-tsai) [International Workshop on Polyhedral Compilation Techniques (IMPACT)](https://acohen.gitlabpages.inria.fr/impact/impact2021/) ### 2020 [Locality-Centric Data and Threadblock Management for Massive GPUs](/publication/2020-10_locality-centric-data-and-threadblock-management-massive-gpus) Mahmoud Khairy, Vadim Nikiforov, [David Nellans](/person/david-nellans), Timothy G. Rogers [International Symposium on Microarchitecture (MICRO)](https://ieeexplore.ieee.org/document/9251964) [A Programmable Approach to Neural Network Compression](/publication/2020-10_programmable-approach-neural-network-compression) Vinu Joseph, Ganesh L. Gopalakrishnan, [Saurav Muralidharan](/person/saurav-muralidharan), [Michael Garland](/person/michael-garland), Animesh Garg [IEEE Micro: Special Issue on Machine Learning for Systems](https://ieeexplore.ieee.org/document/9151283) [Zeroploit: Exploiting Zero Valued Operands in Interactive Gaming Applications](/publication/2020-08_zeroploit-exploiting-zero-valued-operands-interactive-gaming-applications) Ram Rangan, [Mark Stephenson](/person/mark-stephenson), Aditya Ukarande, Shyam Murthy, Virat Agarwal, Marc Blackstein [ACM Transactions on Architecture and Code Optimization (TACO)](https://dl.acm.org/doi/10.1145/3394284) [There’s Plenty of Room at the Top: What Will Drive Computer Performance after Moore’s Law?](/publication/2020-06_there-s-plenty-room-top-what-will-drive-computer-performance-after-moore-s-law) Charles E. Leiserson, Neil C. Thompson, [Joel Emer](/person/joel-emer), Bradley C. Kuszmaul, Butler W. Lampson, Daniel Sanchez , Tao B. Schardl [Science](https://www.science.org/doi/10.1126/science.aam9744) [Speculative Reconvergence for Improved SIMT Efficiency](/publication/2020-02_speculative-reconvergence-improved-simt-efficiency) Sana Damani, Daniel Johnson, [Mark Stephenson](/person/mark-stephenson), Eddie Yan, Olivier Giroux, Michael McKeown, [Steve Keckler](/person/stephen-keckler) [International Symposium on Code Generation and Optimization](https://dl.acm.org/doi/10.1145/3368826.3377911) ### 2019 [Legate NumPy: Accelerated and Distributed Array Computing](/publication/2019-11_legate-numpy-accelerated-and-distributed-array-computing) [Michael Bauer](/person/mike-bauer), [Michael Garland](/person/michael-garland) [The International Conference for High Performance Computing, Networking, Storag…](https://sc19.supercomputing.org/presentation/?id=pap271&sess=sess163) [NVBit: A Dynamic Binary Instrumentation Framework for NVIDIA GPUs](/publication/2019-10_nvbit-dynamic-binary-instrumentation-framework-nvidia-gpus) Oreste Villa, [Mark Stephenson](/person/mark-stephenson), [David Nellans](/person/david-nellans), [Steve Keckler](/person/stephen-keckler) [International Symposium on Microarchitecture (MICRO)](https://doi.org/10.1145/3352460.3358307) [Task Bench: A Parameterized Benchmark for Evaluating Parallel Runtime Performance](/publication/2019-08_task-bench-parameterized-benchmark-evaluating-parallel-runtime-performance) Elliott Slaughter, Wei Wu, Yuankun Fu, Legend Brandenburg, Nicolai Garcia, Wilhem Kautz, Emily Marx, Kaleb S. Morris, Qinglei Cao, George Bosilca, Seema Mirchandaney, Wonchan Lee, Sean Treichler, Patrick McCormick, Alex Aiken [arXiv](https://arxiv.org/abs/1908.05790) [Timeloop: A Systematic Approach to DNN Accelerator Evaluation](/index.php/publication/2019-03_timeloop-systematic-approach-dnn-accelerator-evaluation) [Angshuman Parashar](/index.php/person/angshuman-parashar), Priyanka Raina, Yakun Sophia Shao, Yu-Hsin Chen, Victor A. Ying, Anurag Mukkara, [Rangharajan Venkatesan](/index.php/person/rangharajan-venkatesan), [Brucek Khailany](/index.php/person/brucek-khailany), [Steve Keckler](/index.php/person/stephen-keckler), [Joel Emer](/index.php/person/joel-emer) [International Symposium on Performance Analysis of Systems and Software (ISPASS)](https://ieeexplore.ieee.org/document/8695666) [Throughput-oriented GPU memory allocation](/publication/2019-02_throughput-oriented-gpu-memory-allocation) [Isaac Gelado](/person/isaac-gelado), [Michael Garland](/person/michael-garland) [Proceedings of the 24th Symposium on Principles and Practice of Parallel Progra…](https://dl.acm.org/citation.cfm?id=3295727) ### 2018 [Optimizing Software-Directed Instruction Replication for GPU Error Detection ](/publication/2018-11_optimizing-software-directed-instruction-replication-gpu-error-detection) Abdulrahman Mahmoud, [Siva Hari](/person/siva-hari), [Michael B. Sullivan](/person/mike-sullivan), Timothy Tsai, [Steve Keckler](/person/stephen-keckler) [ International Conference for High-Performance Computing, Networking, Storage a…](https://dl.acm.org/doi/10.5555/3291656.3291746) [Dynamic Tracing: Memoization of Task Graphs for Dynamic Task-based Runtimes](/publication/2018-11_dynamic-tracing-memoization-task-graphs-dynamic-task-based-runtimes) Wonchan Lee, Elliott Slaughter, [Michael Bauer](/person/mike-bauer), Sean Treichler, Todd Warszawski, [Michael Garland](/person/michael-garland), Alex Aiken [International Conference for High Performance Computing and Communications (SC'…](https://dl.acm.org/doi/10.5555/3291656.3291702) [Slang: Language Mechanisms for Extensible Real-time Shading Systems](/index.php/publication/2018-08_slang-language-mechanisms-extensible-real-time-shading-systems) Yong He, Theresa Foley, Kayvon Fatahalian [Proceedings of ACM SIGGRAPH 2018](https://dl.acm.org/doi/10.1145/3197517.3201380) [Isometry: A Path-Based Distributed Data Transfer System](/index.php/publication/2018-06_isometry-path-based-distributed-data-transfer-system) Zhihao Jia, Sean Treichler, Galen Shipman, Patrick McCormick, Alex Aiken [International Conference on Supercomputing (ICS)](https://dl.acm.org/doi/abs/10.1145/3205289.3205301) [Scalable Collectives for Distributed Asynchronous Many-Task Runtimes](/publication/2018-05_scalable-collectives-distributed-asynchronous-many-task-runtimes) Matthew Whitlock, Hemanth Kolla, Sean Treichler, Philippe Pebay, Janine C. Bennett [International Parallel and Distributed Processing Symposium (IPDPS) - workshops](https://ieeexplore.ieee.org/document/8425445) [BabelFlow: An Embedded Domain Specific Language for Parallel Analysis and Visualization](/publication/2018-05_babelflow-embedded-domain-specific-language-parallel-analysis-and-visualization) Steve Petruzza, Sean Treichler, Valerio Pascucci, Peer-Timo Bremer [International Parallel and Distributed Processing Symposium (IPDPS)](https://ieeexplore.ieee.org/document/8425200) ### 2017 [Integrating External Resources with a Task-Based Programming Model](/publication/2017-12_integrating-external-resources-task-based-programming-model) Zhihao Jia, Sean Treichler, Galen Shipman, [Michael Bauer](/person/mike-bauer), Noah Watkins, Carlos Maltzahn, Patrick McCormick, Alex Aiken [International Conference on High Performance Computing (HiPC)](https://ieeexplore.ieee.org/document/8287762) [A Novel Shard-Based Approach for Asynchronous Many-Task Models for In Situ Analysis](/publication/2017-11_novel-shard-based-approach-asynchronous-many-task-models-situ-analysis) Philippe P. Pébaÿ, Giulio Borghesi, Hemanth Kolla, Janine C. Bennett, Sean Treichler [Workshop on In Situ Infrastructures on Enabling Extreme-Scale Analysis and Visu…](https://dl.acm.org/doi/10.1145/3144769.3144775) [Control Replication: Compiling Implicit Parallelism to Efficient SPMD with Logical Regions](/publication/2017-11_control-replication-compiling-implicit-parallelism-efficient-spmd-logical) Elliott Slaughter, Wonchan Lee, Sean Treichler, Wen Zhang, [Michael Bauer](/person/mike-bauer), Galen Shipman, Patrick McCormick, Alex Aiken [ International Conference for High Performance Computing and Communications (SC…](https://dl.acm.org/doi/10.1145/3126908.3126949) [Relaxations for High-Performance Message Passing on Massively Parallel SIMT Processors](/publication/2017-06_relaxations-high-performance-message-passing-massively-parallel-simt-processors) Benjamin Klenk, Holger Fröning, [Hans Eberle](/person/hans-eberle), [Larry Dennison](/person/larry-dennison) [32nd IEEE International Parallel and Distributed Processing](http://www.ipdps.org) Best Paper Award [Automated Synthesis of Comprehensive Memory Model Litmus Test Suites](/publication/2017-04_automated-synthesis-comprehensive-memory-model-litmus-test-suites) [Daniel Lustig](/person/daniel-lustig), Andrew Wright, Alexandros Papakonstantinou, Olivier Giroux [International Conference on Architectural Support for Programming Languages and…](https://dl.acm.org/doi/10.1145/3037697.3037723) [TriCheck: Memory Model Verification at the Trisection of Software, Hardware, and ISA](/publication/2017-04_tricheck-memory-model-verification-trisection-software-hardware-and-isa) Caroline Trippel, Yatin A. Manerkar, [Daniel Lustig](/person/daniel-lustig), [Michael Pellauer](/person/michael-pellauer), Margaret Martonosi [International Conference on Architectural Support for Programming Languages and…](https://dl.acm.org/doi/10.1145/3093336.3037719) IEEE Micro Top Picks in Computer Architecture ### 2016 [A System for Rapid Exploration of Shader Optimization Choices](/publication/2016-07_system-rapid-exploration-shader-optimization-choices) Yong He, Theresa Foley, Kayvon Fatahalian [Proceedings of ACM SIGGRAPH 2016](https://dl.acm.org/doi/10.1145/2897824.2925923) ### 2015 [MemcachedGPU: Scaling-up Scale-out Key-value Stores](/index.php/publication/2015-08_memcachedgpu-scaling-scale-out-key-value-stores) Tayler Hetherington, [Mike O'Connor](/index.php/person/mike-o-connor), Tor Aamodt [Sixth ACM Symposium on Cloud Computing (SoCC '15)](http://dl.acm.org/citation.cfm?id=2806836) [Flexible Software Profiling of GPU Architectures](/publication/2015-06_flexible-software-profiling-gpu-architectures) [Mark Stephenson](/person/mark-stephenson), [Siva Hari](/person/siva-hari), Yunsup Lee, Eiman Ebrahimi, Daniel Johnson, [David Nellans](/person/david-nellans), [Mike O'Connor](/person/mike-o-connor), [Steve Keckler](/person/stephen-keckler) [International Symposium on Computer Architecture (ISCA)](https://dl.acm.org/doi/10.1145/2749469.2750375) [Verification of Producer-Consumer Synchronization in GPU Programs](/index.php/publication/2015-06_verification-producer-consumer-synchronization-gpu-programs) [Michael Bauer](/index.php/person/mike-bauer), Rahul Sharma, Alex Aiken ### 2014 [Exploring the Design Space of SPMD Divergence Management on Data-Parallel Architectures](/publication/2014-12_exploring-design-space-spmd-divergence-management-data-parallel-architectures) Yunsup Lee, Vinod Grover, Ronny Krashinsky, [Mark Stephenson](/person/mark-stephenson), [Steve Keckler](/person/stephen-keckler), Krste Asanovic [International Symposium on Microarchitecture (MICRO)](https://doi.org/10.1109/MICRO.2014.48) [Scaling Irregular Applications through Data Aggregation and Software Multithreading](/index.php/publication/2014-05_scaling-irregular-applications-through-data-aggregation-and-software) Alessandro Morari, Antonino Tumeo, Daniel Chavarria-Miranda, Oreste Villa, Mateo Valero [International Parallel and Distributed Processing Symposium (IPDPS)](https://ieeexplore.ieee.org/document/6877341) ### 2013 [NOVA: A Functional Language for Data Parallelism](/publication/2013-07_nova-functional-language-data-parallelism) Alex Collins, Dominik Grewe, Vinod Grover, Sean Lee, Adriana Susnea [Convergence and Scalarization for Data-Parallel Architectures](/publication/2013-02_convergence-and-scalarization-data-parallel-architectures) Yunsup Lee, Ronny Krashinsky, Vinod Grover, [Steve Keckler](/person/stephen-keckler), Krste Asanovic [International Symposium on Code Generation and Optimization (CGO)](https://ieeexplore.ieee.org/document/6494995) ### 2012 [Policy-based Tuning for Performance Portability and Library Co-optimization](/publication/2012-05_policy-based-tuning-performance-portability-and-library-co-optimization) [Duane Merrill](/person/duane-merrill%2520iii), [Michael Garland](/person/michael-garland), Andrew Grimshaw [Proc. Innovative Parallel Computing](http://innovativeparallel.org/) ### 2011 [Processing Device Arrays with C++ Metaprogramming](/publication/2011-09_processing-device-arrays-c-metaprogramming) Jonathan Cohen [GPU Computing Gems, Jade Edition, Edited by Wen-mei W. Hwu](http://mkp.com/news/3405) [Copperhead: Compiling an Embedded Data Parallel Language](/publication/2011-02_copperhead-compiling-embedded-data-parallel-language) Bryan Catanzaro, [Michael Garland](/person/michael-garland), Kurt Keutzer [16th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (…](http://ppopp11.ac.uma.es) ### 2010 [Programming Massively Parallel Processors: A Hands-on Approach](/publication/2010-01_programming-massively-parallel-processors-hands-approach) David Kirk, Wen-mei Hwu [Morgan Kauffman](http://is.gd/7bNYP) ### 2008 [Parallel Computing Experiences with CUDA](/index.php/publication/2008-08_parallel-computing-experiences-cuda) [Michael Garland](/index.php/person/michael-garland), Scott Le Grand, John Nickolls, Joshua Anderson, Jim Hardwick, Scott Morton, Everett Phillips, Yao Zhang, Vasily Volkov [IEEE Micro](http://www.computer.org/micro) [Scalable Parallel Programming with CUDA](/publication/2008-03_scalable-parallel-programming-cuda) John Nickolls, Ian Buck, [Michael Garland](/person/michael-garland), Kevin Skadron [Queue](http://queue.acm.org/) ### Researchers [Aamer Jaleel](/person/aamer-jaleel) [Aaron Lefohn](/index.php/person/aaron-lefohn) [Albert Sidelnik](/person/albert-sidelnik) [Andrei Alexandrescu](/person/andrei-alexandrescu) [Benjamin Klenk](/index.php/person/ben-klenk) [Cédric Augonnet](/person/cedric-augonnet) [Chaz Gouert](/index.php/person/chaz-gouert) [Conor Hoekstra](/person/conor-hoekstra) [Cris Cecka](/index.php/person/cris-cecka) [Daniel Lustig](/index.php/person/daniel-lustig) [David Nellans](/index.php/person/david-nellans) [Isaac Gelado](/index.php/person/isaac-gelado) [Jared Hoberock](/person/jared-hoberock) [Jean-Luc Watson](/person/jean-luc-watson) [Mark Kilgard](/person/mark-kilgard) [Mark Stephenson](/person/mark-stephenson) [Maryam Mehri Dehnavi](/index.php/person/maryam-mehri-dehnavi) [Melih Elibol](/person/melih-elibol) [Michael Garland](/person/michael-garland) [Michael Bauer](/person/mike-bauer) [Mohamed Tarek Ibn Ziad](/person/mohamed-tarek-ibn-ziad) [Nicolai Oswald](/person/nicolai-oswald) [Sai Bangaru](/person/sai-bangaru) [Sana Damani](/index.php/person/sana-damani) [Sean Baxter](/index.php/person/sean-baxter) [Simon Cooksey](/person/simon-cooksey) [Steven Dalton](/person/steven-dalton) [Vinu Joseph](/person/vinu-joseph) [William Dally](/index.php/person/william-dally) [Yaosheng Fu](/person/yaosheng-fu)