High Performance Computing

Associated Publications

2023

Legate Sparse: Distributed Sparse Computing in Python

Rohan Yadav, Wonchan Lee, Melih Elibol, Taylor Lee Patti, Manolis Papadakis, Michael Garland, Alex Aiken, Fredrik Kjolstad, Michael Bauer

Supercomputing

Neuralangelo: High-Fidelity Neural Surface Reconstruction

Zhaoshuo Li, Thomas Müller, Alex Evans, Russell H. Taylor, Mathias Unberath, Ming-Yu Liu, Chen-Hsuan Lin

CVPR

Visibility Algorithms for Dynamic Dependence Analysis and Distributed Coherence

Michael Bauer, Elliott Slaughter, Sean Treichler, Wonchan Lee, Michael Garland, Alex Aiken

PPoPP

Implementing Reinforcement Learning Datacenter Congestion Control in NVIDIA NICs

Benjamin Fuhrer, Yuval Shpigelman, Chen Tessler, Shie Mannor, Gal Chechik, Eitan Zahavy, Gal Dalal

CCGrid 2023

2022

Towards Precision-Aware Fault Tolerance Approaches for Mixed-Precision Applications

Bo Fang, Siva Hari, Timothy Tsai, Xinyi Li, Ganesh Gopalakrishnan, Ignacio Laguna, Kevin Barker, Ang Li

Workshop on Fault-Tolerance for HPC at Extreme Scale (FTXS)

Variable Bitrate Neural Fields

Towaki Takikawa, Alex Evans, Jonathan Tremblay, Thomas Müller, Morgan McGuire, Alec Jacobson, Sanja Fidler

ACM SIGGRAPH 2022 Conference Proceedings

Instant Neural Graphics Primitives with a Multiresolution Hash Encoding

Thomas Müller, Alex Evans, Christoph Schied, Alex Keller

ACM Transactions on Graphics (SIGGRAPH 2022)

Best Technical Paper, SIGGRAPH 2022, THE BEST INVENTIONS OF 2022, TIME

Ray/Ribbon Intersections

Alexander Reshetov

Proc. ACM Comput. Graph. Interact. Tech., Vol. 5, No. 3, July 2022.

GATSPI: GPU Accelerated Gate-Level Simulation for Power Improvement

Yanqing Zhang, Mark Ren, Akshay Sridharan, Brucek Khailany

2022 Design Automation Conference

2021

GPS: A Global Publish-Subscribe Model for Multi-GPU Memory Management

Harini Muthukrishnan, Daniel Lustig, David Nellans, Thomas Wenisch

International Symposium on Microarchitecture (MICRO)

Best Paper nominee, IEEE Micro Top Picks in Computer Architecture (Honorable Mention)

EMOGI: Efficient Memory-access for Out-of-memory Graph-traversal in GPUs

Seung Won Min, Vikram Sharma Mailthody, Zaid Qureshi, Jinjun Xiong, Eiman Ebrahimi, Wen-mei Hwu

Proceedings of the VLDB Endownment (VLDB)

Large Graph Convolutional Network Training with GPU-Oriented Data Communication Architecture

Seung Won Min, Kun Wu, Sitao Huang, Mert Hidayetoglu, Jinjun Xiong, Eiman Ebrahimi, Deming Chen, Wen-mei Hwu

Proceedings of the VLDB Endowment (VLDB)

Suraksha: A Quantitative AV Safety Evaluation Framework to Analyze Safety Implications of Perception Design Choices

Hengyu Zhao, Siva Hari, Timothy Tsai, Michael B. Sullivan, Steve Keckler, Jishen Zhao

Workshop on Safety and Security of Intelligent Vehicles (SSIV)

Efficient Multi-GPU Shared Memory via Automatic Optimization of Fine-Grained Transfers

Harini Muthukrishnan, David Nellans, Daniel Lustig, Jeffrey Fessler, Thomas Wenisch

International Symposium on Computer Architecture (ISCA)

Demystifying GPU Reliability: Comparing and Combining Beam Experiments, Fault Simulation, and Profiling

Fernando Fernandes dos Santos, Siva Hari, Pedro Martins Basso, Luigi Carro, Paolo Rech

IEEE International Parallel & Distributed Processing Symposium (IPDPS)

Learning Sparse Matrix Row Permutations for Efficient SpMM on GPU Architectures

Atefeh Mehrabi, Donghyuk Lee, Niladrish Chatterjee, Danial J. Sorin, Benjamin C. Lee, Mike O'Connor

International Symposium on Performance Analysis of Systems and Software (ISPASS)

Large Graph Convolutional Network Training with GPU-Oriented Data Communication Architecture

Seung Won Min, Kun Wu, Sitao Huang, Mert Hidayetoglu, Jinjun Xiong, Eiman Ebrahimi, Deming Chen, Wen-mei Hwu

ArXiv

Scaling Implicit Parallelism via Dynamic Control Replication

Michael Bauer, Wonchan Lee, Elliott Slaughter, Zhihao Jia, Mario Di Renzo, Manolis Papadakis, Galen Shipman, Patrick McCormick, Michael Garland, Alex Aiken

Principles and Practices of Parallel Programming (PPoPP)

2020

Accelerating Reinforcement Learning through GPU Atari Emulation

Iuri Frosio, Steven Dalton

Advances in Neural Information Processing Systems 33 (NeurIPS 2020)

Locality-Centric Data and Threadblock Management for Massive GPUs

Mahmoud Khairy, Vadim Nikiforov, David Nellans, Timothy G. Rogers

International Symposium on Microarchitecture (MICRO)

EMOGI: Efficient Memory-access for Out-of-memory Graph-traversal In GPUs

Seung Won Min, Vikram Sharma Mailthody, Zaid Qureshi, Jinjun Xiong, Eiman Ebrahimi, Wen-mei Hwu

arXiv

Buddy Compression: Enabling Larger Memory for Deep Learning and HPC Workloads on GPUs

Esha Chouske, Michael B. Sullivan, Mike O'Connor, Mattan Erez, Jeff Pool, David Nellans, Steve Keckler

International Symposium on Computer Architecture (ISCA)

An In-Network Architecture for Accelerating Shared-Memory Multiprocessor Collectives

Benjamin Klenk, Ted Jiang, Greg Thorson, Larry Dennison

International Symposium on Computer Architecture (ISCA)

NWChem: Past, Present, and Future

Edoardo Aprà, Many others, Oreste Villa, Many others

The Journal of Chemical Physics

2019

Near-Memory Data Transformation for Efficient Sparse Matrix Multi-Vector Multiplication

Daichi Fujiki, Niladrish Chatterjee, Donghyuk Lee, Mike O'Connor

International Conference for High-Performance Computing, Networking, Storage, a…

Highly-scalable, Physics-informed GANs for Learning Solutions of Stochastic PDEs

Liu Yang, Sean Treichler, Thorsten Kurth, Keno Fischer, David Barajas-Solano, Josh Romero, Valentin Churavy, Alexandre Tartakovsky, Michael Houston, Prabhat, George Karniadakis

arXiv

Exascale Deep Learning for Scientific Inverse Problems

Nouamane Laanait, Joshua Romero, Junqi Yin, M. Todd Young, Sean Treichler, Vitalii Starchenko, Albina Borisevich, Alex Sergeev, Michael Matheson

arXiv

Task Bench: A Parameterized Benchmark for Evaluating Parallel Runtime Performance

Elliott Slaughter, Wei Wu, Yuankun Fu, Legend Brandenburg, Nicolai Garcia, Wilhem Kautz, Emily Marx, Kaleb S. Morris, Qinglei Cao, George Bosilca, Seema Mirchandaney, Wonchan Lee, Sean Treichler, Patrick McCormick, Alex Aiken

arXiv

Optimizing Multi-GPU Parallelization Strategies for Deep Learning Training

Saptadeep Pal, Eiman Ebrahimi, Arslan Zulfiqar, Yaosheng Fu, Victor Zhang, Szymon Migacz, David Nellans, Puneet Gupta

arXiv

GPU-Accelerated Atari Emulation for Reinforcement Learning

Steven Dalton, Iuri Frosio, Michael Garland

Arxiv

GPU Snapshot: Checkpoint Offloading for GPU-Dense Systems

Kyushick Lee, Michael B. Sullivan, Siva Hari, Timothy Tsai, Steve Keckler, Mattan Erez

International Conference on Supercomputing

On the Trend of Resilience for GPU-Dense Systems

Kyushick Lee, Michael B. Sullivan, Siva Hari, Timothy Tsai, Steve Keckler, Mattan Erez

International Conference on Dependable Systems and Networks, Supplemental (DSN-…

Best of SELSE (Workshop on Silicon Errors in Logic - System Effects)

NVGaze: An Anatomically-Informed Dataset for Low-Latency, Near-Eye Gaze Estimation

Joohwan Kim, Michael Stengel, Alexander Majercik, Shalini De Mello, David Dunn, Samuli Laine, Morgan McGuire, David Luebke

ACM Conference on Human-Computer-Interaction (CHI) 2019

Buddy Compression: Enabling Larger Memory for Deep Learning and HPC Workloads on GPUs

Esha Choukse, Michael B. Sullivan, Mike O'Connor, Mattan Erez, Jeff Pool, David Nellans, Stephen W. Keckler

arXiv

DeLTA: GPU Performance Model for Deep Learning Applications with In-depth Memory System Traffic Analysis

Sangkug Lym, Donghyuk Lee, Mike O'Connor, Niladrish Chatterjee, Mattan Erez

arXiv

A Fast and Robust Method for Avoiding Self-Intersection

Carsten Wächter, Nikolaus Binder

Ray Tracing Gems

Massively Parallel Path Space Filtering

Nikolaus Binder, Sascha Fricke, Alex Keller

arXiv

Metaoptimization on a Distributed System for Deep Reinforcement Learning

Greg Heinrich, Iuri Frosio

Massively Parallel Construction of Radix Tree Forests for the Efficient Sampling of Discrete Probability Distributions

Nikolaus Binder, Alex Keller

arXiv

2018

Dynamic Tracing: Memoization of Task Graphs for Dynamic Task-based Runtimes

Wonchan Lee, Elliott Slaughter, Michael Bauer, Sean Treichler, Todd Warszawski, Michael Garland, Alex Aiken

International Conference for High Performance Computing and Communications (SC'…

Evaluating and Accelerating High-Fidelity Error Injection for HPC

Chun-Kai Chang, Sangkug Lym, Nicholas Kelly, Michael B. Sullivan, Mattan Erez

The International Conference on High Performance Computing, Networking, Storage…

Exascale Deep Learning for Climate Analytics

Thorsten Kurth, Sean Treichler, Joshua Romero, Mayur Mudigonda, Nathan Luehr, Everett Phillips, Ankur Mahesh, Michael Matheson, Jack Deslippe, Massimiliano Fatica, Prabhat, Michael Houston

International Conference for High Performance Computing and Communications (SC'…

Exploiting Idle Resources in a High-Radix Switch for Supplemental Storage

Matthias Blumrich, Ted Jiang, Larry Dennison

Proceedings of the International Conference for High Performance Computing, Net…

Fast, High Precision Ray/Fiber Intersection using Tight, Disjoint Bounding Volumes

Nikolaus Binder, Alex Keller

arXiv

Massively Parallel Stackless Ray Tracing of Catmull-Clark Subdivision Surfaces

Nikolaus Binder, Alex Keller

arXiv

Exascale Deep Learning for Climate Analytics

Thorsten Kurth, Sean Treichler, Joshua Romero, Mayur Mudigonda, Nathan Luehr, Everett Phillips, Ankur Mahesh, Michael Matheson, Jack Deslippe, Massimiliano Fatica, Prabhat, Michael Houston

arXiv

CRUM: Checkpoint-Restart Support for CUDA's Unified Memory

Rohan Garg, Apoorve Mohan, Michael B. Sullivan, Gene Cooperman

The International Conference on Cluster Computing (IEEE CLUSTER)

Phantom Ray-Hair Intersector

Alexander Reshetov, David Luebke

Proceedings of the ACM on Computer Graphics and Interactive Techniques

Hamartia: A Fast and Accurate Error Injection Framework

Chun-Kai Chang, Sangkug Lym, Nicholas Kelly, Michael B. Sullivan, Mattan Erez

The International Conference on Dependable Systems and Networks Workshops (DSN-…

Isometry: A Path-Based Distributed Data Transfer System

Zhihao Jia, Sean Treichler, Galen Shipman, Patrick McCormick, Alex Aiken