Research Areas

Algorithms and Numerical Methods

Associated Publications

2024

scene_synthesizer: A Python Library for Procedural Scene Generation in Robot Manipulation
Clemens Eppner, Adithya Murali, Caelan Garrett, Rowland O'Flaherty, Tucker Hermans, Wei Yang, Dieter Fox
The Journal of Open Source Software
Differentiable GPU-Parallelized Task and Motion Planning
William Shen, Caelan Garrett, Ankit Goyal, Tucker Hermans, Fabio Ramos
CoRL 2024 Workshop on Differentiable Optimization
Constructability-driven design of frame structures with state-space search methods
Yijiang Huang, Caelan Garrett, Caitlin Mueller
Automation in Construction
Conformer without Convolutions
Matthijs Van keirsbilck, Alex Keller
Interspeech 2024
Improving Hyperparameter Optimization with Checkpointed Model Weights
Nikhil Mehta, Jonathan Lorraine, Steve Masson, Ramanathan Arunachalam, Zaid Pervaiz Bhat, James Lucas, Arun George Zachariah
Arxiv

2023

Graph Metanetworks for Processing Diverse Neural Architectures
Derek Lim, Haggai Maron, Marc T. Law, Jonathan Lorraine, James Lucas
ICLR
Graph Neural Networks for Enhanced Decoding of Quantum LDPC Codes
Anqi Gong, Sebastian Cammerer, Joseph M. Renes
International Conference on Quantum Information Processing (QIP) 2024

2022

Graph Neural Networks for Channel Decoding
Sebastian Cammerer, Jakob Hoydis, Fayçal Aït Aoudia , Alex Keller
IEEE Globecom Workshops (GC Wkshps) 2022
Deep Learning-Based Synchronization for Uplink NB-IoT
Fayçal Aït Aoudia , Jakob Hoydis, Sebastian Cammerer, Matthijs Van keirsbilck, Alex Keller
IEEE Global Communications Conference 2022
Structural Pruning via Latency-Saliency Knapsack
Maying Shen, Hongxu Danny Yin, Pavlo Molchanov, Lei Mao, Jianna Liu, Jose M. Alvarez
NeurIPS 2022
From RTL to CUDA: A GPU Acceleration Flow for RTL Simulation with Batch Stimulus
Dian-Lun Lin, Haoxing (Mark) Ren, Yanqing Zhang, Brucek Khailany, Tsung-Wei Huang
51st International Conference on Parallel Processing (ICPP '22)
As-Locally-Uniform-as-Possible Reshaping of Vector Clip Art
Chrystiano Araujo, Nicholas Vining, Enrique Rosales, Giorgio Gori, Alla Sheffer
ACM Transactions on Graphics (SIGGRAPH 2022)
Variable Bitrate Neural Fields
Towaki Takikawa, Alex Evans, Jonathan Tremblay, Thomas Müller, Morgan McGuire, Alec Jacobson, Sanja Fidler
ACM SIGGRAPH 2022 Conference Proceedings
Unbiased Inverse Volume Rendering With Differential Trackers
Merlin Nimier-David, Thomas Müller, Alex Keller, Wenzel Jakob
ACM Transactions on Graphics (SIGGRAPH 2022)
Generalized Resampled Importance Sampling: Foundations of ReSTIR
Daqi Lin, Markus Kettunen, Benedikt Bitterli, Jacopo Pantaleoni, Cem Yuksel, Chris Wyman
ACM Transactions on Graphics (SIGGRAPH 2022)
Unbiased and consistent rendering using biased estimators
Zackary Misso, Benedikt Bitterli, Iliyan Georgiev, Wojciech Jarosz
ACM Transactions on Graphics (SIGGRAPH 2022)
Optimal Clipping and Magnitude-aware Differentiation for Improved Quantization-aware Training
Charbel Sakr, Steve Dai, Rangharajan Venkatesan, Brian Zimmer, Brucek Khailany, William Dally
2022 International Conference on Machine Learning (ICML)
Ray/Ribbon Intersections
Alexander Reshetov
Proc. ACM Comput. Graph. Interact. Tech., Vol. 5, No. 3, July 2022.
Adaptive Neural Network-based OFDM Receivers
Moritz Benedikt Fischer, Sebastian Dörner, Sebastian Cammerer, Takayuki Shimizu, Hongsheng Lu, Stephan ten Brink
IEEE International Workshop on Signal Processing Advances in Wireless Communic…
Onesweep: A Faster Least Significant Digit Radix Sort for GPUs
Andrey Adinets, Duane Merrill
arXiv
MatBuilder: Mastering Sampling Uniformity Over Projections
Loïs Paulin, Nicolas Bonneel, David Coeurjolly, Jean-Claude Iehl, Alex Keller, Victor Ostromoukhov
ACM Transactions on Graphics (SIGGRAPH 2022)
Artificial Neural Networks generated by Low Discrepancy Sequences
Matthijs Van keirsbilck, Alex Keller
arxiv link
Sionna: An Open-Source Library for Next-Generation Physical Layer Research
Jakob Hoydis, Sebastian Cammerer, Fayçal Aït Aoudia , Avinash Vem, Nikolaus Binder, Guillermo Marcus, Alex Keller
arXiv
Generic Lithography Modeling with Dual-band Optics-Inspired Neural Networks
Haoyu Yang, Zongyi Li, Kumara Sastry, Saumyadip Mukhopadhyay, Mark Kilgard, Anima Anandkumar, Brucek Khailany, Vivek Singh, Haoxing (Mark) Ren
2022 Design Automation Conference

2021

Path Guiding Using Spatio-Directional Mixture Models
Ana Dodik, Marios Papas, Cengiz Öztireli, Thomas Müller
Computer Graphics Forum
Graph Learning-Based Arithmetic Block Identification
Zhuolun He, Ziyi Wang, Chen Bai, Haoyu Yang, Bei Yu
IEEE/ACM International Conference on Computer-Aided Design
Compressing 1D Time-Channel Separable Convolutions using Sparse Random Ternary Matrices
Goncalo Mordido, Matthijs Van keirsbilck, Alex Keller
Interspeech 2021
Alternative Paths Planner (APP) for Provably Fixed-time Manipulation Planning in Semi-structured Environments
Fahad Islam, Chris Paxton, Clemens Eppner, Bryan Peele, Maxim Likhachev, Dieter Fox
2021 IEEE International Conference on Robotics and Automation (ICRA)

2020

Understanding SSIM
Jim Nilsson, Tomas Akenine-Möller
arXiv
DREAMPlace: Deep Learning Toolkit-Enabled GPU Acceleration for Modern VLSI Placement
Yibo Lin, Zixuan Jiang, Jiaqi Gu, Wuxi Li, Shounak Dhar, Haoxing (Mark) Ren, Brucek Khailany, David Z. Pan
IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (…
2021 IEEE Transactions on Computer-Aided Design Donald O. Pederson Best Paper Award
Monte Carlo Gradient Quantization
Goncalo Mordido, Matthijs Van keirsbilck, Alex Keller
CVPR2020 Workshop
ABCDPlace: Accelerated Batch-based Concurrent Detailed Placement on Multi-threaded CPUs and GPUs
Yibo Lin, Wuxi Li, Jiaqi Gu, Haoxing (Mark) Ren, Brucek Khailany, David Z. Pan
IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (…

2019

Instant Quantization of neural networks using Monte Carlo Methods
Gonçalo Mordido, Matthijs Van keirsbilck, Alex Keller
NeurIPS 2019 EMC2 workshop (IEEExplore)
DREAMPlace: Deep Learning Toolkit-Enabled GPU Acceleration for Modern VLSI Placement
Yibo Lin, Shounak Dhar, Wuxi Li, Haoxing (Mark) Ren, Brucek Khailany, David Z. Pan
Design Automation Conference (DAC) 2019
DAC 2019 Best Paper Award
Dynamic Diffuse Global Illumination with Ray-Traced Irradiance Fields
Zander Majercik, Jean-Philippe Guertin, Derek Nowrouzezahrai, Morgan McGuire
Journal of Computer Graphics Techniques
Cool Patches: A Geometric Approach to Ray/Bilinear Patch Intersections
Alexander Reshetov
Ray Tracing Gems
Rethinking full connectivity in recurrent neural networks
Matthijs Van keirsbilck, Alex Keller, Xiaodong Yang
arxiv paper
A Fast and Robust Method for Avoiding Self-Intersection
Carsten Wächter, Nikolaus Binder
Ray Tracing Gems
Massively Parallel Path Space Filtering
Nikolaus Binder, Sascha Fricke, Alex Keller
arXiv
Massively Parallel Construction of Radix Tree Forests for the Efficient Sampling of Discrete Probability Distributions
Nikolaus Binder, Alex Keller
arXiv

2018

Fast, High Precision Ray/Fiber Intersection using Tight, Disjoint Bounding Volumes
Nikolaus Binder, Alex Keller
arXiv
Massively Parallel Stackless Ray Tracing of Catmull-Clark Subdivision Surfaces
Nikolaus Binder, Alex Keller
arXiv
Machine Learning and Rendering
Alex Keller, Jaroslav Křivánek, Jan Novák, Anton Kaplanyan, Marco Salvi
ACM SIGGRAPH 2018 Courses
Phantom Ray-Hair Intersector
Alexander Reshetov, David Luebke
Proceedings of the ACM on Computer Graphics and Interactive Techniques

2017

Parallel Complexity of Forward and Backward Propagation
Maxim Naumov
arXiv:1712.06577 [cs.LG]
Integral Equations and Machine Learning
Alex Keller, Ken Dahm
Mathematics and Computers in Simulation, Volume 161, July 2019, Pages 2-12
AdaBatch: Adaptive Batch Sizes for Training Deep Neural Networks
Aditya Devarakonda, Maxim Naumov, Michael Garland
arXiv:1712.02029 [cs.LG]
Near-eye Light Field Holographic Rendering with Spherical Waves for Wide Field of View Interactive 3D Computer Graphics
Liang Shi, Fu-Chung Huang, Ward Lopes, Wojciech Matusik, David Luebke
ACM SIGGRAPH ASIA 2017
Parallel Jaccard and Related Graph Clustering Techniques
Alexandre Fender, Nahid Emad, Serge Petiton, Joe Eaton, Maxim Naumov
Proceedings of the 8th Workshop on Latest Advances in Scalable Algorithms for L…
Low Communication FMM-Accelerated FFT on GPUs
Cris Cecka
The International Conference for High Performance Computing, Networking, Storag…
Exploiting Budan-Fourier and Vincent’s Theorems for Ray Tracing 3D Bézier Curves
Alexander Reshetov
High-Performance Graphics 2017
Spatiotemporal Variance-Guided Filtering: Real-Time Reconstruction for Path-Traced Global Illumination
Christoph Schied, Anton Kaplanyan, Chris Wyman, Anjul Patney, Chakravarty R. Alla Chaitanya, John Burgess, Shiqiu Liu, Carsten Dachsbacher, Aaron Lefohn, Marco Salvi
Proceedings of High Performance Graphics 2017
Generating stratified random lines in a square
Peter Shirley, Chris Wyman
Journal of Computer Graphics Techniques
Parallel Modularity Clustering
Alexandre Fender, Nahid Emad, Serge Petiton, Maxim Naumov
Procedia Computer Science (Elsevier)
The Iray Light Transport Simulation and Rendering System
Alex Keller, Carsten Wächter, Matthias Raab, Daniel Seibert, Dietger van Antwerpen, Johann Korndörfer, Lutz Kettner
arXiv
Learning Light Transport the Reinforced Way
Ken Dahm, Alex Keller
arXiv

2016

GI next: global illumination for production rendering on GPUs
Enzo Catalano, Rajko Yasui-Schöffel , Ken Dahm, Nikolaus Binder, Alex Keller
ACM SIGGRAPH 2016 Talks
Exploring and Expanding the Continuum of OIT Algorithms
Chris Wyman
High Performance Graphics 2016
Efficient stackless hierarchy traversal on GPUs with backtracking in constant time
Nikolaus Binder, Alex Keller
Proceedings of High Performance Graphics
Hybrid Modulation for Near Zero Display Latency
Trey Greer, Josef Spjut, David Luebke, Turner Whitted
S-Step and Communication-Avoiding Iterative Methods
Maxim Naumov
Technical Report NVR-2016-003
Single-pass Parallel Prefix Scan with Decoupled Look-back
Duane Merrill, Michael Garland
Parallel Spectral Graph Partitioning
Maxim Naumov, Timothy Moon
Technical Report NVR-2016-001

2015

AmgX: A Library for GPU Accelerated Algebraic Multigrid and Preconditioned Iterative Methods
Maxim Naumov, Marat Arsaev, Patrice Castonguay, Jonathan Cohen, Julien Demouth, Joe Eaton, Simon Layton, Nikolay Markovskiy, Istvan Reguly, Nikolai Sakharnykh, Vijay Sellappan, Robert Strzodka
SIAM Journal on Scientific Computing (SISC)
Stackless ray tracing of patches from feature-adaptive subdivision on GPUs
Nikolaus Binder, Alex Keller
ACM SIGGRAPH 2015 Talks
Parallel Graph Coloring with Applications to the Incomplete-LU Factorization on the GPU
Maxim Naumov, Patrice Castonguay, Jonathan Cohen
Technical Report NVR-2015-001

2014

Path space filtering
Alex Keller, Ken Dahm, Nikolaus Binder
ACM SIGGRAPH 2014 Talks
Path space similarity determined by Fourier histogram descriptors
Pascal Gautron, Marc Droske, Carsten Wächter, Lutz Kettner, Alex Keller, Nikolaus Binder, Ken Dahm
ACM SIGGRAPH 2014 Talks
A unistable polyhedron with 14 faces
Alexander Reshetov
International Journal of Computational Geometry & Applications
A Decomposition for In-place Array Transposition
Bryan Catanzaro, Alex Keller, Michael Garland
PPoPP 2014

2013

Deterministic Consistent Density Estimation for Light Transport Simulation
Alex Keller, Nikolaus Binder
Monte Carlo and Quasi-Monte Carlo Methods 2012
A Parallel Auxiliary Grid Algebraic Multigrid Method for Graphic Processing Units
Lu Wang, Xiaozhe Hu, Jonathan Cohen, Jinchao Xu
SIAM J. Scientific Computing 35(3)

2012

Preconditioned Block-Iterative Methods on GPUs
Maxim Naumov
Proceedings in Applied Mathematics and Mechanics
Relational Algorithms for Multi-Bulk-Synchronous Processors
Greg Diamos, Haicheng Wu, Ashwin Lele, Jin Wang, Sudhakar Yalamanchili
NVIDIA Tech Report
Incomplete-LU and Cholesky Factorization in the Preconditioned Iterative Methods on the GPU
Maxim Naumov
Technical Report NVR-2012-003
Efficient Parallel Merge Sort for Fixed and Variable Length Keys
Andrew Davidson, David Tarjan, Michael Garland, John Owens
Proc. Innovative Parallel Computing
Policy-based Tuning for Performance Portability and Library Co-optimization
Duane Merrill, Michael Garland, Andrew Grimshaw
Proc. Innovative Parallel Computing

2011

A Hybrid Method for Solving Tridiagonal Systems on the GPU
Yao Zhang, Jonathan Cohen, Andrew A. Davidson, John Owens
GPU Computing Gems, Jade Edition, Edited by Wen-mei W. Hwu
Exposing Fine-Grained Parallelism in Algebraic Multigrid Methods
Nathan Bell, Steven Dalton, Luke Olson
NVIDIA Technical Report NVR-2011-002
Parallel Solution of Sparse Triangular Linear Systems in the Preconditioned Iterative Methods on the GPU
Maxim Naumov
Technical Report NVR-2011-001

2010

Sparse Matrix-Vector Multiplication on Multicore and Accelerators
Sam Williams, Nathan Bell, Jee Whan Choi, Michael Garland, Leonid Oliker, Richard Vuduc
Scientific Computing on Multicore and Accelerators
Fast Tridiagonal Solvers on the GPU
Yao Zhang, Jonathan Cohen, John Owens
15th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (…

2009

Implementing Sparse Matrix-Vector Multiplication on Throughput-Oriented Processors
Nathan Bell, Michael Garland
Proc. Supercomputing '09
Solving Computational Problems with GPU Computing
Jonathan Cohen, Michael Garland
Computing in Science and Engineering
Designing Efficient Sorting Algorithms for Manycore GPUs
Nadathur Satish, Mark Harris, Michael Garland
Proc. IEEE International Symposium on Parallel & Distributed Processing
Fast BVH Construction on GPUs
Christian Lauterbach, Michael Garland, Shubhabrata Sengupta, David Luebke, Dinesh Manocha
Proc. Eurographics 2009

2008

Efficient Sparse Matrix-Vector Multiplication on CUDA
Nathan Bell, Michael Garland
NVIDIA Technical Report NVR-2008-004
Efficient Parallel Scan Algorithms for GPUs
Shubhabrata Sengupta, Mark Harris, Michael Garland
NVIDIA Technical Report NVR-2008-003
On the Visualization of Social and Other Scale-Free Networks
Yuntao Jia, Jared Hoberock, Michael Garland, John C. Hart
Proc. Infovis 2008
Rapid Multipole Graph Drawing on the GPU
Apeksha Godiyal, Jared Hoberock, Michael Garland, John C. Hart
Proc. Graph Drawing 2008

2007

Iterative Methods for Improving Mesh Parameterizations
Shen Dong, Michael Garland
IEEE Shape Modeling International 2007

Researchers

Alex Keller
Andrei Alexandrescu
Boris Bonev
Chia-Tung (Mark) Ho
Dale Durran
Eli Meirom
Fayçal Aït Aoudia
Guillermo Marcus
Haoyu Yang
Heng Yang
Hongxu Danny Yin
Hugo Hadfield
Jakob Hoydis
Jiaojiao Fan
Marco Salvi
Markus Kettunen
Matthijs Van keirsbilck
Michael Garland
Michael Stengel
Mike Sullivan
Nikolaus Binder
Pavlo Molchanov
Samuli Laine
Sebastian Cammerer
Steven Dalton
Thomas Müller
Tobias Zirr
Vinu Joseph
Yi-Chen Lu