Algorithms and Numerical Methods

Associated Publications

2025

Boris Bonev, Max Rietmann, Andrea Paris, Alberto Carpentieri, Thorsten Kurth

https://neurips.cc/virtual/2025/poster/117783

Augmenting Simulated Noisy Quantum Data Collection by Orders of Magnitude Using Pre-Trajectory Sampling with Batched Execution

Taylor Patti, Thien Nguyen, Justin Lietz, Alex McCaskey, Brucek Khailany

https://arxiv.org/abs/2504.16297

Isaac Lab: A GPU Accelerated Simulation Framework For Multi-Modal Robot Learning

Mayank Mittal, Kelly Guo, Gavriel State, Spencer Huang

Huge ensembles–Part 1: Design of ensemble weather forecasts using spherical Fourier neural operators

Ankur Mahesh, William D. Collins, Boris Bonev, Noah Brenowitz, Yair Cohen, Joshua Elms, Peter Harrington, Karthik Kashinath, Thorsten Kurth, Joshua North, Travis O'Brian, Mike Pritchard, David Pruitt, Mark Risser, Shashank Subramanian, Jared Willard

GMD Publication

Huge ensembles – Part 2: Properties of a huge ensemble of hindcasts generated with spherical Fourier neural operators

Ankur Mahesh, William D. Collins, Boris Bonev, Noah Brenowitz, Yair Cohen, Peter Harrington, Karthik Kashinath, Thorsten Kurth, Joshua North, Travis O'Brian, Mike Pritchard, David Pruitt, Mark Risser, Shashank Subramanian, Jared Willard

GMD Publication

FourCastNet 3: A geometric approach to probabilistic machine-learning weather forecasting at scale

Boris Bonev, Thorsten Kurth, Ankur Mahesh, Mauro Bisson, Jean Kossaifi, Karthik Kashinath, Anima Anandkumar, William D. Collins, Mike Pritchard, Alex Keller

Helix Parallelism: Rethinking Sharding Strategies for Interactive Multi-Million-Token LLM Decoding

Nidhi Bhatia, Ankit More, Ritika Borkar, Tiyasa Mitra, Ramon Matas, Ritchie Zhao, Maximilian Golub, Dheevatsa Mudigere, Brian Pharris, Bita Darvish Rouhani

Adaptive Algebraic Reuse of Reordering in Cholesky Factorizations with Dynamic Sparsity Patterns

Behrooz Zarebavani, Danny Kaufman, David Levin, Maryam Mehri Dehnavi

SIGGRAPH 2025

Sionna RT: Technical Report

Fayçal Aït Aoudia , Jakob Hoydis, Merlin Nimier-David, Sebastian Cammerer, Alex Keller

https://arxiv.org/abs/2504.21719

scene_synthesizer: A Python Library for Procedural Scene Generation in Robot Manipulation

Clemens Eppner, Adithya Murali, Caelan Garrett, Rowland O'Flaherty, Tucker Hermans, Wei Yang, Dieter Fox

The Journal of Open Source Software

Towards large-scale quantum optimization solvers with few qubits

Marco Sciorilli, Lucas Borges, Taylor Patti, Diego Garcia-Martin, Giancarlo Camilo, Anima Anandkumar, Leandro Aolita

2024

Pretraining codomain attention neural operators for solving multiphysics pdes

Md Ashiqur Rahman, Robert Joseph George, Mogab Elleithy, Daniel Leibovici, Zongyi Li, Boris Bonev, Colin White, Julius Berner, Raymond A. Yeh, Jean Kossaifi, Kamyar Azizzadenesheli, Anima Anandkumar

NeurIPS Proceedings

Differentiable GPU-Parallelized Task and Motion Planning

William Shen, Caelan Garrett, Nishanth Kumar, Ankit Goyal, Tucker Hermans, Leslie Pack Kaelbling, Tomás Lozano-Pérez, Fabio Ramos

Robotics: Science and Systems

Constructability-driven design of frame structures with state-space search methods

Yijiang Huang, Caelan Garrett, Caitlin Mueller

Automation in Construction

Conformer without Convolutions

Matthijs Van keirsbilck, Alex Keller

Interspeech 2024

Zero and Finite Temperature Quantum Simulations Powered by Quantum Magic

Andi Gu, Hong-Ye Hu, Di Luo, Taylor Patti, Nicholas C. Rubin, Susanne F. Yelin

https://quantum-journal.org/papers/q-2024-07-23-1422/

Neural operators with localized integral and differential kernels

Miguel Liu-Schiaffini, Julius Berner, Boris Bonev, Thorsten Kurth, Kamyar Azizzadenesheli, Anima Anandkumar

arXiv link

Improving Hyperparameter Optimization with Checkpointed Model Weights

Nikhil Mehta, Jonathan Lorraine, Steve Masson, Ramanathan Arunachalam, Zaid Pervaiz Bhat, James Lucas, Arun George Zachariah

Arxiv

Near-term distributed quantum computation using mean-field corrections and auxiliary qubits

Abigail McClain-Gomez, Taylor Patti, Anima Anandkumar, Susanne F. Yelin

https://iopscience.iop.org/article/10.1088/2058-9565/ad3f45/meta

2023

Compact Neural Graphics Primitives with Learned Hash Probing

Towaki Takikawa, Thomas Müller, Merlin Nimier-David, Alex Evans, Sanja Fidler, Alec Jacobson, Alex Keller

SIGGRAPH Asia 2023

Graph Metanetworks for Processing Diverse Neural Architectures

Derek Lim, Haggai Maron, Marc T. Law, Jonathan Lorraine, James Lucas

ICLR

Graph Neural Networks for Enhanced Decoding of Quantum LDPC Codes

Anqi Gong, Sebastian Cammerer, Joseph M. Renes

International Conference on Quantum Information Processing (QIP) 2024

Spherical Fourier Neural Operators: Learning Stable Dynamics on the Sphere

Boris Bonev, Thorsten Kurth, Christian Hundt, Jaideep Pathak, Maximilian Baust, Karthik Kashinath, Anima Anandkumar

PDF

2022

Deep Learning-Based Synchronization for Uplink NB-IoT

Fayçal Aït Aoudia , Jakob Hoydis, Sebastian Cammerer, Matthijs Van keirsbilck, Alex Keller

IEEE Global Communications Conference 2022

Graph Neural Networks for Channel Decoding

Sebastian Cammerer, Jakob Hoydis, Fayçal Aït Aoudia , Alex Keller

IEEE Globecom Workshops (GC Wkshps) 2022

Structural Pruning via Latency-Saliency Knapsack

Maying Shen, Hongxu Danny Yin, Pavlo Molchanov, Lei Mao, Jianna Liu, Jose M. Alvarez

NeurIPS 2022

From RTL to CUDA: A GPU Acceleration Flow for RTL Simulation with Batch Stimulus

Dian-Lun Lin, Mark Haoxing Ren, Yanqing Zhang, Brucek Khailany, Tsung-Wei Huang

51st International Conference on Parallel Processing (ICPP '22)

As-Locally-Uniform-as-Possible Reshaping of Vector Clip Art

Chrystiano Araujo, Nicholas Vining, Enrique Rosales, Giorgio Gori, Alla Sheffer

ACM Transactions on Graphics (SIGGRAPH 2022)

Variable Bitrate Neural Fields

Towaki Takikawa, Alex Evans, Jonathan Tremblay, Thomas Müller, Morgan McGuire, Alec Jacobson, Sanja Fidler

ACM SIGGRAPH 2022 Conference Proceedings

Unbiased Inverse Volume Rendering With Differential Trackers

Merlin Nimier-David, Thomas Müller, Alex Keller, Wenzel Jakob

ACM Transactions on Graphics (SIGGRAPH 2022)

Generalized Resampled Importance Sampling: Foundations of ReSTIR

Daqi Lin, Markus Kettunen, Benedikt Bitterli, Jacopo Pantaleoni, Cem Yuksel, Chris Wyman

ACM Transactions on Graphics (SIGGRAPH 2022)

Unbiased and consistent rendering using biased estimators

Zackary Misso, Benedikt Bitterli, Iliyan Georgiev, Wojciech Jarosz

ACM Transactions on Graphics (SIGGRAPH 2022)

Optimal Clipping and Magnitude-aware Differentiation for Improved Quantization-aware Training

Charbel Sakr, Steve Dai, Rangharajan Venkatesan, Brian Zimmer, Brucek Khailany, William Dally

2022 International Conference on Machine Learning (ICML)

Ray/Ribbon Intersections

Alexander Reshetov

Proc. ACM Comput. Graph. Interact. Tech., Vol. 5, No. 3, July 2022.

Adaptive Neural Network-based OFDM Receivers

Moritz Benedikt Fischer, Sebastian Dörner, Sebastian Cammerer, Takayuki Shimizu, Hongsheng Lu, Stephan ten Brink

IEEE International Workshop on Signal Processing Advances in Wireless Communic…

Onesweep: A Faster Least Significant Digit Radix Sort for GPUs

Andrey Adinets, Duane Merrill

arXiv

MatBuilder: Mastering Sampling Uniformity Over Projections

Loïs Paulin, Nicolas Bonneel, David Coeurjolly, Jean-Claude Iehl, Alex Keller, Victor Ostromoukhov

ACM Transactions on Graphics (SIGGRAPH 2022)

Artificial Neural Networks generated by Low Discrepancy Sequences

Matthijs Van keirsbilck, Alex Keller

arxiv link

Sionna: An Open-Source Library for Next-Generation Physical Layer Research

Jakob Hoydis, Sebastian Cammerer, Fayçal Aït Aoudia , Avinash Vem, Nikolaus Binder, Guillermo Marcus, Alex Keller

arXiv

Generic Lithography Modeling with Dual-band Optics-Inspired Neural Networks

Haoyu Yang, Zongyi Li, Kumara Sastry, Saumyadip Mukhopadhyay, Mark Kilgard, Anima Anandkumar, Brucek Khailany, Vivek Singh, Mark Haoxing Ren

2022 Design Automation Conference

2021

Path Guiding Using Spatio-Directional Mixture Models

Ana Dodik, Marios Papas, Cengiz Öztireli, Thomas Müller

Computer Graphics Forum

Graph Learning-Based Arithmetic Block Identification

Zhuolun He, Ziyi Wang, Chen Bai, Haoyu Yang, Bei Yu

IEEE/ACM International Conference on Computer-Aided Design

Compressing 1D Time-Channel Separable Convolutions using Sparse Random Ternary Matrices

Goncalo Mordido, Matthijs Van keirsbilck, Alex Keller

Interspeech 2021

Alternative Paths Planner (APP) for Provably Fixed-time Manipulation Planning in Semi-structured Environments

Fahad Islam, Chris Paxton, Clemens Eppner, Bryan Peele, Maxim Likhachev, Dieter Fox

2021 IEEE International Conference on Robotics and Automation (ICRA)

2020

Understanding SSIM

Jim Nilsson, Tomas Akenine-Möller

arXiv

DREAMPlace: Deep Learning Toolkit-Enabled GPU Acceleration for Modern VLSI Placement

Yibo Lin, Zixuan Jiang, Jiaqi Gu, Wuxi Li, Shounak Dhar, Mark Haoxing Ren, Brucek Khailany, David Z. Pan

IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (…

2021 IEEE Transactions on Computer-Aided Design Donald O. Pederson Best Paper Award

Monte Carlo Gradient Quantization

Goncalo Mordido, Matthijs Van keirsbilck, Alex Keller

CVPR2020 Workshop

ABCDPlace: Accelerated Batch-based Concurrent Detailed Placement on Multi-threaded CPUs and GPUs

Yibo Lin, Wuxi Li, Jiaqi Gu, Mark Haoxing Ren, Brucek Khailany, David Z. Pan

IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (…

2019

Instant Quantization of neural networks using Monte Carlo Methods

Gonçalo Mordido, Matthijs Van keirsbilck, Alex Keller

NeurIPS 2019 EMC2 workshop (IEEExplore)

DREAMPlace: Deep Learning Toolkit-Enabled GPU Acceleration for Modern VLSI Placement

Yibo Lin, Shounak Dhar, Wuxi Li, Mark Haoxing Ren, Brucek Khailany, David Z. Pan

Design Automation Conference (DAC) 2019

DAC 2019 Best Paper Award

Dynamic Diffuse Global Illumination with Ray-Traced Irradiance Fields

Zander Majercik, Jean-Philippe Guertin, Derek Nowrouzezahrai, Morgan McGuire

Journal of Computer Graphics Techniques

Cool Patches: A Geometric Approach to Ray/Bilinear Patch Intersections

Alexander Reshetov

Ray Tracing Gems

Rethinking full connectivity in recurrent neural networks

Matthijs Van keirsbilck, Alex Keller, Xiaodong Yang

arxiv paper

A Fast and Robust Method for Avoiding Self-Intersection

Carsten Wächter, Nikolaus Binder

Ray Tracing Gems

Massively Parallel Path Space Filtering

Nikolaus Binder, Sascha Fricke, Alex Keller

arXiv

Massively Parallel Construction of Radix Tree Forests for the Efficient Sampling of Discrete Probability Distributions

Nikolaus Binder, Alex Keller

arXiv

2018

Fast, High Precision Ray/Fiber Intersection using Tight, Disjoint Bounding Volumes

Nikolaus Binder, Alex Keller

arXiv

Massively Parallel Stackless Ray Tracing of Catmull-Clark Subdivision Surfaces

Nikolaus Binder, Alex Keller

arXiv

Machine Learning and Rendering

Alex Keller, Jaroslav Křivánek, Jan Novák, Anton Kaplanyan, Marco Salvi

ACM SIGGRAPH 2018 Courses

Phantom Ray-Hair Intersector

Alexander Reshetov, David Luebke

Proceedings of the ACM on Computer Graphics and Interactive Techniques

2017

Parallel Complexity of Forward and Backward Propagation

Maxim Naumov

arXiv:1712.06577 [cs.LG]

Integral Equations and Machine Learning

Alex Keller, Ken Dahm

Mathematics and Computers in Simulation, Volume 161, July 2019, Pages 2-12

AdaBatch: Adaptive Batch Sizes for Training Deep Neural Networks

Aditya Devarakonda, Maxim Naumov, Michael Garland

arXiv:1712.02029 [cs.LG]

Near-eye Light Field Holographic Rendering with Spherical Waves for Wide Field of View Interactive 3D Computer Graphics

Liang Shi, Fu-Chung Huang, Ward Lopes, Wojciech Matusik, David Luebke

ACM SIGGRAPH ASIA 2017

Parallel Jaccard and Related Graph Clustering Techniques

Alexandre Fender, Nahid Emad, Serge Petiton, Joe Eaton, Maxim Naumov

Proceedings of the 8th Workshop on Latest Advances in Scalable Algorithms for L…

Low Communication FMM-Accelerated FFT on GPUs

Cris Cecka

The International Conference for High Performance Computing, Networking, Storag…

Spatiotemporal Variance-Guided Filtering: Real-Time Reconstruction for Path-Traced Global Illumination

Christoph Schied, Anton Kaplanyan, Chris Wyman, Anjul Patney, Chakravarty R. Alla Chaitanya, John Burgess, Shiqiu Liu, Carsten Dachsbacher, Aaron Lefohn, Marco Salvi

Proceedings of High Performance Graphics 2017

Exploiting Budan-Fourier and Vincent’s Theorems for Ray Tracing 3D Bézier Curves

Alexander Reshetov

High-Performance Graphics 2017

Generating stratified random lines in a square

Peter Shirley, Chris Wyman

Journal of Computer Graphics Techniques

Parallel Modularity Clustering

Alexandre Fender, Nahid Emad, Serge Petiton, Maxim Naumov

Procedia Computer Science (Elsevier)

The Iray Light Transport Simulation and Rendering System

Alex Keller, Carsten Wächter, Matthias Raab, Daniel Seibert, Dietger van Antwerpen, Johann Korndörfer, Lutz Kettner

arXiv

Learning Light Transport the Reinforced Way

Ken Dahm, Alex Keller

arXiv

2016

GI next: global illumination for production rendering on GPUs

Enzo Catalano, Rajko Yasui-Schöffel , Ken Dahm, Nikolaus Binder, Alex Keller

ACM SIGGRAPH 2016 Talks

Efficient stackless hierarchy traversal on GPUs with backtracking in constant time

Nikolaus Binder, Alex Keller

Proceedings of High Performance Graphics

Exploring and Expanding the Continuum of OIT Algorithms

Chris Wyman

High Performance Graphics 2016

Hybrid Modulation for Near Zero Display Latency

Trey Greer, Josef Spjut, David Luebke, Turner Whitted

SID

S-Step and Communication-Avoiding Iterative Methods

Maxim Naumov

Technical Report NVR-2016-003

Parallel Spectral Graph Partitioning

Maxim Naumov, Timothy Moon

Technical Report NVR-2016-001

Single-pass Parallel Prefix Scan with Decoupled Look-back

Duane Merrill, Michael Garland

2015

AmgX: A Library for GPU Accelerated Algebraic Multigrid and Preconditioned Iterative Methods

Maxim Naumov, Marat Arsaev, Patrice Castonguay, Jonathan Cohen, Julien Demouth, Joe Eaton, Simon Layton, Nikolay Markovskiy, Istvan Reguly, Nikolai Sakharnykh, Vijay Sellappan, Robert Strzodka

SIAM Journal on Scientific Computing (SISC)

Stackless ray tracing of patches from feature-adaptive subdivision on GPUs

Nikolaus Binder, Alex Keller

ACM SIGGRAPH 2015 Talks

Parallel Graph Coloring with Applications to the Incomplete-LU Factorization on the GPU

Maxim Naumov, Patrice Castonguay, Jonathan Cohen

Technical Report NVR-2015-001