Research Areas

Real-Time Rendering

Associated Publications

2023

Sionna RT: Differentiable Ray Tracing for Radio Propagation Modeling
Jakob Hoydis, Fayçal Aït Aoudia , Sebastian Cammerer, Merlin Nimier-David, Nikolaus Binder, Guillermo Marcus, Alex Keller
IEEE Globecom Workshops (GC Wkshps) 2023
Less is More: Rendering for Esports
Benjamin Watson, Joohwan Kim, Josef Spjut, Peter Shirley, Byungjoo Lee
SIGGRAPH Frontiers Workshop
Microfacet theory for non-uniform heightfields
Eugene d'Eon, Benedikt Bitterli, Andrea Weidlich, Tizian Zeltner
SIGGRAPH 2023
Neuralangelo: High-Fidelity Neural Surface Reconstruction
Max Zhaoshuo Li, Thomas Müller, Alex Evans, Russell H. Taylor, Mathias Unberath, Ming-Yu Liu, Chen-Hsuan Lin
CVPR 2023
The Best Inventions of 2023, TIME Magazine
Luminance-Preserving and Temporally Stable Daltonization
Pontus Ebelin, Cyril Crassin, Gyorgy Denes, Magnus Oskarsson, Kalle Åström, Tomas Akenine-Möller
Eurographics 2023 Short Papers
Real-Time Neural Appearance Models
Tizian Zeltner, Fabrice Rousselle, Andrea Weidlich, Petrik Clarberg, Jan Novák, Benedikt Bitterli, Alex Evans, Tomáš Davidovič, Simon Kallweit, Aaron Lefohn
arxiv
Joint Neural Denoising of Surfaces and Volumes
Nikolai Hofmann, Jon Hasselgren, Jacob Munkberg
I3D 2023

2022

QuadStream: A Quad-Based Scene Streaming Architecture for Novel Viewpoint Reconstruction
Jozef Hladky, Michael Stengel, Nicholas Vining, Bernhard Kerbl, Hans-Peter Seidel, Markus Steinberger
ACM Transactions on Graphics (Proc. SIGGRAPH Asia 2022)
Variable Bitrate Neural Fields
Towaki Takikawa, Alex Evans, Jonathan Tremblay, Thomas Müller, Morgan McGuire, Alec Jacobson, Sanja Fidler
ACM SIGGRAPH 2022 Conference Proceedings
Instant Neural Graphics Primitives with a Multiresolution Hash Encoding
Thomas Müller, Alex Evans, Christoph Schied, Alex Keller
ACM Transactions on Graphics (SIGGRAPH 2022)
Best Technical Paper, SIGGRAPH 2022, THE BEST INVENTIONS OF 2022, TIME
Generalized Resampled Importance Sampling: Foundations of ReSTIR
Daqi Lin, Markus Kettunen, Benedikt Bitterli, Jacopo Pantaleoni, Cem Yuksel, Chris Wyman
ACM Transactions on Graphics (SIGGRAPH 2022)
Ray/Ribbon Intersections
Alexander Reshetov
Proc. ACM Comput. Graph. Interact. Tech., Vol. 5, No. 3, July 2022.
Real-Time Path Tracing and Beyond
Petrik Clarberg, Simon Kallweit, Craig Kolb, Pawel Kozlowski, Yong He, Lifan Wu, Edward Liu, Benedikt Bitterli, Matt Pharr
HPG 2022 Keynote
A Dataset and Explorer for 3D Signed Distance Functions
Towaki Takikawa, Andrew Glassner, Morgan McGuire
Journal of Computer Graphics Techniques
Slang Shading Language Advances
Yong He, Petrik Clarberg, Theresa Foley
Video on YouTube
Research Advances Toward Real-Time Path Tracing
Petrik Clarberg, Simon Kallweit, Craig Kolb, Pawel Kozlowski, Yong He, Lifan Wu, Edward Liu
GDC 2022
GPU Subwarp Interleaving
Sana Damani, Mark Stephenson, Ram Rangan, Daniel Johnson, Rishkul Kulkarni, Steve Keckler
International Symposium on High-Performance Computer Architecture (HPCA)

2021

Scalar Spatiotemporal Blue Noise Masks
Alan Wolfe, Nathan Morrical, Tomas Akenine-Möller, Ravi Ramamoorthi
arXiv:2112.09629
Dynamic Diffuse Global Illumination Resampling
Zander Majercik, Thomas Müller, Alex Keller, Derek Nowrouzezahrai, Morgan McGuire
Computer Graphics Forum
Fast Volume Rendering with Spatiotemporal Reservoir Resampling
Daqi Lin, Chris Wyman, Cem Yuksel
ACM Transactions on Graphics (SIGGRAPH Asia 2021)
Extracting Triangular 3D Models, Materials, and Lighting From Images
Jacob Munkberg, Jon Hasselgren, Tianchang Shen, Jun Gao, Wenzheng Chen, Alex Evans, Thomas Müller, Sanja Fidler
CVPR 2022 (Oral)
A distributed, decoupled system for losslessly streaming dynamic light probes to thin clients
Michael Stengel, Zander Majercik, Ben Boudaoud, Morgan McGuire
ACM Multimedia Systems Conference
Cooperative Profile Guided Optimization
Mark Stephenson, Ram Rangan, Steve Keckler
Computer Graphics Forum (Proceedings of High Performance Graphics)
Real-time Neural Radiance Caching for Path Tracing
Thomas Müller, Fabrice Rousselle, Jan Novák, Alex Keller
ACM Transactions on Graphics
Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapes
Towaki Takikawa, Joey Litalien, Kangxue Yin, Karsten Kreis, Charles Loop, Derek Nowrouzezahrai, Alec Jacobson, Morgan McGuire, Sanja Fidler
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2021
A Case Study of First Person Aiming at Low Latency for Esports
Josef Spjut, Ben Boudaoud, Joohwan Kim
Esports and High Performance HCI Workshop
Scaling Probe-Based Real-Time Dynamic Global Illumination for Production
Zander Majercik, Adam Marrs, Josef Spjut, Morgan McGuire
The Journal of Computer Graphics Techniques
Interactive Path Tracing and Reconstruction of Sparse Volumes
Nikolai Hofmann, Jon Hasselgren, Petrik Clarberg, Jacob Munkberg
Proceedings of the ACM on Computer Graphics and Interactive Techniques
Best Paper Presentation, i3D 2021
PGZ: Automatic Zero-Value Code Specialization
Mark Stephenson, Ram Rangan
International Conference on Compiler Construction (CC)

2020

Glossy Probe Reprojection for Interactive Global Illumination
Simon Rodriguez, Thomas Leimkühler, Siddhant Prakash, Chris Wyman, Peter Shirley, George Drettakis
ACM Transactions on Graphics (SIGGRAPH Asia 2020)
Scaling Probe-Based Real-Time Dynamic Global Illumination for Production (Technical Report)
Zander Majercik, Adam Marrs, Josef Spjut, Morgan McGuire
arXiv.org
Spatiotemporal reservoir resampling for real-time ray tracing with dynamic direct lighting
Benedikt Bitterli, Chris Wyman, Matt Pharr, Peter Shirley, Aaron Lefohn, Wojciech Jarosz
ACM Transactions on Graphics (SIGGRAPH 2020)
Practical Product Sampling by Fitting and Composing Warps
David Hart, Matt Pharr, Thomas Müller, Ward Lopes, Morgan McGuire, Peter Shirley
EuroGraphics Symposium on Rendering
Post-Render Warp with Late Input Sampling Improves Aiming Under High Latency Conditions
Joohwan Kim, Pyarelal Knowles, Josef Spjut, Ben Boudaoud, Morgan McGuire
High Performance Graphics 2020
A Taxonomy of Bidirectional Scattering Distribution Function Lobes for Rendering Engineers
Morgan McGuire, Julie Dorsey, John F. Hughes, Steve Marschner, Matt Pharr, Peter Shirley
EuroGraphics Workshop on Material Appearance Modeling
Neural Denoising with Layer Embeddings
Jacob Munkberg, Jon Hasselgren
EGSR 2020
Neural Temporal Adaptive Sampling and Denoising
Jon Hasselgren, Jacob Munkberg, Marco Salvi, Anjul Patney, Aaron Lefohn
Computer Graphics Forum (Proceedings of Eurographics 2020)

2019

Dynamic Many-Light Sampling for Real-Time Ray Tracing
Pierre Moreau, Matt Pharr, Petrik Clarberg
Proceedings of High Performance Graphics 2019
Temporally Dense Ray Tracing
Pontus Ebelin, Jim Nilsson, Marco Salvi, Josef Spjut, Tomas Akenine-Möller
High Performance Graphics 2019
Dynamic Diffuse Global Illumination with Ray-Traced Irradiance Fields
Zander Majercik, Jean-Philippe Guertin, Derek Nowrouzezahrai, Morgan McGuire
Journal of Computer Graphics Techniques
Improving Temporal Antialiasing with Adaptive Ray Tracing
Adam Marrs, Josef Spjut, Holger Gruen, Rahul Sathe, Morgan McGuire
Ray Tracing Gems
Cool Patches: A Geometric Approach to Ray/Bilinear Patch Intersections
Alexander Reshetov
Ray Tracing Gems
Precision Improvements for Ray/Sphere Intersection
Eric Haines, Johannes Gunther, Tomas Akenine-Möller
Ray Tracing Gems
Texture Level of Detail Strategies for Real-Time Ray Tracing
Tomas Akenine-Möller, Jim Nilsson, Magnus Andersson, Colin Barré-Brisebois, Robert Toth, Tero Karras
Ray Tracing Gems
What is a Ray?
Peter Shirley, Ingo Wald, Tomas Akenine-Möller, Eric Haines
Ray Tracing Gems
Simple Environment Map Filtering Using Ray Cones and Ray Differentials
Tomas Akenine-Möller, Jim Nilsson
Ray Tracing Gems
A Fast and Robust Method for Avoiding Self-Intersection
Carsten Wächter, Nikolaus Binder
Ray Tracing Gems
Massively Parallel Path Space Filtering
Nikolaus Binder, Sascha Fricke, Alex Keller
arXiv
Massively Parallel Construction of Radix Tree Forests for the Efficient Sampling of Discrete Probability Distributions
Nikolaus Binder, Alex Keller
arXiv

2018

Fast, High Precision Ray/Fiber Intersection using Tight, Disjoint Bounding Volumes
Nikolaus Binder, Alex Keller
arXiv
Massively Parallel Stackless Ray Tracing of Catmull-Clark Subdivision Surfaces
Nikolaus Binder, Alex Keller
arXiv
A Ray-Box Intersection Algorithm and Efficient Dynamic Voxel Rendering
Zander Majercik, Cyril Crassin, Peter Shirley, Morgan McGuire
Journal of Computer Graphics Techniques
Machine Learning and Rendering
Alex Keller, Jaroslav Křivánek, Jan Novák, Anton Kaplanyan, Marco Salvi
ACM SIGGRAPH 2018 Courses
Adaptive Temporal Antialiasing
Adam Marrs, Josef Spjut, Holger Gruen, Rahul Sathe, Morgan McGuire
High Performance Graphics
Phantom Ray-Hair Intersector
Alexander Reshetov, David Luebke
Proceedings of the ACM on Computer Graphics and Interactive Techniques
Combining Analytic Direct Illumination and Stochastic Shadows
Eric Heitz, Stephen Hill, Morgan McGuire
ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games

2017

Integral Equations and Machine Learning
Alex Keller, Ken Dahm
Mathematics and Computers in Simulation, Volume 161, July 2019, Pages 2-12
Perceptually-Guided Foveation for Light Field Displays
Qi Sun, Fu-Chung Huang, Joohwan Kim, Li-Yi Wei, David Luebke, Arie Kaufman
ACM SIGGRAPH ASIA 2017
Exploiting Budan-Fourier and Vincent’s Theorems for Ray Tracing 3D Bézier Curves
Alexander Reshetov
High-Performance Graphics 2017
Interactive Stable Ray Tracing
Alessandro Dal Corso, Marco Salvi, Craig Kolb, Jeppe Revall Frisvad, Aaron Lefohn, David Luebke
Proceedings of High Performance Graphics (HPG '17)
Efficient Incoherent Ray Traversal on GPUs Through Compressed Wide BVHs
Henri Ylitie, Tero Karras, Samuli Laine
High-Performance Graphics 2017
Spatiotemporal Variance-Guided Filtering: Real-Time Reconstruction for Path-Traced Global Illumination
Christoph Schied, Anton Kaplanyan, Chris Wyman, Anjul Patney, Chakravarty R. Alla Chaitanya, John Burgess, Shiqiu Liu, Carsten Dachsbacher, Aaron Lefohn, Marco Salvi
Proceedings of High Performance Graphics 2017
An Efficient Denoising Algorithm for Global Illumination
Michael Mara, Morgan McGuire, Benedikt Bitterli, Wojciech Jarosz
ACM SIGGRAPH / EuroGraphics High Performance Graphics 2017
The Iray Light Transport Simulation and Rendering System
Alex Keller, Carsten Wächter, Matthias Raab, Daniel Seibert, Dietger van Antwerpen, Johann Korndörfer, Lutz Kettner
arXiv
Learning Light Transport the Reinforced Way
Ken Dahm, Alex Keller
arXiv

2016

A System for Rapid Exploration of Shader Optimization Choices
Yong He, Theresa Foley, Kayvon Fatahalian
Proceedings of ACM SIGGRAPH 2016
GI next: global illumination for production rendering on GPUs
Enzo Catalano, Rajko Yasui-Schöffel , Ken Dahm, Nikolaus Binder, Alex Keller
ACM SIGGRAPH 2016 Talks
Efficient stackless hierarchy traversal on GPUs with backtracking in constant time
Nikolaus Binder, Alex Keller
Proceedings of High Performance Graphics

2015

CloudLight: A System for Amortizing Indirect Lighting in Real-Time Rendering
Cyril Crassin, David Luebke, Michael Mara, Morgan McGuire, Brent Oster, Peter Shirley, Peter-Pike Sloan, Chris Wyman
Journal of Computer Graphics Techniques
An Adaptive Acceleration Structure for Screen-space Ray Tracing
Jan Kautz, Sven Widmer, Dawid Pajak, Andre Schulz, Kari Pulli, Michael Goesele, David Luebke
High-Performance Graphics
The SGGX microflake distribution
Eric Heitz, Jonathan Dupuy, Cyril Crassin, Carsten Dachsbacher
ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH 2015
Stackless ray tracing of patches from feature-adaptive subdivision on GPUs
Nikolaus Binder, Alex Keller
ACM SIGGRAPH 2015 Talks
Frustum-Traced Raster Shadows: Revisiting Irregular Z-Buffers
Chris Wyman, Rama Hoetzlein, Aaron Lefohn
Symposium on Interactive 3D Graphics and Games

2014

Path space filtering
Alex Keller, Ken Dahm, Nikolaus Binder
ACM SIGGRAPH 2014 Talks
Path space similarity determined by Fourier histogram descriptors
Pascal Gautron, Marc Droske, Carsten Wächter, Lutz Kettner, Alex Keller, Nikolaus Binder, Ken Dahm
ACM SIGGRAPH 2014 Talks

2013

Deterministic Consistent Density Estimation for Light Transport Simulation
Alex Keller, Nikolaus Binder
Monte Carlo and Quasi-Monte Carlo Methods 2012
On Quality Metrics of Bounding Volume Hierarchies
Timo Aila, Tero Karras, Samuli Laine
Proc. High-Performance Graphics
Fast Parallel Construction of High-Quality Bounding Volume Hierarchies
Tero Karras, Timo Aila
High Performance Graphics 2013
Gradient-Domain Metropolis Light Transport
Jaakko Lehtinen, Tero Karras, Samuli Laine, Miika Aittala, Frédo Durand, Timo Aila
ACM Transactions on Graphics (Proc. SIGGRAPH 2013)
CloudLight: A system for amortizing indirect lighting in real-time rendering (Technical Report)
Cyril Crassin, David Luebke, Michael Mara, Morgan McGuire, Brent Oster, Peter Shirley, Peter-Pike Sloan, Chris Wyman

2012

Reconstructing the Indirect Light Field for Global Illumination
Jaakko Lehtinen, Timo Aila, Samuli Laine, Frédo Durand
ACM Transactions on Graphics (Proc. SIGGRAPH 2012)
Understanding the Efficiency of Ray Traversal on GPUs - Kepler and Fermi Addendum
Timo Aila, Samuli Laine, Tero Karras
NVIDIA Technical Report NVR-2012-002

2011

Simpler and Faster HLBVH with Work Queues
Kirill Garanzha, Jacopo Pantaleoni, David McAllister
High Performance Graphics 2011

2010

PantaRay: Fast Ray-traced Occlusion Caching of Massive Scenes
Jacopo Pantaleoni, Luca Fascione
Siggraph 2010 (In Proceedings of ACM Siggraph 2010)
Restart Trail for Stackless BVH Traversal
Samuli Laine
High-Performance Graphics 2010
HLBVH: Hierarchical LBVH Construction for Real-Time Ray Tracing
Jacopo Pantaleoni, David Luebke
High Performance Graphics 2010
Architecture Considerations for Tracing Incoherent Rays
Timo Aila, Tero Karras
Proc. High-Performance Graphics 2010

2009

Understanding the Efficiency of Ray Traversal on GPUs
Timo Aila, Samuli Laine
Proc. High-Performance Graphics

Researchers

Aaron Lefohn
Alex Keller
Amrita Mazumdar
Andrea Weidlich
Bart Wronski
Benedikt Bitterli
Bob Alfieri
Chris Wyman
Christoph Schied
Craig Kolb
Cyril Crassin
Daqi Lin
David Luebke
Fabrice Rousselle
Guillermo Marcus
Jacob Munkberg
Jaesung Choe
Jan Novák
Josef Spjut
Lifan Wu
Marco Salvi
Markus Kettunen
Matthew Chan
Michael Stengel
Ming-Yu Liu
Nicholas Vining
Nikolaus Binder
Petrik Clarberg
Pontus Ebelin
Ravi Ramamoorthi
Samuli Laine
Simon Kallweit
Tero Karras
Thomas Müller
Tizian Zeltner
Tomas Akenine-Möller
Tomas Davidovic
Towaki Takikawa
Yong He