image-alt-text
High-dynamic-range image computed from a stack of different exposures.

Part of our engagement with the broader community includes disseminating our results in technical conferences, journals, and NVIDIA technical reports.

2018

October

Localization-Aware Active Learning for Object Detection
Context-aware Synthesis and Placement of Object Instances
Video-to-Video Synthesis
Structured Domain Randomization: Bridging the Reality Gap by Context-Aware Synthetic Data

November

Optimizing Software-Directed Instruction Replication for GPU Error Detection
Models Matter, So Does Training: An Empirical Study of CNNs for Optical Flow Estimation
Kayotee: A Fault Injection-based System to Assess the Safety and Reliability of Autonomous Vehicles to Faults and Errors

September

Deep Object Pose Estimation for Semantic Robotic Grasping of Household Objects
Statistical Nearest Neighbors for Image Denoising
Separating Reflection and Transmission Images in the Wild
Tackling 3D ToF Artifacts Through Learning and the FLAT Dataset
FocusAR: Auto-focus Augmented Reality Eyeglasses for both Real World and Virtual Imagery
Learning Rigidity in Dynamic Scenes with a Moving Camera for 3D Motion Field Estimation
Switchable Temporal Propagation Network
HGMR: Hierarchical Gaussian Mixtures for Adaptive 3D Registration
Multimodal Unsupervised Image-to-Image Translation
A Closed-form Solution to Photorealistic Image Stylization
EOE: Expected Overlap Estimation over Unstructured Point Cloud Data
Superpixel Sampling Networks

August

Machine Learning and Rendering
Towards Virtual Reality Infinite Walking: Dynamic Saccadic Redirection
Steerable application-adaptive near eye displays
Correlation-Aware Semi-Analytic Visibility for Antialiased Rendering
Adaptive Temporal Antialiasing
Phantom Ray-Hair Intersector

July

Noise2Noise: Learning Image Restoration without Clean Data
Approximate svBRDF Estimation From Mobile Phone Video

June

Modeling Soft Error Propagation in Programs
A Modular Digital VLSI Flow for High-Productivity SoC Design
Light-weight Head Pose Invariant Gaze Tracking
Learning Superpixels with Segmentation-Aware Affinity Losse
MoCoGAN: Decomposing Motion and Content for Video Generation
Improving Landmark Localization with Semi-Supervised Learning
Depth-Based 3D Hand Pose Estimation: From Current Achievements to Future Goals
Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolation
High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs
Making Convolutional Networks Recurrent for Visual Sequence Learning
Geometry-Aware Learning of Maps for Camera Localization
SPLATNet: Sparse Lattice Networks for Point Cloud Processing
PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volume
Hardware-Enabled Artificial Intelligence
Deep Semantic Face Deblurring
Falling Things: A Synthetic Dataset for 3D Object Detection and Pose Estimation
PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenes

May

Adversarial Collaboration: Joint Unsupervised Learning of Depth, Camera Motion, Optical Flow and Motion Segmentation
Synthetically Trained Neural Networks for Learning Human-Readable Plans from Real-World Demonstrations
Combining Analytic Direct Illumination and Stochastic Shadows
Reblur2Deblur: Deblurring Videos via Self-Supervised Learning

April

Progressive Growing of GANs for Improved Quality, Stability, and Variation
A Variable Shape and Variable Stiffness Controller for Haptic Virtual Interactions
Training Deep Networks with Synthetic Data: Bridging the Reality Gap by Domain Randomization
IamNN: Iterative and Adaptive Mobile Neural Network for Efficient Image Classification
On the Importance of Stereo for Accurate Depth Estimation: An Efficient Semi-Supervised Deep Neural Network Approach
A Switching Linear Regulator Based on a Fast-Self-Clocked Comparator with Very Low Probability of Meta-stability and a Parallel Analog Ripple Control Module
Ground-Referenced Signaling for Intra-Chip and Short-Reach Chip-to-Chip Interconnects

March

Riemannian Motion Policies

February

Reducing Data Transfer Energy by Exploiting Similarity within a Data Transaction
Compressing DMA Engine: Leveraging Activation Sparsity for Training Deep Neural Networks
A 1.17pJ/b 25Gb/s/pin Ground-Referenced Single Ended Serial Link for Off- and On-Package Communication in 16nm CMOS Using a Process- and Temperature-Adaptive Voltage Regulator
Learning Binary Residual Representations for Domain-specific Video Streaming

January

Learning Adaptive Parameter Tuning for Image Processing
2017

December

Parallel Complexity of Forward and Backward Propagation
Machine Learning and Integral Equations
AdaBatch: Adaptive Batch Sizes for Training Deep Neural Networks
Sim-to-Real Transfer of Accurate Grasping with Eye-In-Hand Observations and Continuous Control
On Nearest Neighbors in Non Local Means Denoising
Learning Affinity via Spatial Propagation Networks
Unsupervised Image-to-Image Translation Networks

November

Near-Eye Varifocal Augmented Reality Display using See-Through Screens
Near-eye Light Field Holographic Rendering with Spherical Waves for Wide Field of View Interactive 3D Computer Graphics
Perceptually-Guided Foveation for Light Field Displays
Toward Standardized Near-Data Processing with Unrestricted Data Placement for GPUs
Understanding Error Propagation in Deep Learning Neural Network (DNN) Accelerators and Applications
Parallel Jaccard and Related Graph Clustering Techniques
Low Communication FMM-Accelerated FFT on GPUs

October

Learning to Super-Resolve Blurry Face and Text Images
Intrinsic3D: High-Quality 3D Reconstruction by Joint Appearance and Geometry Optimization with Spatially-Varying Lighting
Semantic Video CNNs through Representation Warping
A Lightweight Approach for On-the-Fly Reflectance Estimation
Fine-Grained DRAM: Energy-Efficient DRAM for Extreme Bandwidth Systems
Beyond the socket: NUMA-aware GPUs
Multiframe Scene Flow with Piecewise Rigid Motion
Cascaded Scene Flow Prediction using Semantic Segmentation

September

Toward Low-Flying Autonomous MAV Trail Navigation using Deep Neural Networks for Environmental Awareness
Latency Requirements for Foveated Rendering in Virtual Reality
Feedforward and Recurrent Neural Networks Backward Propagation and Hessian in Matrix Form

August

Tactics of Adversarial Attack on Deep Reinforcement Learning Agents

July

Membrane AR: Varifocal, Wide-Field-of-View Augmented Reality Display from Deformable Membranes
Mixed-primary Factorization for Dual-frame Computational Displays
Varifocal Virtuality: A Novel Optical Layout for Near-Eye Display
Audio-Driven Facial Animation by Joint End-to-End Learning of Pose and Emotion
Stretchable Transducers for Kinesthetic Interactions in Virtual Reality
Exploiting Budan-Fourier and Vincent’s Theorems for Ray Tracing 3D Bézier Curves
Spatiotemporal Variance-Guided Filtering: Real-Time Reconstruction for Path-Traced Global Illumination
An Efficient Denoising Algorithm for Global Illumination
Efficient Incoherent Ray Traversal on GPUs Through Compressed Wide BVHs
Dynamic Facial Analysis: From Bayesian Filtering to Recurrent Neural Networks
Deep 360 Pilot: Learning a Deep Agent for Piloting through 360 Sports Videos
Light Fields for Near-eye Displays
Production-Level Facial Performance Capture Using Deep Convolutional Neural Networks
Interactive Reconstruction of Monte Carlo Image Sequences using a Recurrent Denoising Autoencoder
Fusing State Spaces for Markov Chain Monte Carlo Rendering
Reconstructing Intensity Images from Binary Spatial Gradient Cameras
Polarimetric Multi-view Stereo
Computational Zoom: A Framework for Post-Capture Image Composition

June

Generating stratified random lines in a square
SCNN: An Accelerator for Compressed-sparse Convolutional Neural Networks
MCM-GPU: Multi-Chip-Module GPUs for Continued Performance Scalability
Parallel Modularity Clustering
Understanding Reduced-Voltage Operation in Modern DRAM Devices: Experimental Characterization, Analysis, and Mechanisms
Design-Induced Latency Variation in Modern DRAM Chips: Characterization, Analysis, and Latency Reduction Mechanisms
Relaxations for High-Performance Message Passing on Massively Parallel SIMT Processors

May

The Iray Light Transport Simulation and Rendering System

April

SASSIFI: An Architecture-level Fault Injection Tool for GPU Application Resilience Evaluation
Pruning Convolutional Neural Networks for Resource Efficient Inference
Consistent Video Filtering for Camera Arrays
TriCheck: Memory Model Verification at the Trisection of Software, Hardware, and ISA
Automated Synthesis of Comprehensive Memory Model Litmus Test Suites
Reinforcement Learning through Asynchronous Advantage Actor-Critic on a GPU

March

Wide Field Of View Varifocal Near-Eye Display Using See-Through Deformable Membrane Mirrors
Phenomenological Transparency
Parallel Depth-First Search for Directed Acyclic Graphs
Loss Functions for Image Restoration with Neural Networks

February

Architecting an Energy-Efficient DRAM System for GPUs
Hashed Alpha Testing
Real-Time Global Illumination using Precomputed Light Field Probes

January

Learning Light Transport the Reinforced Way
2016

December

Tensor Contractions with Extended BLAS Kernels on CPU and GPU
Towards Foveated Rendering for Gaze-Tracked Virtual Reality

October

Approxilyzer: Towards A Systematic Framework for Instruction-Level Approximate Computing and its Application to Hardware Resiliency
Temporal Ensembling for Semi-Supervised Learning
CLARA: Circular Linked-List Auto- and Self-Refresh Architecture
Multilayer and Multimodal Fusion of Deep Neural Networks for Video Classification
Path space filtering

July

Aggregate G-Buffer Anti-Aliasing in Unreal Engine 4
GI next: global illumination for production rendering on GPUs
Reflectance Modeling by Neural Texture Synthesis
Estimating Local Beckmann Roughness for Complex BSDFs
Perceptually-Based Foveated Virtual Reality

June

Exploring and Expanding the Continuum of OIT Algorithms
Efficient stackless hierarchy traversal on GPUs with backtracking in constant time
Transparent Offloading and Mapping (TOM): Enabling Programmer-Transparent Near-Data Processing in GPU Systems
Infinite Resolution Textures
All-Inclusive ECC: Thorough End-to-End Protection for Reliable Computer Memory
Towards Selecting Robust Hand Gestures for Automotive Interfaces
Filtering Distributions of Normals for Shading Antialiasing
A Real-time Energy-Efficient Superpixel Hardware Accelerator for Mobile Computer Vision Applications
Accelerated Generative Models for 3D Point Cloud Data
Deep G-Buffers for Stable Global Illumination Approximation
Online Detection and Classification of Dynamic Hand Gestures with Recurrent 3D Convolutional Neural Networks

May

Hybrid Modulation for Near Zero Display Latency
Modeling and Analysis of Power Supply Noise Tolerance with Fine-grained GALS Adaptive Clocks

April

S-Step and Communication-Avoiding Iterative Methods
Stack-Based Algorithms for HDR Capture and Reconstruction

March

Current parking regulator for zero droop/overshoot load transient response
A Case for Toggle-Aware Compression for GPU Systems
An Analytical Model for Hardened Latch Selection and Exploration
Parallel Spectral Graph Partitioning
Single-pass Parallel Prefix Scan with Decoupled Look-back

February

Real-time Rendering of Procedural Multiscale Materials
A Phenomenological Scattering Model for Order-Independent Transparency
A 28nm 2Mbit 6T SRAM with Highly Configurable Write Assist Implementation and Capacitor Based Sense Amplifier Input Offset Compen
A 6.5-to-23.3fJ/b/mm Balanced Charge-Recycling Bus in 16nm FinFET CMOS at 1.7-to-2.6Gb/s/wire with Clock Forwarding and Low-Crosstalk Contraflow Wiring
2015

December

Robust Model-based 3D Head Pose Estimation

November

Network Endpoint Congestion Control for Fine-Grained Communication
Exploiting Asymmetry in Booth-Encoded Multipliers for Reduced Energy Multiplication

October

Anatomy of GPU Memory System for Multi-Application Execution
AmgX: A Library for GPU Accelerated Algebraic Multigrid and Preconditioned Iterative Methods
MLMD: Maximum Likelihood Mixture Decoupling for Fast and Accurate Point Cloud Registration

August

MemcachedGPU: Scaling-up Scale-out Key-value Stores
Designing Efficient Heterogeneous Memory Architectures
Decoupled Coverage Anti-Aliasing
The SGGX microflake distribution
Accumulative Anti-Aliasing
An Adaptive Acceleration Structure for Screen-space Ray Tracing

July

The Light Field Stereoscope
Stackless ray tracing of patches from feature-adaptive subdivision on GPUs
Improved Half Vector Space Light Transport
Compressing Neural Networks with the Hashing Trick

June

Flexible Software Profiling of GPU Architectures
A Variable Warp Size Architecture
Locally Non-rigid Registration for Mobile HDR Photography
Retrieving Gray-Level Information from a Binary Sensor and its Application to Gesture Detection
Filtering Environment Illumination for Interactive Physically-Based Rendering in Mixed Reality
Apex Point Map for Constant-Time Bounding Plane Approximation
Hand Gesture Recognition with 3D Convolutional Neural Networks

May

Toggle-aware Compression for GPUs
Multi-sensor System for Driver’s Hand-Gesture Recognition
A Pausible Bisynchronous FIFO for GALS Systems
Parallel Graph Coloring with Applications to the Incomplete-LU Factorization on the GPU
Camera Re-calibration after Zooming based on Sets of Conics
Short-Range FMCW Monopulse Radar for Hand-Gesture Sensing

March

Page Placement Strategies for GPUs within Heterogeneous Memory Systems
Simulating the Visual Experience of Very Bright and Very Dark Scenes
Slim near eye display using pinhole aperture arrays
Adaptive Segmentation based on a Learned Quality Metric

February

Unlocking Bandwidth for GPUs in CC-NUMA systems
Priority-Based Cache Allocation in Throughput Processors
Aggregate G-Buffer Anti-Aliasing
Machine Learning for Adaptive Bilateral Filtering
Frustum-Traced Raster Shadows: Revisiting Irregular Z-Buffers

January

High-speed Low-power On-chip Global Signaling Design Overview
2014

December

cuDNN: Efficient Primitives for Deep Learning
DT-SLAM: Deferred Triangulation for Robust SLAM
FlexISP: A Flexible Camera Image Processing Framework

November

Scaling the Power Wall: A Path to Exascale

September

A Non-Linear Filter for Gyroscope-Based Video Stabilization

August

Cascaded Displays: Spatiotemporal Superresolution using Offset Pixel Layers

July

Path space similarity determined by Fourier histogram descriptors

June

Fast ANN for High-Quality Collaborative Filtering
Dynamic Image Stacks
Addressing System-Level Optimization with OpenVX Graphs
Fast Global Illumination Approximations on Deep G-Buffers

April

Perceptual Depth Compression for Stereo Applications

March

A Reverse Write Assist Circuit for SRAM Dynamic Write VMIN Tracking using Canary SRAMs
Application-aware Memory System for Fair and Efficient Execution of Concurrent GPGPU Applications
A unistable polyhedron with 14 faces

February

A Decomposition for In-place Array Transposition
Occluder Simplification using Planar Sections
2013

December

A 0.54 pJ/b 20 Gb/s Ground-Referenced Single-Ended Short-Reach Serial Link in 28 nm CMOS for Advanced Packaging Applications
Lighting Deep G-Buffers: Single-Pass, Layered Depth Images with Minimum Separation Applied to Indirect Illumination

November

Deterministic Consistent Density Estimation for Light Transport Simulation
Near-Eye Light Field Displays
WYSIWYG Computational Photography via Viewfinder Editing
A Fast and Stable Feature-Aware Motion Blur Filter

October

An Energy Efficient Time-sharing Pyramid Pipeline for Multi-resolution Computer Vision

September

On Quality Metrics of Bounding Volume Hierarchies

August

2D Polyhedral Bounds of a Clipped, Perspective-Projected 3D Sphere

July

Simple Analytic Approximations to the CIE XYZ Color Matching Functions
NOVA: A Functional Language for Data Parallelism
CloudLight: A system for amortizing indirect lighting in real-time rendering
Gradient-Domain Metropolis Light Transport
PixelPie: Maximal Poisson-disk Sampling with Rasterization
Practical SVBRDF Capture in the Frequency Domain
Fast Parallel Construction of High-Quality Bounding Volume Hierarchies
Megakernels Considered Harmful: Wavefront Path Tracing on GPUs
Imperfect Voxelized Shadow Volumes

June

A Topological Approach to Voxelization
HDR Deghosting: How to Deal with Saturation?

May

GPU Ray Tracing

March

Toward Practical Real-Time Photon Mapping: Efficient GPU Density Estimation

February

A 0.54pJ/b 20Gb/s Ground-Referenced Single-Ended Short-Haul Serial Link in 28nm CMOS for Advanced Packaging Applications

January

A Parallel Auxiliary Grid Algebraic Multigrid Method for Graphic Processing Units
2012

December

Unifying Primary Cache, Scratch, and Register File Memories in a Throughput Processor
Preconditioned Block-Iterative Methods on GPUs

October

Exposure Stacks for Live Scenes with Hand-held Cameras

August

Reconstructing the Indirect Light Field for Global Illumination

July

Octree-Based Sparse Voxelization Using The GPU Hardware Rasterizer

June

Scalable Ambient Obscurance
Understanding the Efficiency of Ray Traversal on GPUs - Kepler and Fermi Addendum
Relational Algorithms for Multi-Bulk-Synchronous Processors
Realtime Computer Vision with OpenCV
Detecting Regions of Interest in Dynamic Scenes with Camera Motions
Maximizing Parallelism in the Construction of BVHs, Octrees, and k-d Trees
Robust Stereo with Flash and No-flash Image Pairs

May

Metering for Exposure Stacks
Policy-based Tuning for Performance Portability and Library Co-optimization
Efficient Parallel Merge Sort for Fixed and Variable Length Keys
Incomplete-LU and Cholesky Factorization in the Preconditioned Iterative Methods on the GPU

April

A Hierarchical Thread Scheduler and Register File for Energy-Efficient Throughput Processors
A Path Space Extension for Robust Light Transport Simulation

February

Scalable GPU Graph Traversal

January

FCam for Multiple Cameras
2011

December

A Compile-Time Managed Multi-Level Register File Hierarchy
Allocation-oriented Algorithm Design with Application to GPU Computing, Ph.D. Dissertation

November

What Characterizes a Shadow Boundary under Sun and Sky?
CudaDMA: Optimizing GPU Memory Bandwidth via Warp Specialization
Improved Dual-Space Bounds for Simultaneous Motion and Defocus Blur
Dynamic Hand Gesture Recognition
Gaussian Process Regression Flow for Analysis of Motion Trajectories

October

Thrust: A Productivity-Oriented Library for CUDA

September

Interactive Indirect Illumination Using Voxel Cone Tracing
GPUs and the Future of Parallel Computing
A Hybrid Method for Solving Tridiagonal Systems on the GPU
Efficient Triangle Coverage Tests for Stochastic Rasterization
Processing Device Arrays with C++ Metaprogramming

August

Temporal Light Field Reconstruction for Rendering Distribution Effects
Simpler and Faster HLBVH with Work Queues
High-Performance Software Rasterization on GPUs
VoxelPipe: A Programmable Pipeline for 3D Voxelization
Stochastic Transparency
The Alchemy Screen-space Ambient Obscurance Algorithm
High Performance and Scalable GPU Graph Traversal
Clipless Dual-Space Bounds for Faster Stochastic Rasterization

June

Stratified Sampling for Stochastic Transparency
Parallel Solution of Sparse Triangular Linear Systems in the Preconditioned Iterative Methods on the GPU
The Workflow Scale: Why 5x Faster Might Not Be Enough
Exposing Fine-Grained Parallelism in Algebraic Multigrid Methods
Energy-efficient Mechanisms for Managing Thread Context in Throughput Processors

May

Decoupled Sampling for Graphics Pipelines

February

Copperhead: Compiling an Embedded Data Parallel Language
Subpixel Reconstruction Antialiasing
Colored Stochastic Shadow Maps
A Local Image Reconstruction Algorithm for Stochastic Rendering
2010

December

Scalable Fluid Simulation using Anisotropic Turbulence Particles
Sparse Matrix-Vector Multiplication on Multicore and Accelerators

August

OptiX: A General Purpose Ray Tracing Engine

July

PantaRay: Fast Ray-traced Occlusion Caching of Massive Scenes

June

Real-Time Stochastic Rasterization on Conventional GPU Architectures
Ambient Occlusion Volumes
Restart Trail for Stackless BVH Traversal
Architecture Considerations for Tracing Incoherent Rays
Two Methods for Fast Ray-Cast Ambient Occlusion
HLBVH: Hierarchical LBVH Construction for Real-Time Ray Tracing

May

Hardware-Accelerated Colored Stochastic Shadow Maps

April

Optical Image Processing Using Light Modulation Displays

February

Efficient Sparse Voxel Octrees
Interactive Fluid-Particle Simulation using Translating Eulerian Grids
Efficient Sparse Voxel Octrees - Analysis, Extensions, and Implementation

January

Fast Tridiagonal Solvers on the GPU
Programming Massively Parallel Processors: A Hands-on Approach
2009

November

Implementing Sparse Matrix-Vector Multiplication on Throughput-Oriented Processors
Increasing Memory Miss Tolerance for SIMD Cores

September

Solving Computational Problems with GPU Computing

August

Understanding the Efficiency of Ray Traversal on GPUs
Hardware-Accelerated Global Illumination by Image Space Photon Mapping
Image Space Gathering

May

A Fast Double Precision CFD Code Using CUDA
Designing Efficient Sorting Algorithms for Manycore GPUs

March

Fast BVH Construction on GPUs
2008

December

Efficient Sparse Matrix-Vector Multiplication on CUDA
Efficient Parallel Scan Algorithms for GPUs

November

On the Visualization of Social and Other Scale-Free Networks
Lossless and Near Lossless Compression of Real Color Filter Array data

September

Rapid Multipole Graph Drawing on the GPU

August

Parallel Computing Experiences with CUDA
A Meshless Hierarchical Representation for Light Transport

July

Low Viscosity Flow Simulations for Animation

June

Real-time Editing and Relighting of Homogeneous Translucent Materials

May

GPU Computing

April

NVIDIA Tesla: A Unified Graphics and Computing Architecture
Free-form Motion Processing

March

Scalable Parallel Programming with CUDA
2007

December

A 14-mW 6.25-Gb/s Transceiver in 90-nm CMOS

August

A Hardware Architecture for Surface Splatting
A Hardware Redundancy and Recovery Mechanism for Reliable Scientific Computation on Graphics Processors
Advanced Techniques for Realistic Real-Time Skin Rendering
Simulation of Bubbles in Foam with the Volume Control Method

June

Efficient Rendering of Human Skin
Incremental Instant Radiosity for Real-Time Indirect Illumination
Iterative Methods for Improving Mesh Parameterizations

February

How GPUs Work
2006

September

The Visual Vulnerability Spectrum: Characterizing Architectural Vulnerability for Graphics Hardware
2005

August

A Survey of General-Purpose Computation on Graphics Hardware

July

GPU-Accelerated High Quality Hidden Surface Removal

March

High-Quality Antialiased Rasterization
2003

July

Twister: A Space-warp Operator for the Two-handed Editing of 3D Shapes
2001

August

A User-Programmable Vertex Engine.
2000

August

Shadows for Cel Animation
1995

September

Motion Signal Processing
1994

September

Animating Images with Line Drawings