Research Areas

Computational Photography and Imaging

Associated Publications

2024

Large Étendue 3D Holographic Display with Content-adpative Dynamic Fourier Modulation
Brian Chao, Manu Gopakumar, Suyeon Choi, Liang Shi, Jonghyun Kim, Gordon Wetzstein
SIGGRAPH ASIA 2024 Technical Papers

2023

Online Overexposed Pixels Hallucination in Videos with Adaptive Reference Frame Selection
Yazhou Xing, Amrita Mazumdar, Anjul Patney, Chao Liu, Hongxu Danny Yin, Qifeng Chen, Jan Kautz, Iuri Frosio
Arxiv
Subpixel Deblurring of Anti-Aliased Raster Clip Art
Jinfan Yang, Nicholas Vining, Shakiba Kheradmand, Nathan Carr, Leonid Sigal, Alla Sheffer
Computer Graphics Forum (Proc. Eurographics 2023)

2022

Variable Bitrate Neural Fields
Towaki Takikawa, Alex Evans, Jonathan Tremblay, Thomas Müller, Morgan McGuire, Alec Jacobson, Sanja Fidler
ACM SIGGRAPH 2022 Conference Proceedings
Instant Neural Graphics Primitives with a Multiresolution Hash Encoding
Thomas Müller, Alex Evans, Christoph Schied, Alex Keller
ACM Transactions on Graphics (SIGGRAPH 2022)
Best Technical Paper, SIGGRAPH 2022, THE BEST INVENTIONS OF 2022, TIME
Neural Fields in Visual Computing and Beyond
Yiheng Xie, Towaki Takikawa, Shunsuke Saito, Or Litany, Shiqin Yan, Numair Khan, Federico Tombari, James Tompkin, Vincent Sitzmann, Srinath Sridhar
Computer Graphics Forum (Eurographics 2022)

2021

Standard vs. Learning-based Codecs for Real Time Endoscopic Video Transmission
Iuri Frosio, Aldo Marzullo, Martina Golini, Elena De Momi, Michele Catellani, Francesco Calimeri, Giuseppe Fiameni
AIABI-2021 Italian Workshop on Artificial Intelligence and Applications for Bus…
Neural 3D Holography
Suyeon Choi, Manu Gopakumar, Yifan Peng, Jonghyun Kim, Gordon Wetzstein
ACM Transactions on Graphics (SIGGRAPH Asia 2021)
Speckle-free holography with partially coherent light sources and camera-in-the-loop calibration
Yifan Peng, Suyeon Choi, Jonghyun Kim, Gordon Wetzstein
Science Advances
Visualizing and Communicating Errors in Rendered Images
Pontus Ebelin, Tomas Akenine-Möller, Jim Nilsson
Ray Tracing Gems II, chapter 19, 2021.
Enabling Next-generation Holographic Displays with Artificial Intelligence
Gordon Wetzstein, Yifan Peng, Suyeon Choi, Jonghyun Kim
OSA Imaging and Applied Optics Congress 2021 (3D, COSI, DH, ISA, pcAOP)
Binary TTC: A Temporal Geofence for Autonomous Navigation
Abhishek Badki, Orazio Gallo, Jan Kautz, Pradeep Sen
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2021
Best Student Paper Honorable Mention, CVPR 2021
Visualizing Errors in Rendered High Dynamic Range Images
Pontus Ebelin, Jim Nilsson, Peter Shirley, Tomas Akenine-Möller
Eurographics Short Papers 2021
High-quality Holographic Displays Using Double SLMs and Camera-in-the-loop Optimization
Suyeon Choi, Yifan Peng, Jonghyun Kim, Gordon Wetzstein
Proceedings Volume 11765, Optical Architectures for Displays and Sensing in Aug…
Optimizing Image Quality for Holographic Near-eye Displays with Michelson Holography
Suyeon Choi, Jonghyun Kim, Yifan Peng, Gordon Wetzstein
Optica

2020

Generative View Synthesis: From Single-View Semantics to Novel-View Images
Tewodros Abtegebrial, Varun Jampani, Orazio Gallo, Didier Stricker
NeurIPS
Neural Holography
Yifan Peng, Suyeon Choi, Nitish Padmanaban, Jonghyun Kim, Gordon Wetzstein
SIGGRAPH 2020 Emerging Technology
Bi3D: Stereo Depth Estimation via Binary Classifications
Abhishek Badki, Alejandro Troccoli, Kihwan Kim, Jan Kautz, Pradeep Sen, Orazio Gallo
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2020
Meshlet Priors for 3D Mesh Reconstruction
Abhishek Badki, Orazio Gallo, Jan Kautz, Pradeep Sen
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2020

2019

High-Quality Self-Supervised Deep Image Denoising
Samuli Laine, Tero Karras, Jaakko Lehtinen, Timo Aila
NeurIPS 2019
Extreme View Synthesis
Inchang Choi, Orazio Gallo, Alejandro Troccoli, Min H. Kim, Jan Kautz
IEEE International Conference of Computer Vision
Video Stitching for Linear Camera Arrays
Wei-Sheng Lai, Orazio Gallo, Jinwei Gu, Deqing Sun, Ming-Hsuan Yang, Jan Kautz
British Machine Vision Conference
Matching Prescription & Visual Acuity: Towards AR for Humans
Jonghyun Kim, Michael Stengel, Jui-Yi Wu, Ben Boudaoud, Josef Spjut, Kaan Akşit, Rachel Albert, Youngmo Jeong, Trey Greer, Ward Lopes, Zander Majercik, Peter Shirley, Morgan McGuire, David Luebke
SIGGRAPH 2019 Emerging Technology
Best in Show Award - Emerging Technology in SIGGRAPH 2019

2018

Statistical Nearest Neighbors for Image Denoising
Iuri Frosio, Jan Kautz
IEEE Transaction on Image Processing, Feb. 2019
Separating Reflection and Transmission Images in the Wild
Patrick Wieschollek, Orazio Gallo, Jinwei Gu, Jan Kautz
European Conference of Computer Vision (ECCV)
Noise2Noise: Learning Image Restoration without Clean Data
Jaakko Lehtinen, Jacob Munkberg, Jon Hasselgren, Samuli Laine, Tero Karras, Miika Aittala, Timo Aila
Proc. ICML 2018
Approximate svBRDF Estimation From Mobile Phone Video
Rachel Albert, Dorian Yao Chan, Dan B Goldman, James F. O'Brien
Eurographics Symposium on Rendering 2018
Reblur2Deblur: Deblurring Videos via Self-Supervised Learning
Huaijin Chen, Jinwei Gu, Orazio Gallo, Ming-Yu Liu, Ashok Veeraraghavan, Jan Kautz
IEEE International Conference on Computational Photography (ICCP)
Learning Adaptive Parameter Tuning for Image Processing
Jingming Dong, Iuri Frosio, Jan Kautz
Electronic Imaging 2018, Image Processing: Algorithms and Systems XVI, Burlinga…

2017

On Nearest Neighbors in Non Local Means Denoising
Iuri Frosio, Jan Kautz
Neural Information Processing Systems (NIPS) 2017 Workshop on Nearest Neighbors…
Reconstructing Intensity Images from Binary Spatial Gradient Cameras
Suren Jayasuriya, Orazio Gallo, Jinwei Gu, Timo Aila, Jan Kautz
IEEE Workshop on Embedded Vision (CVPR)
Computational Zoom: A Framework for Post-Capture Image Composition
Abhishek Badki, Orazio Gallo, Jan Kautz, Pradeep Sen
ACM SIGGRAPH
Loss Functions for Image Restoration with Neural Networks
Hang Zhao, Orazio Gallo, Iuri Frosio, Jan Kautz
IEEE Transactions on Computational Imaging

2016

Stack-Based Algorithms for HDR Capture and Reconstruction
Orazio Gallo, Pradeep Sen
High Dynamic Range Video: From Acquisition, to Display and Applications, Academ…

2015

Locally Non-rigid Registration for Mobile HDR Photography
Orazio Gallo, Alejandro Troccoli, Jun Hu, Kari Pulli, Jan Kautz
IEEE Computer Vision and Pattern Recognition (CVPR 2015) Embedded Vision Worksh…
Simulating the Visual Experience of Very Bright and Very Dark Scenes
David Jacobs, Orazio Gallo, Emily Cooper, Kari Pulli, Marc Levoy
ACM Transaction on Graphics
Machine Learning for Adaptive Bilateral Filtering
Iuri Frosio, Karen Egiazarian, Kari Pulli
Proc. SPIE 9399, Image Processing: Algorithms and Systems XIII

2014

FlexISP: A Flexible Camera Image Processing Framework
Felix Heide, Markus Steinberger, Yun-Ta Tsai, Mushfiqur Rouf, Dawid Pająk, Dikpal Reddy, Orazio Gallo, Jing Liu, Wolfgang Heidrich, Karen Egiazarian, Jan Kautz, Kari Pulli
Proc. ACM SIGGRAPH Asia
A Non-Linear Filter for Gyroscope-Based Video Stabilization
Steven Bell, Alejandro Troccoli, Kari Pulli
European Conference on Computer Vision 2014
Fast ANN for High-Quality Collaborative Filtering
Yun-Ta Tsai, Markus Steinberger, Dawid Pająk, Kari Pulli
HPG
Dynamic Image Stacks
David E. Jacobs, Orazio Gallo, Kari Pulli
The Fourth IEEE Workshop on Mobile Vision

2013

WYSIWYG Computational Photography via Viewfinder Editing
Jongmin Baek, Dawid Pająk, Kihwan Kim, Kari Pulli, Marc Levoy
Proc. ACM SIGGRAPH Asia
HDR Deghosting: How to Deal with Saturation?
Jun Hu, Orazio Gallo, Kari Pulli, Xiaobai Sun
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition

2012

Exposure Stacks for Live Scenes with Hand-held Cameras
Jun Hu, Orazio Gallo, Kari Pulli
Proceedings of the European Conference of Computer Vision
Metering for Exposure Stacks
Orazio Gallo, Marius Tico, Roberto Manduchi, Natasha Gelfand, Kari Pulli
Eurographics 2012
FCam for Multiple Cameras
Alejandro Troccoli, Dawid Pająk, Kari Pulli
SPIE Electronic Imaging: Multimedia on Mobile Images 2012

2010

Optical Image Processing Using Light Modulation Displays
David Luebke, Gordon Wetzstein, Wolfgang Heidrich
Computer Graphics Forum

2008

Lossless and Near Lossless Compression of Real Color Filter Array data
Karen Eguiazarian, co-author: Andriy Bazhyna
IEEE Transactions on Consumer Electronics, vol. 54, no. 4, pp. 1492-1500
Real-time Editing and Relighting of Homogeneous Translucent Materials
Rui Wang, Qianyong Chen, Ewen Cheslack-Postava, David Luebke, Rui Wang, Qunsheng Peng, Hujun Bao
Computer Graphics International 2008
GPU Computing
John D. Owens, Mike Houston, David Luebke, Simon Green, John E. Stone, James C. Phillips
Proceedings of the IEEE

Researchers

Bart Wronski
Charles Loop
Craig Kolb
Iuri Frosio
Jae-Hyun Jung
Jan Kautz
Jinwei Gu
Joohwan Kim
Ming-Yu Liu
Morteza Mardani
Orazio Gallo
Seungjun Nah