Computer Vision

Associated Publications

Two-shot Spatially-varying BRDF and Shape Estimation
Self-Supervised Viewpoint Learning From Image Collections
Novel View Synthesis of Dynamic Scenes with Globally Coherent Depths
Toward Sim-to-Real Directional Semantic Grasping
DREAM, ICRA 2020
NRMVS: Non-Rigid Multi-view Stereo
SymGAN: Orientation Estimation without Annotation for Symmetric Objects
Neurreg: Neural registration and its application to image segmentation
Joint-task Self-supervised Learning for Temporal Correspondence
Dance to Music
Few-Shot Video-to-Video Synthesis
Joint Optimization for Cooperative Image Captioning
Content-Consistent Generation of Realistic Eyes with Style
Neural Inverse Rendering of an Indoor Scene from a Single Image
Few-Shot Adaptive Gaze Estimation
PAMTRI: Pose-Aware Multi-Task Learning for Vehicle Re-Identification Using Highly Randomized Synthetic Data
Few-Shot Unsupervised Image-to-Image Translation
PointFlow: 3D Point Cloud Generation with Continuous Normalizing Flows
6-DOF GraspNet: Variational Grasp Generation for Object Manipulation
Extreme View Synthesis
SENSE: A Shared Encoder Network for Scene-flow Estimation
Neural Turtle Graphics for Modeling City Road Layouts
Meta-Sim: Learning to Generate Synthetic Datasets
Learning Propagation for Arbitrarily-Structured Data
Video Stitching for Linear Camera Arrays
Few-Shot Viewpoint Estimation
Pixel-Adaptive Convolutional Neural Networks
PlaneRCNN: 3D Plane Detection and Reconstruction from a Single Image
Competitive Collaboration: Joint Unsupervised Learning of Depth, Camera Motion, Optical Flow and Motion Segmentation
SIDOD: A Synthetic Image Dataset for 3D Object Pose Recognition with Distractors
Putting Humans in a Scene: Learning Affordance in 3D Indoor Environments
Neural RGB->D Sensing: Depth and Uncertainty from a Video Camera
STEP: Spatio-Temporal Progressive Learning for Video Action Detection
SCOPS: Self-Supervised Co-Part Segmentation
Semantic Image Synthesis with Spatially-Adaptive Normalization
CityFlow: A City-Scale Benchmark for Multi-Target Multi-Camera Vehicle Tracking and Re-Identification
Learning Linear Transformations for Fast Image and Video Style Transfer
Domain-Aware Generalized Zero-Shot Learning
Informative Object Annotations: Tell Me Something I Don't Know
Unsupervised Stylish Image Description Generation via Domain Layer Norm
Models Matter, So Does Training: An Empirical Study of CNNs for Optical Flow Estimation
A Fusion Approach for Multi-Frame Optical Flow Estimation
Localization-Aware Active Learning for Object Detection
Context-aware Synthesis and Placement of Object Instances
Mapping Images to Scene Graphs with Permutation-Invariant Structured Prediction
Video-to-Video Synthesis
Structured Domain Randomization: Bridging the Reality Gap by Context-Aware Synthetic Data
Deep Object Pose Estimation for Semantic Robotic Grasping of Household Objects
Hand Pose Estimation via Latent 2.5 D Heatmap Regression
Separating Reflection and Transmission Images in the Wild
Tackling 3D ToF Artifacts Through Learning and the FLAT Dataset
Learning Rigidity in Dynamic Scenes with a Moving Camera for 3D Motion Field Estimation
HGMR: Hierarchical Gaussian Mixtures for Adaptive 3D Registration
Image Inpainting for Irregular Holes Using Partial Convolutions
Switchable Temporal Propagation Network
A Closed-form Solution to Photorealistic Image Stylization
Multimodal Unsupervised Image-to-Image Translation
EOE: Expected Overlap Estimation over Unstructured Point Cloud Data
Superpixel Sampling Networks
Noise2Noise: Learning Image Restoration without Clean Data
Light-weight Head Pose Invariant Gaze Tracking
Learning Superpixels with Segmentation-Aware Affinity Losse
MoCoGAN: Decomposing Motion and Content for Video Generation
Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolation
Improving Landmark Localization with Semi-Supervised Learning
Depth-Based 3D Hand Pose Estimation: From Current Achievements to Future Goals
Falling Things: A Synthetic Dataset for 3D Object Detection and Pose Estimation
SPLATNet: Sparse Lattice Networks for Point Cloud Processing
PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volume
Making Convolutional Networks Recurrent for Visual Sequence Learning
High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs
Deep Semantic Face Deblurring
Geometry-Aware Learning of Maps for Camera Localization
PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenes
Synthetically Trained Neural Networks for Learning Human-Readable Plans from Real-World Demonstrations
Probabilistic AND-OR Attribute Grouping for Zero-Shot Learning
Reblur2Deblur: Deblurring Videos via Self-Supervised Learning
Training Deep Networks with Synthetic Data: Bridging the Reality Gap by Domain Randomization
IamNN: Iterative and Adaptive Mobile Neural Network for Efficient Image Classification
On the Importance of Stereo for Accurate Depth Estimation: An Efficient Semi-Supervised Deep Neural Network Approach
On Nearest Neighbors in Non Local Means Denoising
Sim-to-Real Transfer of Accurate Grasping with Eye-In-Hand Observations and Continuous Control
Learning Affinity via Spatial Propagation Networks
Unsupervised Image-to-Image Translation Networks
Learning to Super-Resolve Blurry Face and Text Images
Intrinsic3D: High-Quality 3D Reconstruction by Joint Appearance and Geometry Optimization with Spatially-Varying Lighting
A Lightweight Approach for On-the-Fly Reflectance Estimation
Semantic Video CNNs through Representation Warping
Multiframe Scene Flow with Piecewise Rigid Motion
Cascaded Scene Flow Prediction using Semantic Segmentation
Toward Low-Flying Autonomous MAV Trail Navigation using Deep Neural Networks for Environmental Awareness
Dynamic Facial Analysis: From Bayesian Filtering to Recurrent Neural Networks
Deep 360 Pilot: Learning a Deep Agent for Piloting through 360 Sports Videos
Production-Level Facial Performance Capture Using Deep Convolutional Neural Networks
Computational Zoom: A Framework for Post-Capture Image Composition
Reconstructing Intensity Images from Binary Spatial Gradient Cameras
Polarimetric Multi-view Stereo
Context-aware Captions from Context-agnostic Supervision
Learning From Noisy Large-Scale Datasets With Minimal Supervision
Multilayer and Multimodal Fusion of Deep Neural Networks for Video Classification
Reflectance Modeling by Neural Texture Synthesis
Online Detection and Classification of Dynamic Hand Gestures with Recurrent 3D Convolutional Neural Networks
Accelerated Generative Models for 3D Point Cloud Data
Robust Model-based 3D Head Pose Estimation
MLMD: Maximum Likelihood Mixture Decoupling for Fast and Accurate Point Cloud Registration
Hand Gesture Recognition with 3D Convolutional Neural Networks
Filtering Environment Illumination for Interactive Physically-Based Rendering in Mixed Reality
Retrieving Gray-Level Information from a Binary Sensor and its Application to Gesture Detection
Camera Re-calibration after Zooming based on Sets of Conics
Adaptive Segmentation based on a Learned Quality Metric
DT-SLAM: Deferred Triangulation for Robust SLAM
Addressing System-Level Optimization with OpenVX Graphs
WYSIWYG Computational Photography via Viewfinder Editing
An Energy Efficient Time-sharing Pyramid Pipeline for Multi-resolution Computer Vision
Practical SVBRDF Capture in the Frequency Domain
Realtime Computer Vision with OpenCV
Detecting Regions of Interest in Dynamic Scenes with Camera Motions
Robust Stereo with Flash and No-flash Image Pairs
What Characterizes a Shadow Boundary under Sun and Sky?
Gaussian Process Regression Flow for Analysis of Motion Trajectories
Dynamic Hand Gesture Recognition