Research Areas

Weakly-Supervised Physically Unconstrained Gaze Estimation

Rakshit Kothari, Shalini De Mello, Umar Iqbal, Wonmin Byeon, Seonwook Park, Jan Kautz

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2021

Learning to Track Instances without Video Annotations

Yang Fu, Sifei Liu, Umar Iqbal, Shalini De Mello, Humphrey Shi, Jan Kautz

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2021

Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapes

Towaki Takikawa, Joey Litalien, Kangxue Yin, Karsten Kreis, Charles Loop, Derek Nowrouzezahrai, Alec Jacobson, Morgan McGuire, Sanja Fidler

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2021

Deep Two-View Structure-from-Motion Revisited

Jianyuan Wang, Yiran Zhong, Yuchao Dai, Stan Birchfield, Kaihao Zhang, Nikolai Smolyanskiy, Hongdong Li

CVPR 2021

See through Gradients: Image Batch Recovery via GradInversion

Hongxu Danny Yin, Arun Mallya, Arash Vahdat, Jose M. Alvarez, Jan Kautz, Pavlo Molchanov

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2021

Optimal Quantization Using Scaled Codebook

Yerlan Idelbayev, Pavlo Molchanov, Maying Shen, Hongxu Danny Yin, Miguel A. Carreira-Perpinan, Jose M. Alvarez

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2021

DexYCB: A Benchmark for Capturing Hand Grasping of Objects

Yu-Wei Chao, Wei Yang, Yu Xiang, Pavlo Molchanov, Ankur Handa, Jonathan Tremblay, Yashraj Narang, Karl Van Wyk, Umar Iqbal, Stan Birchfield, Jan Kautz, Dieter Fox

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2021

NViSII: A Scriptable Tool for Photorealistic Image Generation

Nathan Morrical, Jonathan Tremblay, Yunzhi Lin, Stephen Tyree, Stan Birchfield, Valerio Pascucci, Ingo Wald

SDG Workshop at ICLR 2021

RGB-D Local Implicit Function for Depth Completion of Transparent Objects

Luyang Zhu, Arsalan Mousavian, Yu Xiang, Hammad Mazhar, Jozef van Eenbergen, Shoubhik Debnath, Dieter Fox

CVPR 2021

Reactive Human-to-Robot Handovers of Arbitrary Objects

Wei Yang, Chris Paxton, Arsalan Mousavian, Yu-Wei Chao, Maya Cakmak, Dieter Fox

ICRA 2021

Best Paper in Human-Robot Interaction, ICRA 2021

Robust Vision-Based Cheat Detection in Competitive Gaming

Aditya Jonnalagadda, Iuri Frosio, Seth Schenider, Morgan McGuire, Joohwan Kim

I3D ’21

Self-Supervised Learning for Domain Adaptation on Point-Clouds

Idan Achituve, Haggai Maron, Gal Chechik

Winter Conference on Applications of Computer Vision (WACV), 2021

Data-Free Knowledge Distillation for Object Detection

Akshay Chawla, Hongxu Danny Yin, Pavlo Molchanov, Jose M. Alvarez

WACV 2021

From Generalized Zero-Shot Learning to Long-Tail with Class Descriptors

Dvir Samuel, Yuval Atzmon, Gal Chechik

Winter Conference on Applications of Computer Vision (WACV) 2021

2020

Online Adaptation for Consistent Mesh Reconstruction in the Wild

Xueting Li, Sifei Liu, Shalini De Mello, Kihwan Kim, Xiaolong Wang, Ming-Hsuan Yang, Jan Kautz

Neural Information Processing Systems (NeurIPS) 2020

Self-Learning Transformations for Improving Gaze and Head Redirection

Yufeng Zheng, Seonwook Park, Xucong Zhang, Shalini De Mello, Otmar Hilliges

Neural Information Processing Systems (NeurIPS) 2020

A Causal View of Compositional Zero-Shot Recognition

Yuval Atzmon, Felix Kreuk, Uri Shalit, Gal Chechik

Neural Information Processing Systems (NeurIPS) 2020 (Spotlight)

Neural Networks with Recurrent Generative Feedback

Yujia Huang, James Gornet, Sihui Dai, Zhiding Yu, Tan Nguyen, Doris Y. Tsao, Anima Anandkumar

Conference on Neural Information Processing Systems (NeurIPS) 2020

Learning Deformable Tetrahedral Meshes for 3D Reconstruction

Jun Gao, Wenzheng Chen, Tommy Xiang, Clement Fuji Tsang, Alec Jacobson, Morgan McGuire

Generative View Synthesis: From Single-View Semantics to Novel-View Images

Tewodros Abtegebrial, Varun Jampani, Orazio Gallo, Didier Stricker

Bongard-LOGO: A New Benchmark for Human-Level Concept Learning and Reasoning

Weili Nie, Zhiding Yu, Lei Mao, Ankit B. Patel, Yuke Zhu, Anima Anandkumar

Conference on Neural Information Processing Systems (NeurIPS) 2020 (Spotlight)

ZEST: Zero-shot Learning from Text Descriptions using Textual Similarity and Visual Summarization

Tzuf Paz-Argaman, Yuval Atzmon, Gal Chechik, Reut Tsarfaty

Findings of EMNLP

Learning Object Permanence from Video

Aviv Shamsian, Ofri Kleinfeld, Amir Globerson, Gal Chechik

ECCV 2020

LAMP: Large Deep Nets with Automated Model Parallelism for Image Segmentation

Wentao Zhu, Can Zhao, Wenqi Li, Holger Roth, Ziyue Xu, Daguang Xu

MICCAI 2020

VAEBM: A Symbiosis between Variational Autoencoders and Energy-based Models

Zhisheng Xiao, Karsten Kreis, Jan Kautz, Arash Vahdat

International Conference on Learning Representations (ICLR), 2021 (Spotlight)

UNAS: Differentiable Architecture Search Meets Reinforcement Learning

Arash Vahdat, Arun Mallya, Ming-Yu Liu, Jan Kautz

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2021

Joint Disentangling and Adaptation for Cross-Domain Person Re-Identification

Yang Zou, Xiaodong Yang, Zhiding Yu, B. V. K. Vijaya Kumar, Jan Kautz

European Conference on Computer Vision (ECCV) 2020 (Oral)

UFO2: A Unified Framework towards Omni-supervised Object Detection

Zhongzheng Ren, Zhiding Yu, Xiaodong Yang, Ming-Yu Liu, Alexander G. Schwing, Jan Kautz

European Conference on Computer Vision (ECCV) 2020

Weakly-Supervised 3D Hand Pose Estimation via Biomechanical Constraints

Adrian Spurr, Umar Iqbal, Pavlo Molchanov, Otmar Hilliges, Jan Kautz

European Conference on Computer Vision, 2020

World-Consistent Video-to-Video Synthesis

Arun Mallya, Ting-Chun Wang, Karan Sapra, Ming-Yu Liu

Self-supervised Single-view 3D Reconstruction via Semantic Consistency

Xueting Li, Sifei Liu, Kihwan Kim, Shalini De Mello, Varun Jampani, Ming-Hsuan Yang, Jan Kautz

European Conference on Computer Vision

Indirect Object-to-Robot Pose Estimation from an External Monocular RGB Camera

Jonathan Tremblay, Stephen Tyree, Terry Mosier, Stan Birchfield

IROS 2020

Weakly Supervised One-stage Vision and Language Disease Detection using Large Scale Pneumonia and Pneumothorax Studies

Leo Tam, Xiaosong Wang, Evrim Turkbey, Kevin Lu, Yuhong Wen, Daguang Xu

MICCAI 2020

Semi-Supervised StyleGAN for Disentanglement Learning

Weili Nie, Tero Karras, Animesh Garg, Shoubhik Debnath, Anjul Patney, Ankit B. Patel, Anima Anandkumar

International Conference on Machine Learning (ICML) 2020

Angular Visual Hardness

Beidi Chen, Weiyang Liu, Zhiding Yu, Jan Kautz, Anshumali Shrivastava, Animesh Garg, Anima Anandkumar

International Conference on Machine Learning (ICML) 2020

Automated Synthetic-to-Real Generalization

Wuyang Chen, Zhiding Yu, Zhangyang Wang, Anima Anandkumar

International Conference on Machine Learning (ICML) 2020

NVAE: A Deep Hierarchical Variational Autoencoder

Arash Vahdat, Jan Kautz

Neural Information Processing Systems (NeurIPS) 2020 (Spotlight)

Contrastive Learning for Weakly Supervised Phrase Grounding

Tanmay Gupta, Arash Vahdat, Gal Chechik, Xiaodong Yang, Jan Kautz, Derek Hoiem

European Conference on Computer Vision (ECCV) 2020 (Spotlight)

Meshlet Priors for 3D Mesh Reconstruction

Abhishek Badki, Orazio Gallo, Jan Kautz, Pradeep Sen

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2020

Instance-aware, Context-focused, and Memory-efficient Weakly Supervised Object Detection

Zhongzheng Ren, Zhiding Yu, Xiaodong Yang, Ming-Yu Liu, Yong Jae Lee, Alexander G. Schwing, Jan Kautz

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2020

Regularizing Neural Networks via Minimizing Hyperspherical Energy

Weiyang Liu, Rongmei Lin, Zhen Liu, Chen Feng, Zhiding Yu, James M. Rehg, Li Xiong, Le Song

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2020

Bi3D: Stereo Depth Estimation via Binary Classifications

Abhishek Badki, Alejandro Troccoli, Kihwan Kim, Jan Kautz, Pradeep Sen, Orazio Gallo

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2020

Two-shot Spatially-varying BRDF and Shape Estimation

Mark Boss, Varun Jampani, Kihwan Kim, Hendrik P.A. Lensch, Jan Kautz

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2020

Self-Supervised Viewpoint Learning From Image Collections

Siva Karthik Mustikovela, Varun Jampani, Shalini De Mello, Sifei Liu, Umar Iqbal, Carsten Rother, Jan Kautz

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2020

Dreaming to Distill: Data-free Knowledge Transfer via DeepInversion

Hongxu Danny Yin, Pavlo Molchanov, Jose M. Alvarez, Zhizhong Li, Arun Mallya, Derek Hoiem, Niraj K. Jha, Jan Kautz

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2020 (Ora…

Novel View Synthesis of Dynamic Scenes with Globally Coherent Depths

Jae shin Yoon, Kihwan Kim, Orazio Gallo, Hyunsoo Park, Jan Kautz

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2020

MVLidarNet: Real-Time Multi-Class Scene Understanding for Autonomous Driving Using Multiple Views

Ke Chen, Ryan, Nikolai, Stan Birchfield, Alexander Popov, David Wehr, Ibrahim Eden, Joachim Pehserl

IROS 2020

Learning Canonical Representations for Scene Graph to Image Generation

Roei Herzig, Amir Bar, Huijuan Xu, Gal Chechik, Trevor Darrell, Amir Globerson

ECCV 2020

6-DOF Grasping for Target-driven Object Manipulation in Clutter

Adithyavairavan Murali, Arsalan Mousavian, Clemens Eppner, Chris Paxton, Dieter Fox

ICRA 2020

Best Paper Finalist in Robot Manipulation, ICRA 2020, Best Student Paper Finalist, ICRA 2020

Weakly-Supervised 3D Human Pose Learning via Multi-view Images in the Wild

Umar Iqbal, Pavlo Molchanov, Jan Kautz

IEEE Computer Vision and Pattern Recognition

Self-supervised 6D Object Pose Estimation for Robot Manipulation

Xinke Deng, Yu Xiang, Arsalan Mousavian, Clemens Eppner, Timothy Bretl, Dieter Fox

2020 IEEE International Conference on Robotics and Automation (ICRA)

Camera-to-Robot Pose Estimation from a Single Image

Timothy E. Lee, Jonathan Tremblay, Thang To, Jia Cheng, Terry Mosier, Oliver Kroemer, Dieter Fox, Stan Birchfield

ICRA 2020

Toward Sim-to-Real Directional Semantic Grasping

Shariq Iqbal, Jonathan Tremblay, Thang To, Jia Cheng, Erik Leitch, Andy Campbell, Kirby Leung, Duncan McKay, Stan Birchfield

ICRA 2020

How to close sim-real gap? transfer with segmentation!

Mengyuan Yan, Qingyun Sun, Iuri Frosio, Stephen Tyree, Jan Kautz

arxiv

DexPilot: Vision Based Teleoperation of Dexterous Robotic Hand-Arm System

Ankur Handa, Karl Van Wyk, Wei Yang, Jacky Liang, Yu-Wei Chao, Qian Wan, Stan Birchfield, Nathan Ratliff, Dieter Fox

ICRA 2020

NRMVS: Non-Rigid Multi-view Stereo

Matthias Innmann, Kihwan Kim, Jinwei Gu, Matthias Niessner , Charles Loop, Marc Stamminger, Jan Kautz

IEEE Winter Conference on Applications of Computer Vision (WACV ’20)

SymGAN: Orientation Estimation without Annotation for Symmetric Objects

Phil Ammirato, Jonathan Tremblay, Ming-Yu Liu, Alexander Berg, Dieter Fox

WACV

Neurreg: Neural registration and its application to image segmentation

Wentao Zhu, Andriy Myronenko, Ziyue Xu, Wenqi Li, Holger Roth, Yufang Huang, Fausto Milletari, Daguang Xu

WACV

Domain Stylization: A Fast Covariance Matching Framework towards Domain Adaptation

Aysegul Dundar, Ming-Yu Liu, Zhiding Yu, Ting-Chun Wang, John Zedlewski, Jan Kautz

IEEE Transactions on Pattern Analysis and Machine Intelligence

Displacement-Invariant Cost Computation for Efficient Stereo Matching

Yiran Zhong, Charles Loop, Wonmin Byeon, Stan Birchfield, Yuchao Dai, Kaihao Zhang, Alexey Kamenev, Thomas Breuel, Hongdong Li, Jan Kautz

arXiv

Improving Deep Stereo Network Generalization with Geometric Priors

Jialiang Wang, Varun Jampani, Deqing Sun, Charles Loop, Stan Birchfield, Jan Kautz

arXiv

2019

Few-Shot Video-to-Video Synthesis

Ting-Chun Wang, Ming-Yu Liu, Andrew Tao, Guilin Liu, Jan Kautz, Bryan Catanzaro

Joint-task Self-supervised Learning for Temporal Correspondence

Xueting Li, Sifei Liu, Shalini De Mello, Xiaolong Wang, Jan Kautz, Ming-Hsuan Yang

Dance to Music

Hsin-Ying Lee, Xiaodong Yang, Ming-Yu Liu, Ting-Chun Wang, Yu-Ding Lu, Ming-Hsuan Yang, Jan Kautz

Joint Optimization for Cooperative Image Captioning

Gilad Vered, Gal Oren, Yuval Atzmon, Gal Chechik

International conference on computer vision (ICCV)

Content-Consistent Generation of Realistic Eyes with Style

Marcel Bühler , Seonwook Park, Shalini De Mello, Xucong, Otmar Hilliges

International Conference on Computer Vision Workshop

Few-Shot Adaptive Gaze Estimation

Seonwook Park, Shalini De Mello, Pavlo Molchanov, Umar Iqbal, Otmar Hilliges, Jan Kautz

International Conference on Computer Vision

Neural Inverse Rendering of an Indoor Scene from a Single Image

Soumyadip Sengupta, Jinwei Gu, Kihwan Kim, Guilin Liu, David W. Jacobs, Jan Kautz

IEEE International Conference on Computer Vision (ICCV 2019)

PAMTRI: Pose-Aware Multi-Task Learning for Vehicle Re-Identification Using Highly Randomized Synthetic Data

Zheng Tang, Milind Naphade, Stan Birchfield, Jonathan Tremblay, William Hodge, Ratnesh Kumar, Shuo Wong, Xiaodong Yang

ICCV 2019

Few-Shot Unsupervised Image-to-Image Translation

Ming-Yu Liu, Xun Huang, Arun Mallya, Tero Karras, Timo Aila, Jaakko Lehtinen, Jan Kautz

Meta-Sim: Learning to Generate Synthetic Datasets

Amlan Kar, Aayush Prakash, Ming-Yu Liu, Eric Cameracci, Justin Yuan, Matt Rusiniak, David Acuna, Antonio Torralba, Sanja Fidler

Confidence Regularized Self-Training

Yang Zou, Zhiding Yu, Xiaofeng Liu, B. V. K. Vijaya Kumar, Jinsong Wang

IEEE/CVF International Conference on Computer Vision (ICCV) 2019 (Oral)

SENSE: A Shared Encoder Network for Scene-flow Estimation

Huaizu Jiang, Deqing Sun, Varun Jampani, Zhaoyang Lv, Erik Learned-Miller, Jan Kautz

International Conference in Computer Vision

Extreme View Synthesis

Inchang Choi, Orazio Gallo, Alejandro Troccoli, Min H. Kim, Jan Kautz

IEEE International Conference of Computer Vision

PointFlow: 3D Point Cloud Generation with Continuous Normalizing Flows

Guandao Yang, Xun Huang, Zekun Hao, Ming-Yu Liu, Serge Belongie, Bharath Hariharan

6-DOF GraspNet: Variational Grasp Generation for Object Manipulation

Arsalan Mousavian, Clemens Eppner, Dieter Fox

ICCV 2019

Neural Turtle Graphics for Modeling City Road Layouts

Hang Chu, Daiqing Li, David Acuna, Amlan Kar, Maria Shugrina, Xinkai Wei, Ming-Yu Liu, Antonio Torralba, Sanja Fidler

Learning Propagation for Arbitrarily-Structured Data

Sifei Liu, Xueting Li, Varun Jampani, Shalini De Mello, Jan Kautz

ICCV 2019

Video Stitching for Linear Camera Arrays

Wei-Sheng Lai, Orazio Gallo, Jinwei Gu, Deqing Sun, Ming-Hsuan Yang, Jan Kautz

British Machine Vision Conference

Few-Shot Viewpoint Estimation

Hung-Yu Tseng, Shalini De Mello, Jonathan Tremblay, Sifei Liu, Stan Birchfield, Ming-Hsuan Yang, Jan Kautz

British Machine Vision Conference (BMVC) 2019

PlaneRCNN: 3D Plane Detection and Reconstruction from a Single Image

Chen Liu, Kihwan Kim, Jinwei Gu, Yasutaka Furukawa, Jan Kautz

IEEE CVPR 2019 (Oral)

Pixel-Adaptive Convolutional Neural Networks

Hang Su, Varun Jampani, Deqing Sun, Orazio Gallo, Erik-Learned Miller, Jan Kautz

Computer Vision and Pattern Recognition (CVPR), 2019

CityFlow: A City-Scale Benchmark for Multi-Target Multi-Camera Vehicle Tracking and Re-Identification

Zheng Tang, Milind Naphade, Ming-Yu Liu, Xiaodong Yang, Stan Birchfield, Shuo Wang, Ratnesh Kumar, David Anastasiu, Jenq-Neng Hwan

SCOPS: Self-Supervised Co-Part Segmentation

Wei-Chih Hung, Varun Jampani, Sifei Liu, Pavlo Molchanov, Ming-Hsuan Yang , Jan Kautz

SIDOD: A Synthetic Image Dataset for 3D Object Pose Recognition with Distractors

Mona Jalal, Josef Spjut, Ben Boudaoud, Margrit Betke

WiCV

Semantic Image Synthesis with Spatially-Adaptive Normalization

Taesung Park, Ming-Yu Liu, Ting-Chun Wang, Jun-Yan Zhu

Neural RGB->D Sensing: Depth and Uncertainty from a Video Camera

Chao Liu, Jinwei Gu, Kihwan Kim, Srinivasa Narasimhan, Jan Kautz

IEEE CVPR 2019 (Oral)

Joint Discriminative and Generative Learning for Person Re-identification

Zhedong Zheng, Xiaodong Yang, Zhiding Yu, Liang Zheng, Yi Yang, Jan Kautz

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2019

Competitive Collaboration: Joint Unsupervised Learning of Depth, Camera Motion, Optical Flow and Motion Segmentation

Anurag Ranjan, Varun Jampani, Lukas Balles, Kihwan Kim, Deqing Sun, Jonas Wulff, Michael J. Black

IEEE CVPR 2019

Putting Humans in a Scene: Learning Affordance in 3D Indoor Environments

Xueting Li, Sifei Liu, Kihwan Kim, Xiaolong Wang, Ming-Hsuan Yang, Jan Kautz

STEP: Spatio-Temporal Progressive Learning for Video Action Detection

Xitong Yang, Xiaodong Yang, Ming-Yu Liu, Fanyi Xiao, Larry Davis, Jan Kautz

Learning Linear Transformations for Fast Image and Video Style Transfer

Xueting Li, Sifei Liu, Ming-Hsuan Yang, Jan Kautz

Informative Object Annotations: Tell Me Something I Don't Know

Lior Bracha, Gal Chechik

Computer Vision and Pattern Recognition

Adaptive Confidence Smoothing for Generalized Zero-Shot Learning

Yuval Atzmon, Gal Chechik

Computer Vision and Pattern Recognition (CVPR) 2019

Unsupervised Stylish Image Description Generation via Domain Layer Norm

Cheng-Kuan Chen, Zhu-Feng Pan, Ming-Yu Liu, Min Sun

AAAI

Models Matter, So Does Training: An Empirical Study of CNNs for Optical Flow Estimation

Deqing Sun, Xiaodong Yang, Ming-Yu Liu, Jan Kautz

TPAMI

A Fusion Approach for Multi-Frame Optical Flow Estimation

Zhile Ren, Orazio Gallo, Deqing Sun, Ming-Hsuan Yang, Erik B. Sudderth, Jan Kautz

IEEE Winter conference of Applications of Computer Vision (WACV)

2018

Localization-Aware Active Learning for Object Detection

Chieh-Chi Kao, Teng-Yok Lee, Pradeep Sen, Ming-Yu Liu

ACCV

Learning towards Minimum Hyperspherical Energy

Weiyang Liu, Rongmei Lin, Zhen Liu, Lixin Liu, Zhiding Yu, Bo Dai, Le Song

Conference on Neural Information Processing Systems (NeurIPS) 2018

Video-to-Video Synthesis

Ting-Chun Wang, Ming-Yu Liu, Jun-Yan Zhu, Guilin Liu, Andrew Tao, Jan Kautz, Bryan Catanzaro

NIPS

Context-aware Synthesis and Placement of Object Instances

Donghoon Lee, Sifei Liu, Jinwei Gu, Ming-Yu Liu, Ming-Hsuan Yang, Jan Kautz

NIPS

Context-aware Synthesis and Placement of Object Instances

Donghoon Lee, Sifei Liu, Jinwei Gu, Ming-Yu Liu, Ming-Hsuan Yang, Jan Kautz

NIPS

Mapping Images to Scene Graphs with Permutation-Invariant Structured Prediction

Roei Herzig, Moshiko Raboh, Gal Chechik, Jonathan Berant, Amir Globerson

Neural Information processing systems (NeurIPS)

Structured Domain Randomization: Bridging the Reality Gap by Context-Aware Synthetic Data

Aayush Prakash, Shaad Boochoon, Mark Brophy, David Acuna, Eric Cameracci, Gavriel State, Omer Shapira, Stan Birchfield

ICRA 2019

Deep Object Pose Estimation for Semantic Robotic Grasping of Household Objects

Jonathan Tremblay, Thang To, Bala Sundaralingam, Yu Xiang, Dieter Fox, Stan Birchfield

Conference on Robot Learning (CoRL) 2018

Hand Pose Estimation via Latent 2.5 D Heatmap Regression

Umar Iqbal, Pavlo Molchanov, Thomas Breuel, Juergen Gall, Jan Kautz

ECCV2018

Tackling 3D ToF Artifacts Through Learning and the FLAT Dataset

Qi Guo, Iuri Frosio, Orazio Gallo, Todd Zickler, Jan Kautz

ECCV 2018

Separating Reflection and Transmission Images in the Wild

Patrick Wieschollek, Orazio Gallo, Jinwei Gu, Jan Kautz

European Conference of Computer Vision (ECCV)

Learning Rigidity in Dynamic Scenes with a Moving Camera for 3D Motion Field Estimation

Zhaoyang Lv, Kihwan Kim, Alejandro Troccoli, Deqing Sun, James M. Rehg, Jan Kautz

European Conference on Computer Vision (ECCV 2018)

Switchable Temporal Propagation Network

Sifei Liu, Guangyu Zhong, Shalini De Mello, Jinwei Gu, Varun Jampani

ECCV 2018

Simultaneous Edge Alignment and Learning

Zhiding Yu, Weiyang Liu, Yang Zou, Chen Feng, Srikumar Ramalingam, B. V. K. Vijaya Kumar, Jan Kautz

European Conference on Computer Vision (ECCV) 2018

HGMR: Hierarchical Gaussian Mixtures for Adaptive 3D Registration

Ben Eckart, Kihwan Kim, Jan Kautz

European Conference on Computer Vision (ECCV 2018)

Image Inpainting for Irregular Holes Using Partial Convolutions

Guilin Liu, Fitsum A. Reda, Kevin Shih, Ting-Chun Wang, Andrew Tao, Bryan Catanzaro

Domain Adaptation for Semantic Segmentation via Class-Balanced Self-Training

Yang Zou, Zhiding Yu, B. V. K. Vijaya Kumar, Jinsong Wang

European Conference on Computer Vision (ECCV) 2018

Multimodal Unsupervised Image-to-Image Translation

Xun Huang, Ming-Yu Liu, Serge Belongie, Jan Kautz

A Closed-form Solution to Photorealistic Image Stylization

Yijun Li, Ming-Yu Liu, Xueting Li, Ming-Hsuan Yang, Jan Kautz

EOE: Expected Overlap Estimation over Unstructured Point Cloud Data

Ben Eckart, Kihwan Kim, Jan Kautz

International Conference on 3D Vision (3DV) 2018

3D MRI Brain Tumor Segmentation Using Autoencoder Regularization

Andriy Myronenko

MICCAI, BrainLes, 2018

Superpixel Sampling Networks

Varun Jampani, Deqing Sun, Ming-Yu Liu, Ming-Hsuan Yang, Jan Kautz

European Conference on Computer Vision (ECCV), 2018

Noise2Noise: Learning Image Restoration without Clean Data

Jaakko Lehtinen, Jacob Munkberg, Jon Hasselgren, Samuli Laine, Tero Karras, Miika Aittala, Timo Aila

Proc. ICML 2018

Light-weight Head Pose Invariant Gaze Tracking

Rajeev Ranjan, Shalini De Mello, Jan Kautz

IEEE Computer Vision and Pattern Recognition Workshop

Learning Superpixels with Segmentation-Aware Affinity Losse

Wei-Chih Tu, Ming-Yu Liu, Varun Jampani, Deqing Sun, Shao-Yi Chien, Ming-Hsuan Yang, Jan Kautz

MoCoGAN: Decomposing Motion and Content for Video Generation

Sergey Tulyakov, Ming-Yu Liu, Xiaodong Yang, Jan Kautz

Improving Landmark Localization with Semi-Supervised Learning

Sina Honari, Pavlo Molchanov, Stephen Tyree, Pascal Vincent, Christopher Pal, Jan Kautz

Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolation

Huaizu Jiang, Deqing Sun, Varun Jampani, Ming-Hsuan Yang, Erik Learned-Miller, Jan Kautz

CVPR 2018

Depth-Based 3D Hand Pose Estimation: From Current Achievements to Future Goals

Shanxin Yuan, Guillermo Garcia-Hernando, Bjorn Stenger, Pavlo Molchanov, Jan Kautz, Sina Honari

Conference on Computer Vision and Pattern Recognition

Learning Strict Identity Mappings in Deep Residual Networks

Xin Yu, Zhiding Yu, Srikumar Ramalingam

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2018

Deep Semantic Face Deblurring

Ziyi Shen, Wei-Sheng Lai, Tingfa Xu, Jan Kautz, Ming-Hsuan Yang

IEEE Computer Vision and Pattern Recognition (CVPR)

Decoupled Networks

Weiyang Liu, Zhen Liu, Zhiding Yu, Bo Dai, Rongmei Lin, Yisen Wang, James M. Rehg, Le Song

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2018

High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs

Ting-Chun Wang, Ming-Yu Liu, Jun-Yan Zhu, Andrew Tao, Jan Kautz, Bryan Catanzaro

PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volume

Deqing Sun, Xiaodong Yang, Ming-Yu Liu, Jan Kautz

SPLATNet: Sparse Lattice Networks for Point Cloud Processing

Hang Su, Varun Jampani, Deqing Sun, Subhransu Maji, Evangelos Kalogerakis, Ming-Hsuan Yang, Jan Kautz

CVPR 2018 (oral)

Making Convolutional Networks Recurrent for Visual Sequence Learning

Xiaodong Yang, Pavlo Molchanov, Jan Kautz

IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

Geometry-Aware Learning of Maps for Camera Localization

Samarth Brahmbhatt, Jinwei Gu, Kihwan Kim, James Hays, Jan Kautz

CVPR 2018 (Spotlight)

Falling Things: A Synthetic Dataset for 3D Object Detection and Pose Estimation

Jonathan Tremblay, Thang To, Stan Birchfield

CVPR 2018 Workshop on Real World Challenges and New Benchmarks for Deep Learnin…

PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenes

Yu Xiang, Tanner Schmidt, Venkatraman Narayanan, Dieter Fox

Robotics: Science and Systems (RSS)

Synthetically Trained Neural Networks for Learning Human-Readable Plans from Real-World Demonstrations

Jonathan Tremblay, Thang To, Artem Molchanov, Stephen Tyree, Jan Kautz, Stan Birchfield

IEEE International Conference on Robotics and Automation (ICRA) 2018

Probabilistic AND-OR Attribute Grouping for Zero-Shot Learning

Yuval Atzmon, Gal Chechik

The conference on uncertainty in artificial intelligence (UAI 2018)

Reblur2Deblur: Deblurring Videos via Self-Supervised Learning

Huaijin Chen, Jinwei Gu, Orazio Gallo, Ming-Yu Liu, Ashok Veeraraghavan, Jan Kautz

IEEE International Conference on Computational Photography (ICCP)

Training Deep Networks with Synthetic Data: Bridging the Reality Gap by Domain Randomization

Jonathan Tremblay, Aayush Prakash, David Acuna, Mark Brophy, Varun Jampani, Cem Anil, Thang To, Eric Cameracci, Shaad Boochoon, Stan Birchfield

CVPR 2018 Workshop on Autonomous Driving

IamNN: Iterative and Adaptive Mobile Neural Network for Efficient Image Classification

Sam Leroux, Pavlo Molchanov, Pieter Simoens, Bart Dhoedt, Thomas Breuel, Jan Kautz

International Conference on Learning Representations, Workshop

On the Importance of Stereo for Accurate Depth Estimation: An Efficient Semi-Supervised Deep Neural Network Approach

Nikolai Smolyanskiy, Alexey Kamenev, Stan Birchfield

CVPR 2018 Workshop on Autonomous Driving

2017

Sim-to-Real Transfer of Accurate Grasping with Eye-In-Hand Observations and Continuous Control

Mengyuan Yan, Iuri Frosio, Stephen Tyree, Jan Kautz

NIPS 2017 Workshop on Acting and Interacting in the Real World: Challenges in …

On Nearest Neighbors in Non Local Means Denoising

Iuri Frosio, Jan Kautz

Neural Information Processing Systems (NIPS) 2017 Workshop on Nearest Neighbors…

Unsupervised Image-to-Image Translation Networks

Ming-Yu Liu, Thomas Breuel, Jan Kautz

NIPS

Learning Affinity via Spatial Propagation Networks

Sifei Liu, Shalini De Mello, Jinwei Gu, Guangyu Zhong, Ming-Hsuan Yang, Jan Kautz

Conference on Neural Information Processing Systems NIPS 2017

Learning to Super-Resolve Blurry Face and Text Images

Xiangyu Xu, Deqing Sun, Jinshan Pan, Yujin Zhang, Hanspeter Pfister, Ming-Hsuan Yang

International Conference on Computer Vision

Semantic Video CNNs through Representation Warping

Raghudeep Gadde, Varun Jampani, Peter V. Gehler

International Conference on Computer Vision (ICCV'17)

Intrinsic3D: High-Quality 3D Reconstruction by Joint Appearance and Geometry Optimization with Spatially-Varying Lighting

Robert Maier, Kihwan Kim, Daniel Cremers, Jan Kautz, Matthias Nießner

IEEE International Conference on Computer Vision (ICCV 2017)

A Lightweight Approach for On-the-Fly Reflectance Estimation

Kihwan Kim, Jinwei Gu, Stephen Tyree, Pavlo Molchanov, Matthias Nießner, Jan Kautz

IEEE International Conference on Computer Vision (ICCV 2017)

Cascaded Scene Flow Prediction using Semantic Segmentation

Zhile Ren, Deqing Sun, Jan Kautz, Erik B. Sudderth

International Conference on 3D Vision

Multiframe Scene Flow with Piecewise Rigid Motion

Vladislav Golyanik, Kihwan Kim, Robert Maier, Matthias Nießner, Didier Stricker, Jan Kautz

IEEE International Conference on 3D Vision (3DV 2017)

Toward Low-Flying Autonomous MAV Trail Navigation using Deep Neural Networks for Environmental Awareness

Nikolai Smolyanskiy, Alexey Kamenev, Jeffrey Smith, Stan Birchfield

IROS 2017

Dynamic Facial Analysis: From Bayesian Filtering to Recurrent Neural Networks

Jinwei Gu, Xiaodong Yang, Shalini De Mello, Jan Kautz

IEEE CVPR 2017

Deep 360 Pilot: Learning a Deep Agent for Piloting through 360 Sports Videos

Hou-Ning Hu, Yen-Chen Lin, Ming-Yu Liu, Hsien-Tzu Cheng, Yung-Ju Chang, Min Sun