People

Pavlo Molchanov

Pavlo Molchanov obtained PhD from Tampere University of Technology, Finland in the area of signal processing in 2014. His dissertation was focused on designing automatic target recognition systems for radars. Since 2015 he is with Learning and Perception Research team at NVIDIA, currently holding a senior research scientist position. His research is focused on methods for neural network acceleration, and designing novel human-computer interaction systems and human understanding. On the network acceleration he is interested in neural network pruning methods and conditional inference. For human understanding he is working on landmark estimation, gesture recognition, hand pose estimation. He received EuRAD best paper award in 2011 and EuRAD young engineer award in 2013.

Research Area(s)
Algorithms and Numerical Methods
Computer Vision
Artificial Intelligence and Machine Learning
Main Field of Interest
Artificial Intelligence and Machine Learning
Google Scholar
https://scholar.google.com/citations?user=J9PoyoIAAAAJ&hl=en

Publications

2024

LLM Pruning and Distillation in Practice: The Minitron Approach
Sharath Turuvekere Sreenivas, Saurav Muralidharan, Raviraj Joshi, Marcin Chochowski, Mostofa Patwary, Mohammad Shoeybi, Bryan Catanzaro, Jan Kautz, Pavlo Molchanov
DoRA: Weight-Decomposed Low-Rank Adaptation
Shih-Yang Liu, Chien-Yi Wang, Hongxu Danny Yin, Pavlo Molchanov, Frank Wang, Kwang-Ting Cheng, Min-Hung Chen
International Conference on Machine Learning (ICML) 2024
FasterViT: Fast Vision Transformers with Hierarchical Attention
Ali Hatamizadeh, Greg Heinrich, Hongxu Danny Yin, Andrew Tao, Jose M. Alvarez, Jan Kautz, Pavlo Molchanov
International Conference on Learning Representations (ICLR) 2024

2023

Global Context Vision Transformers
Ali Hatamizadeh, Hongxu Danny Yin, Greg Heinrich, Jan Kautz, Pavlo Molchanov
International Conference on Machine Learning (ICML) 2023

2022

Structural Pruning via Latency-Saliency Knapsack
Maying Shen, Hongxu Danny Yin, Pavlo Molchanov, Lei Mao, Jianna Liu, Jose M. Alvarez
NeurIPS 2022
LANA: Latency Aware Network Acceleration
Pavlo Molchanov, Jimmy Hall, Hongxu Danny Yin, Jan Kautz, Nicolo Fusi, Arash Vahdat
European Conference on Computer Vision (ECCV), 2022
GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Cameras
Ye Yuan, Umar Iqbal, Pavlo Molchanov, Kris Kitani, Jan Kautz
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2022 (Ora…
A-ViT: Adaptive Tokens for Efficient Vision Transformer
Hongxu Danny Yin, Arash Vahdat, Jose M. Alvarez, Arun Mallya, Jan Kautz, Pavlo Molchanov
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2022 (Ora…
When to Prune? A Policy towards Early Structural Pruning
Maying Shen, Pavlo Molchanov, Hongxu Danny Yin, Jose M. Alvarez
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2022
GradViT: Gradient Inversion of Vision Transformers
Ali Hatamizadeh, Hongxu Danny Yin, Holger Roth, Wenqi Li, Jan Kautz, Daguang Xu, Pavlo Molchanov
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2022

2021

KAMA: 3D Keypoint Aware Body Mesh Articulation
Umar Iqbal, Kevin Xie, Kelly Guo, Jan Kautz, Pavlo Molchanov
International Conference on 3D Vision
Optimizing Selective Protection for CNN Resilience
Abdulrahman Mahmoud, Siva Hari, Christopher W. Fletcher, Sarita V. Adve, Charbel Sakr, Naresh Shanbhag, Pavlo Molchanov, Michael B. Sullivan, Timothy Tsai, Steve Keckler
International Symposium on Software Reliability Engineering (ISSRE)
See through Gradients: Image Batch Recovery via GradInversion
Hongxu Danny Yin, Arun Mallya, Arash Vahdat, Jose M. Alvarez, Jan Kautz, Pavlo Molchanov
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2021
Optimal Quantization Using Scaled Codebook
Yerlan Idelbayev, Pavlo Molchanov, Maying Shen, Hongxu Danny Yin, Miguel A. Carreira-Perpinan, Jose M. Alvarez
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2021
DexYCB: A Benchmark for Capturing Hand Grasping of Objects
Yu-Wei Chao, Wei Yang, Yu Xiang, Pavlo Molchanov, Ankur Handa, Jonathan Tremblay, Yashraj Narang, Karl Van Wyk, Umar Iqbal, Stan Birchfield, Jan Kautz, Dieter Fox
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2021
Data-Free Knowledge Distillation for Object Detection
Akshay Chawla, Hongxu Danny Yin, Pavlo Molchanov, Jose M. Alvarez
WACV 2021

2020

HarDNN: Fine-Grained Vulnerability Evaluation and Protection for Convolutional Neural Networks
Abdulrahman Mahmoud, Siva Hari, Christopher W. Fletcher, Sarita V. Adve, Charbel Sakr, Naresh Shanbhag, Pavlo Molchanov, Michael B. Sullivan, Timothy Tsai, Steve Keckler
SRC TECHCON
Weakly-Supervised 3D Hand Pose Estimation via Biomechanical Constraints
Adrian Spurr, Umar Iqbal, Pavlo Molchanov, Otmar Hilliges, Jan Kautz
European Conference on Computer Vision, 2020
Dreaming to Distill: Data-free Knowledge Transfer via DeepInversion
Hongxu Danny Yin, Pavlo Molchanov, Jose M. Alvarez, Zhizhong Li, Arun Mallya, Derek Hoiem, Niraj K. Jha, Jan Kautz
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2020 (Ora…
Weakly-Supervised 3D Human Pose Learning via Multi-view Images in the Wild
Umar Iqbal, Pavlo Molchanov, Jan Kautz
IEEE Computer Vision and Pattern Recognition
Feature Map Vulnerability Evaluation in CNNs
Abdulrahman Mahmoud, Siva Hari, Christopher W. Fletcher, Sarita V. Adve, Charbel Sakr, Naresh Shanbhag, Pavlo Molchanov, Michael B. Sullivan, Timothy Tsai, Steve Keckler
Workshop on Secure and Resilient Autonomy
HarDNN: Feature Map Vulnerability Evaluation in CNNs
Abdulrahman Mahmoud, Siva Hari, Christopher W. Fletcher, Sarita V. Adve, Charbel Sakr, Naresh Shanbhag, Pavlo Molchanov, Michael B. Sullivan, Timothy Tsai, Steve Keckler
arXiv

2019

Few-Shot Adaptive Gaze Estimation
Seonwook Park, Shalini De Mello, Pavlo Molchanov, Umar Iqbal, Otmar Hilliges, Jan Kautz
International Conference on Computer Vision (ICCV) 2019
Oral
SCOPS: Self-Supervised Co-Part Segmentation
Wei-Chih Hung, Varun Jampani, Sifei Liu, Pavlo Molchanov, Ming-Hsuan Yang , Jan Kautz
CVPR 2019
Importance Estimation for Neural Network Pruning
Pavlo Molchanov, Arun Mallya, Stephen Tyree, Iuri Frosio, Jan Kautz
CVPR2019

2018

Hand Pose Estimation via Latent 2.5 D Heatmap Regression
Umar Iqbal, Pavlo Molchanov, Thomas Breuel, Juergen Gall, Jan Kautz
ECCV2018
Improving Landmark Localization with Semi-Supervised Learning
Sina Honari, Pavlo Molchanov, Stephen Tyree, Pascal Vincent, Christopher Pal, Jan Kautz
CVPR
Depth-Based 3D Hand Pose Estimation: From Current Achievements to Future Goals
Shanxin Yuan, Guillermo Garcia-Hernando, Bjorn Stenger, Pavlo Molchanov, Jan Kautz, Sina Honari
Conference on Computer Vision and Pattern Recognition
Making Convolutional Networks Recurrent for Visual Sequence Learning
Xiaodong Yang, Pavlo Molchanov, Jan Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
IamNN: Iterative and Adaptive Mobile Neural Network for Efficient Image Classification
Sam Leroux, Pavlo Molchanov, Pieter Simoens, Bart Dhoedt, Thomas Breuel, Jan Kautz
International Conference on Learning Representations, Workshop

2017

A Lightweight Approach for On-the-Fly Reflectance Estimation
Kihwan Kim, Jinwei Gu, Stephen Tyree, Pavlo Molchanov, Matthias Nießner, Jan Kautz
IEEE International Conference on Computer Vision (ICCV 2017)
Pruning Convolutional Neural Networks for Resource Efficient Inference
Pavlo Molchanov, Stephen Tyree, Tero Karras, Timo Aila, Jan Kautz
International Conference on Learning Representations (ICLR 2017)

2016

Multilayer and Multimodal Fusion of Deep Neural Networks for Video Classification
Xiaodong Yang, Pavlo Molchanov, Jan Kautz
ACM Multimedia
Towards Selecting Robust Hand Gestures for Automotive Interfaces
Shalini Gupta, Pavlo Molchanov, Xiaodong Yang, Stephen Tyree, Jan Kautz
IEEE Intelligent Vehicles Symposium (IV) 2016
Online Detection and Classification of Dynamic Hand Gestures with Recurrent 3D Convolutional Neural Networks
Pavlo Molchanov, Xiaodong Yang, Shaline Gupta, Kihwan Kim, Stephen Tyree, Jan Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016
Towards Selecting Robust Hand Gestures for Automotive Interfaces
Shalini Gupta, Pavlo Molchanov, Xiaodong Yang, Kihwan Kim, Stephen Tyree, Jan Kautz
IEEE Intelligent Vehicles Symposium

2015

Hand Gesture Recognition with 3D Convolutional Neural Networks
Pavlo Molchanov, Shalini Gupta, Kihwan Kim, Jan Kautz
IEEE Computer Vision and Pattern Recognition Workshop (CVPRW) 2015
Winner (1st place) Hand Gesture Recognition Challenge
Multi-sensor System for Driver’s Hand-Gesture Recognition
Pavlo Molchanov, Shalini Gupta, Kihwan Kim, Kari Pulli
IEEE International Conference on Automatic Face and Gesture Recognition (FG) 20…
Short-Range FMCW Monopulse Radar for Hand-Gesture Sensing
Pavlo Molchanov, Shalini Gupta, Kihwan Kim, Kari Pulli
IEEE International Radar Conference