NVIDIA Research Taiwan

NVIDIA Research Taiwan

Introduction

Welcome to the homepage of the NVIDIA Research Taiwan. Founded in 2022, NVR Taiwan is the APAC research team of NVIDIA Research, with primary research focuses on Generative AI, multimodal learning and 3D vision. The team is led by Professor Frank Wang.

We invite applications for the following positions:

  • Full-time research scientist
  • Research internship

Graduate students with strong research publications and interested in doing an internship at NVR Taiwan can see this link for open positions, or contact our members for more details.

News

Oct. 2023 - Four papers at ICCV 2023 and one paper at ICCVW 2023 have been accepted.

Jul. 2023 - Frank Wang receives the Outstanding Young Scholar Award from the Foundation for the Advancement of Outstanding Scholarship.

Jun. 2023 - Our “QuAVF” work ranked 1st place winner at the 2023 CVPR Ego4D Challenge (Social Understanding: Talking-to-me track)!

Jun. 2023 - One paper has been accepted at CVPR 2023.

Feb. 2023 - Two papers have been accepted at AAAI 2023.

Dec. 2022 - Two papers have been accepted at NeurIPS 2022.

Members

Avatar

Yu-Chiang Frank Wang

Avatar

Chien-Yi Wang

Avatar

Min-Hung Chen

Avatar

Szu-Wei Fu

Avatar

Ryo Hachiuma

Avatar

Cheng Sun

Avatar

Jaesung Choe

Avatar

Wen-Hao Liu

Current interns

Avatar

Ci-Siang Lin

Avatar

Yun Da Tsai

Avatar

Sung-Feng Huang

Avatar

Shih-Yang Liu

Avatar

Mu-Yi Shen

Avatar

Shun-Cheng Wu

Research Topics

A non-exhaustive list of research topics studied in our group include:

  • Vision & Language

  • Audio & Speech

  • Multimodal Learning

  • 3D Vision

  • Federated Learning

Publications

Quickly discover relevant content by filtering publications.
*

2D-3D Interlaced Transformer for Point Cloud Segmentation with Scene-Level Supervision

ICCV 2023

We present a Multimodal Interlaced Transformer (MIT) that jointly considers 2D and 3D data for weakly supervised point cloud …
PDF Project
2D-3D Interlaced Transformer for Point Cloud Segmentation with Scene-Level Supervision

Efficient Model Personalization in Federated Learning via Client-Specific Prompt Generation

ICCV 2023

Federated learning (FL) emerges as a decentralized learning framework which trains models from multiple distributed clients without …
PDF
Efficient Model Personalization in Federated Learning via Client-Specific Prompt Generation

Neural-PBIR Reconstruction of Shape, Material, and Illumination

ICCV 2023

Reconstructing the shape and spatially varying surface appearances of a physical-world object as well as its surrounding illumination …
PDF Project
Neural-PBIR Reconstruction of Shape, Material, and Illumination

Spacetime Surface Regularization for Neural Dynamic Scene Reconstruction

ICCV 2023

We propose an algorithm, 4DRegSDF, for the spacetime surface regularization to improve the fidelity of neural rendering and …
Spacetime Surface Regularization for Neural Dynamic Scene Reconstruction

Frequency-Aware Self-Supervised Long-Tailed Learning

ICCVW 2023

Data collected from the real world typically exhibit long-tailed distributions, where frequent classes contain abundant data while rare …
PDF
Frequency-Aware Self-Supervised Long-Tailed Learning

Bias-Eliminating Augmentation Learning for Debiased Federated Learning

CVPR 2023

Learning models trained on biased datasets tend to observe correlations between categorical and undesirable features, which result in …
PDF
Bias-Eliminating Augmentation Learning for Debiased Federated Learning

QuAVF: Quality-aware Audio-Visual Fusion for Ego4D Talking to Me Challenge

CVPRW 2023

This technical report describes our QuAVF@NTU-NVIDIA submission to the Ego4D Talking to Me (TTM) Challenge 2023. Based on the …
PDF
QuAVF: Quality-aware Audio-Visual Fusion for Ego4D Talking to Me Challenge

Frido: Feature Pyramid Diffusion for Complex Scene Image Synthesis

AAAI 2023

Diffusion models (DMs) have shown great potential for high-quality image synthesis. However, when it comes to producing images with …
PDF Code
Frido: Feature Pyramid Diffusion for Complex Scene Image Synthesis

Target-Free Text-guided Image Manipulation

AAAI 2023

We tackle the problem of target-free text-guided image manipulation, which requires one to modify the input reference image based on …
PDF Project
Target-Free Text-guided Image Manipulation

Paraphrasing Is All You Need for Novel Object Captioning

NeurIPS 2022

Novel object captioning (NOC) aims to describe images containing objects without observing their ground truth captions during training. …
PDF
Paraphrasing Is All You Need for Novel Object Captioning

SPoVT: Semantic-Prototype Variational Transformer for Dense Point Cloud Semantic Completion

NeurIPS 2022

Point cloud completion is an active research topic for 3D vision and has been widely studied in recent years. Instead of directly …
PDF
SPoVT: Semantic-Prototype Variational Transformer for Dense Point Cloud Semantic Completion

Contact

Our lab is mainly located in Taipei City (10-15 minutes away from Taipei Songshan Airport by MRT). Motivated candidates can contact our members to apply for internships and research positions.

Unauthorized visitors are not permitted in the Taipei office.

  • Neihu District No.8 Jihu Rd, 2nd floor, Taipei City, 114
  • Monday-Friday 9:00 to 18:00