Editing Physiological Signals in Videos Using Latent Representations

Camera-based physiological signal estimation provides a convenient and non-contact way to monitor heart rate, but it also raises serious privacy concerns because facial videos can leak sensitive information about a person’s health and emotional state. We present a learned framework for editing physiological signals in videos while preserving visual fidelity. Our method first encodes an input video into a latent representation using a pretrained 3D Variational Autoencoder, and embeds a target heart-rate prompt through a frozen text encoder.

Peter Kocsis

Peter joined NVIDIA as Research Scientist in 2026 April. His research focuses on inverse and forward rendering using generative image priors to solve fundamental challenges in material estimation and light transport. He finished his PhD at the Technical University of Munich, under the supervision of Prof. Dr. Matthias Nießner. Peter began his career as a mechatronics engineer. His early works span a broad domain from neural control for robotics to active learning for computer vision.

Nicolas Roussel

Nicolas Roussel is a research engineer at NVIDIA Research working with the Foundations of Graphics, Communications, and Machine Learning team. Prior to joining NVIDIA, he worked at EPFL, where he developed and maintained the Mitsuba 3 differentiable renderer, as well as its just-in-time compiler and automatic differentiation system Dr.Jit. He holds a M.Sc. in Communication Systems from EPFL. Outside of work, Nicolas enjoys rock climbing and cycling.

Bing Xu

Bing is a research scientist in the Real-Time Graphics Research Group at NVIDIA, where her work focuses on physically-based rendering and neural rendering. In the past, she explored forward and inverse light transport, importance sampling, denoising, and deep learning approaches for appearance modeling.

Bing earned her PhD from the University of California, San Diego, advised by Prof. Ravi Ramamoorthi. She holds a Bachelor’s degree from the University of Hong Kong and gained industry experience in offline rendering and 3D designer tools before moving into research.

Haozhe Liu

Haozhe Liu is a Research Scientist at NVIDIA Research. He received his Ph.D. from King Abdullah University of Science and Technology (KAUST), where he was advised by Jürgen Schmidhuber. Prior to joining NVIDIA, he worked at Meta AI (London), Meta AI (MPK), and Tencent.