Facial Animation

Near-realtime Facial Animation by Deep 3D Simulation Super-Resolution

We present a neural network-based simulation super-resolution framework that can efficiently and realistically enhance a facial performance produced by a low-cost, real-time physics-based simulation to a level of detail that closely approximates that …

Simulation-aided face strain extraction for ML animation systems

We present a volumetric, simulation-based pipeline for the automatic creation of strain-based descriptors from facial performance capture provided as surface meshes. Strain descriptors encode facial poses via length elongation/contraction ratios of …