FACTS
Style transfer for 3D facial animation — retargeting emotion and idiosyncratic speaking style while preserving lip sync. Eurographics 2024.
Authors: Jack Saunders, Steven Caulkin, Vinay P. Namboodiri — University of Bath
Venue: Eurographics 2024 (Short Paper)
Abstract
We present FACTS, a method for modifying existing 3D facial animations by transferring style characteristics across identities and emotions. FACTS employs StarGAN to enable the conversion of 3D facial animations into different emotions and person-specific idiosyncratic styles, while preserving lip-sync through a novel viseme-preserving loss.
This allows artists and developers to retarget the style of an animation — changing the emotional or personal character of a performance — without the need for expensive performance capture or manual re-animation.
Citation
@inproceedings{Saunders2023FACTS,
author = {Saunders, Jack and Caulkin, Steven and Namboodiri, Vinay P.},
title = {FACTS: Facial Animation Creation using the Transfer of Styles},
booktitle = {Proceedings of the Eurographics Conference (Short Papers)},
year = {2024},
}