FACTS

Style transfer for 3D facial animation — retargeting emotion and idiosyncratic speaking style while preserving lip sync. Eurographics 2024.

arXiv   PDF

Authors: Jack Saunders, Steven Caulkin, Vinay P. Namboodiri — University of Bath

Venue: Eurographics 2024 (Short Paper)


Abstract

We present FACTS, a method for modifying existing 3D facial animations by transferring style characteristics across identities and emotions. FACTS employs StarGAN to enable the conversion of 3D facial animations into different emotions and person-specific idiosyncratic styles, while preserving lip-sync through a novel viseme-preserving loss.

This allows artists and developers to retarget the style of an animation — changing the emotional or personal character of a performance — without the need for expensive performance capture or manual re-animation.


Citation

@inproceedings{Saunders2023FACTS,
  author    = {Saunders, Jack and Caulkin, Steven and Namboodiri, Vinay P.},
  title     = {FACTS: Facial Animation Creation using the Transfer of Styles},
  booktitle = {Proceedings of the Eurographics Conference (Short Papers)},
  year      = {2024},
}