arxiv GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussians

名称
GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussians
首页
https://yiyibooks.cn/arxiv/2312.02069v2/index.html
原始地址
https://arxiv.org/abs/2312.02069
描述
我们引入了 GaussianAvatars,这是一种创建逼真头部头像的新方法,在表情、姿势和视角方面完全可控。 The core idea is a dynamic 3D representation based on 3D Gaussian splats that are rigged to a parametric morphable face model.这种组合促进了照片级真实感渲染,同时允许通过底层参数模型进行精确的动画控制,例如通过驱动序列的表达传输或通过手动更改可变形模型参数。我们通过三角形的局部坐标系对每个板进行参数化,并优化显式位移偏移以获得更准确的几何表示。 During avatar reconstruction, we jointly optimize for the morphable model parameters and Gaussian splat parameters in an end-to-end fashion. We demonstrate the animation capabilities of our photorealistic avatar in several challenging scenarios. For instance, we show reenactments from a driving video, where our method outperforms existing works by a significant margin. ...