SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation

Video generation

Create stunning videos effortlessly with Luma Dream Machine.

SadTalker is a cutting-edge technology developed by researchers from Xi'an Jiaotong University, Tencent AI Lab, and Ant Group. It aims to address the challenges of generating talking head videos from a single face image and speech audio, such as unnatural head movement, distorted expressions, and identity modification. SadTalker generates 3D motion coefficients (head pose, expression) from audio and implicitly modulates a novel 3D-aware face render for talking head generation. The technology has been presented at CVPR 2023.

Hailuo AI is a cutting-edge text/image to video generation tool.

AI Hug is a state-of-the-art AI tool that creates professional videos from textual descriptions or visual inputs.

3D animations

Create unique VRChat avatars quickly and easily!

SadTalker is a cutting-edge technology developed by researchers from Xi'an Jiaotong University, Tencent AI Lab, and Ant Group. It aims to address the challenges of generating talking head videos from a single face image and speech audio, such as unnatural head movement, distorted expressions, and identity modification. SadTalker generates 3D motion coefficients (head pose, expression) from audio and implicitly modulates a novel 3D-aware face render for talking head generation. The technology has been presented at CVPR 2023.

Architectural planning

Create stunning custom action figures effortlessly!