NVIDIA Omniverse Audio2Face will be available later this week in open beta. With the Audio2Face app, Omniverse users can generate AI-driven facial animation from audio sources.
NVIDIA Omniverse Audio2Face will be available later this week in open beta. With the Audio2Face app, Omniverse users can generate AI-driven facial animation from audio sources.
The demand for digital humans is increasing across industries, from game development and visual effects to conversational AI and healthcare. But the animation process is tedious, manual and complex, plus existing tools and technologies can be difficult to use or implement into existing workflows.
With Omniverse Audio2Face, anyone can now create realistic facial expressions and motions to match any voice-over track. The technology feeds the audio input into a pre-trained Deep Neural Network, based on NVIDIA and the output of the network drives the facial animation of 3D characters in real time.
The open beta release includes:
- Audio player and recorder: record and playback vocal audio tracks, then input the file to the neural network for immediate animation results.
- Live mode: use a microphone to drive Audio2Face in real time.
- Character transfer: retarget generated motions to any 3D character’s face, whether realistic or stylized.
- Multiple instances: run multiple instances of Audio2Face with multiple characters in the same scene.
Learn more about NVIDIA Omniverse Audio2Face and join the open beta today.