Geppetto - AI-Powered Lip Sync Animation

💡 With its intuitive interface, you can easily input audio or text files and have the tool automatically generate a corresponding lip sync animation. You can also customize the animation by adjusting the mouth shape and timing for your 3D or 2D characters.

🎮 The tool uses advanced AI algorithms to automatically generate facial animations that match the timing and tone of your character's speech, freeing you up to focus on other aspects of your project.

Whether you're creating a game, an animated film, or any other type of interactive content, Geppetto is a powerful tool that can help you bring your characters to life.

✔️ How the tool works

There are two ways to use this geppetto tool. Either you want to use it to save production time and pre-generate all your lip animations from existing texts or audios. Or, you can run geppetto dynamically and generate the animation in real time. You may need speech synthesis or text generation for your characters. You can look at these tools on the unity asset store if you are interested.

Please take note that our animation tools only work with Blendshapes so make sure your character already has some. If not, you can use software like blender or maya to create them.

✔️ Technical information

This asset is compatible with Unity versions 2022 and later. It is optimized for use with humanoid characters, but can be used with other character models as well.

You will find on this github link the necessary examples to learn how to use the tool

⚠️ In order for you to generate the animation you must have an internet connection as it uses our internal API for the generation. Once your animation is generated, you don't need to be online to be able to use it.

✔️ Support

• Join the X&Immersion discord to chat with the technical support & share feedback with others;
• Or contact us at [email protected]