NPC AI Engine - Dialog, actions, voice and lipsync - Convai

Convai enables AI characters in games and virtual worlds to have human-like conversation capabilities and more. With Convai, developers can add a backstory, knowledge base, voice, and overall intelligence to their character assets to converse naturally with players and carry out actions.

Convai includes the complete conversation pipeline, which includes Speech Recognition, Language Understanding, and Generation, Text-to-Speech, Text-to-Action, Lipsync. Convai focuses on bringing characters that are as life-like as possible and can be directed by any developer!

Check out our Documentation to get started!

Resources:

Documentation to guide you through the plugin's features and capabilities.

Quick start video to help you get started quickly and easily.

Enhanced plugin containing integrations with LipSync, Ready Player Me, and Basic Head and Eye Following.

Troubleshooting guide to help you solve our most commonly faced issues.

Tutorial series to help you master the plugin's full potential.

Convai Website to create custom characters and try them out.

Discord server to help you out with any issues you face while using our plugin.

For any questions, reach out to [email protected].

Partner Page to help join our partner program. While Convai provides a free experience to distribute a product (game or experience) using Convai, you must be a partner or a customer.

Highlights:

• Intelligent real-time open-ended conversation capabilities, enabling natural and dynamic interactions.
• Actions: Characters can understand the environment and perform actions based on conversation, verbal commands, and events, opening up new possibilities.
• Knowledge Base: You can add potentially unlimited knowledge for your characters, making them an expert at a topic or grounding them in the lore of the world and their backstories.
• Intelligent Animations: Integrated with Lip-Sync and custom facial and body animations with conversation flow.
• Avatar Integrations: Integrated out-of-the-box with the most popular avatar platforms like Reallusion Character Creator 4 and Ready Player Me. Compatible with all model families.
• AR/VR Support: Characters support AR and VR build platforms.
• Text or Talk: You can use text or voice input to talk to your characters.
• Production Ready: The asset can be deployed to hundreds of users (under our commercial agreement).

Why Convai?

• Have open-ended conversations with your intelligent characters!

Our characters are responsive and intelligent. They listen to you and understand you. This gives an engaging and open-ended human-like conversation.

• Give your character an interesting background in seconds!

Use the Convai Website to create a character and give it an interesting backstory. Design the character however you want.

• Bring your characters into your projects in a single step!

With Convai's Unity Plugin, all you need is to copy and paste the character ID and click a button, and your characters will be in your project.

• Well-documented, easy-to-read, and highly customizable code to accommodate any game logic you can think of!

You do not need any code to get started and talk to your character, but if you want to create custom logic for your character, our code is easy and customizable enough for you to know what you need to know. Check out our documentation to get started.