-
Notifications
You must be signed in to change notification settings - Fork 47
docs: add Tavus to voice providers #27
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from all commits
Commits
Show all changes
8 commits
Select commit
Hold shift + click to select a range
d170cb0
update custom voices section with tavus
bryantanderson e254db2
add tavus to voice providers
bryantanderson 53065b9
add video tutorial iframe link
bryantanderson 6280de1
improve copy for providers/voice/tavus
bryantanderson af6180f
Merge branch 'main' into bryant/add-tavus-docs
bryantanderson a10ca2c
Merge remote-tracking branch 'origin/main' into bryant/add-tavus-docs
bryantanderson bbc13bf
rewrite providers/voice/tavus
bryantanderson 7eccc0a
Merge remote-tracking branch 'origin/bryant/add-tavus-docs' into brya…
bryantanderson File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,29 @@ | ||
--- | ||
title: Tavus | ||
subtitle: 'Quickstart: Setup Tavus Custom Replica' | ||
slug: customization/custom-voices/tavus | ||
--- | ||
|
||
|
||
This guide outlines the procedure for integrating your custom replica with Tavus through the VAPI platform. | ||
|
||
<Note>An API subscription is required for this process to work.</Note> | ||
|
||
To integrate your custom replica with [Tavus](https://platform.tavus.io/) using the VAPI platform, follow these steps. | ||
|
||
1. **Obtain a Tavus API Subscription:** Visit the [Tavus pricing page](https://platform.tavus.io/billing) and subscribe to an API plan. | ||
2. **Retrieve Your API Key:** Go to the [API Keys section](https://platform.tavus.io/api-keys) on Tavus to get your API key. | ||
3. **Enter Your API Key in VAPI:** Navigate to the [VAPI Provider Key section](https://dashboard.vapi.ai/keys) and input your Tavus API key under the Tavus section. | ||
4. **Enter Your Custom Replica ID:** After adding your API key, you can select Tavus as your assistant's voice provider and add your Custom Replica ID manually through the dashboard. Alternatively, you may use the API and specify the replica ID within the `voiceId` field. | ||
|
||
**Video Tutorial:** | ||
<iframe | ||
src="https://www.loom.com/embed/f3f8a6f3ec0d46c79874ee9e032ae332?sid=981ef281-a30b-46e3-ac19-1a2b2b176511" | ||
title="Loom video player" | ||
frameborder="0" | ||
allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" | ||
referrerpolicy="strict-origin-when-cross-origin" | ||
width="100%" | ||
height="400px" | ||
allowfullscreen | ||
/> |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,50 @@ | ||
--- | ||
title: Tavus | ||
subtitle: What is Tavus? | ||
slug: providers/voice/tavus | ||
--- | ||
|
||
|
||
**What is Tavus?** | ||
|
||
Tavus is a leading generative AI video research company dedicated to advancing the field of personalized video communication through artificial intelligence. Founded with the mission to humanize AI interactions, Tavus has made significant strides in developing advanced AI models and APIs that enable developers to create sophisticated digital twin experiences and real-time conversational interfaces. | ||
|
||
**The Evolution of AI in Video Personalization:** | ||
|
||
The landscape of AI-driven video personalization has evolved significantly. Initially confined to text and static images, advancements in machine learning and deep learning have introduced dynamic, video-based personalization. Tavus leverages these technological strides to produce videos that not only replicate human likeness and voice but also deliver tailored content to each recipient. | ||
|
||
**Overview of Tavus' Offerings:** | ||
|
||
Tavus provides a comprehensive suite of AI-powered products and services designed to meet diverse video personalization needs: | ||
|
||
**Automated Video Generation** | ||
|
||
- Tavus' core video generation system represents the state-of-the-art in personalized video creation. Using advanced AI models, the platform can transform a single recording into numerous personalized versions, each tailored to individual recipients. This technology excels in maintaining natural speech patterns, facial expressions, and emotional authenticity while delivering customized content at scale. | ||
|
||
**Conversational Video Interface (CVI):** | ||
|
||
- The Conversational Video Interface is Tavus' breakthrough technology for real-time interactive experiences. With sub-second latency and sophisticated AI processing, CVI creates digital replicas capable of natural, dynamic interactions. This system enables applications ranging from interactive customer service to personalized educational experiences, all while maintaining human-like responsiveness. | ||
|
||
**Integration Capabilities:** | ||
|
||
- Tavus' robust API and integration capabilities allow seamless incorporation with existing business systems, including CRM platforms and marketing tools. This technical framework enables developers to enhance their applications with advanced video personalization features while maintaining workflow efficiency. | ||
|
||
**Use Cases for Tavus:** | ||
|
||
Tavus’ technologies are versatile and applicable across multiple sectors: | ||
|
||
**Customer Experience:** | ||
|
||
- Businesses leverage Tavus' video generation capabilities to create personalized customer interactions at scale. The system's ability to generate customized video content enhances engagement rates and improves customer satisfaction through more personal, direct communication. | ||
|
||
**Innovation and Research:** | ||
|
||
- Tavus is committed to ongoing innovation in AI and video technology. The platform continually evolves to improve the realism of generated videos and expand the range of customization options. Research efforts focus on enhancing the AI's capabilities while ensuring ethical standards are upheld. | ||
|
||
**AI Safety and Ethics:** | ||
|
||
- Ethical use of AI is a core principle for Tavus. The company implements strict guidelines and technical measures to prevent misuse of its technology, such as unauthorized impersonation. User consent and data protection are paramount, and Tavus complies with relevant regulations to safeguard personal information. | ||
|
||
**Integrations and Compatibility:** | ||
|
||
- Tavus' API allows seamless integration with various platforms and applications. This ensures that developers can incorporate Tavus' video generation and real-time interaction capabilities into their existing systems, enhancing functionality and improving user experience. The API is designed to be flexible and developer-friendly, accommodating a wide range of enterprise use cases. |
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
worth writing by hand