Skip to content

docs: add Tavus to voice providers #27

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 8 commits into from
Nov 18, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
29 changes: 29 additions & 0 deletions fern/customization/custom-voices/tavus.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
---
title: Tavus
subtitle: 'Quickstart: Setup Tavus Custom Replica'
slug: customization/custom-voices/tavus
---


This guide outlines the procedure for integrating your custom replica with Tavus through the VAPI platform.

<Note>An API subscription is required for this process to work.</Note>

To integrate your custom replica with [Tavus](https://platform.tavus.io/) using the VAPI platform, follow these steps.

1. **Obtain a Tavus API Subscription:** Visit the [Tavus pricing page](https://platform.tavus.io/billing) and subscribe to an API plan.
2. **Retrieve Your API Key:** Go to the [API Keys section](https://platform.tavus.io/api-keys) on Tavus to get your API key.
3. **Enter Your API Key in VAPI:** Navigate to the [VAPI Provider Key section](https://dashboard.vapi.ai/keys) and input your Tavus API key under the Tavus section.
4. **Enter Your Custom Replica ID:** After adding your API key, you can select Tavus as your assistant's voice provider and add your Custom Replica ID manually through the dashboard. Alternatively, you may use the API and specify the replica ID within the `voiceId` field.

**Video Tutorial:**
<iframe
src="https://www.loom.com/embed/f3f8a6f3ec0d46c79874ee9e032ae332?sid=981ef281-a30b-46e3-ac19-1a2b2b176511"
title="Loom video player"
frameborder="0"
allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share"
referrerpolicy="strict-origin-when-cross-origin"
width="100%"
height="400px"
allowfullscreen
/>
4 changes: 4 additions & 0 deletions fern/docs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -170,6 +170,8 @@ navigation:
path: customization/custom-voices/elevenlabs.mdx
- page: PlayHT
path: customization/custom-voices/playht.mdx
- page: Tavus
path: customization/custom-voices/tavus.mdx
- page: Custom Keywords
path: customization/custom-keywords.mdx
- page: Knowledge Base
Expand Down Expand Up @@ -310,6 +312,8 @@ navigation:
path: providers/voice/rimeai.mdx
- page: Deepgram
path: providers/voice/deepgram.mdx
- page: Tavus
path: providers/voice/tavus.mdx
- section: Models
contents:
- page: OpenAI
Expand Down
1 change: 0 additions & 1 deletion fern/providers/voice/rimeai.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,6 @@ Rime.ai provides a comprehensive suite of speech synthesis tools designed to mee

In the media industry, Rime.ai’s lifelike voices can be used for automated newsreading, delivering news updates in a natural and engaging manner. This ensures consistency and professionalism in audio content delivery.


**Narration:**

- For audiobooks, educational materials, and other forms of narration, Rime.ai offers high-quality voice generation that enhances the listening experience. The ability to match voices to the content’s demographic audience further adds to the personalization and effectiveness of the narration.
Expand Down
50 changes: 50 additions & 0 deletions fern/providers/voice/tavus.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,50 @@
---
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

worth writing by hand

title: Tavus
subtitle: What is Tavus?
slug: providers/voice/tavus
---


**What is Tavus?**

Tavus is a leading generative AI video research company dedicated to advancing the field of personalized video communication through artificial intelligence. Founded with the mission to humanize AI interactions, Tavus has made significant strides in developing advanced AI models and APIs that enable developers to create sophisticated digital twin experiences and real-time conversational interfaces.

**The Evolution of AI in Video Personalization:**

The landscape of AI-driven video personalization has evolved significantly. Initially confined to text and static images, advancements in machine learning and deep learning have introduced dynamic, video-based personalization. Tavus leverages these technological strides to produce videos that not only replicate human likeness and voice but also deliver tailored content to each recipient.

**Overview of Tavus' Offerings:**

Tavus provides a comprehensive suite of AI-powered products and services designed to meet diverse video personalization needs:

**Automated Video Generation**

- Tavus' core video generation system represents the state-of-the-art in personalized video creation. Using advanced AI models, the platform can transform a single recording into numerous personalized versions, each tailored to individual recipients. This technology excels in maintaining natural speech patterns, facial expressions, and emotional authenticity while delivering customized content at scale.

**Conversational Video Interface (CVI):**

- The Conversational Video Interface is Tavus' breakthrough technology for real-time interactive experiences. With sub-second latency and sophisticated AI processing, CVI creates digital replicas capable of natural, dynamic interactions. This system enables applications ranging from interactive customer service to personalized educational experiences, all while maintaining human-like responsiveness.

**Integration Capabilities:**

- Tavus' robust API and integration capabilities allow seamless incorporation with existing business systems, including CRM platforms and marketing tools. This technical framework enables developers to enhance their applications with advanced video personalization features while maintaining workflow efficiency.

**Use Cases for Tavus:**

Tavus’ technologies are versatile and applicable across multiple sectors:

**Customer Experience:**

- Businesses leverage Tavus' video generation capabilities to create personalized customer interactions at scale. The system's ability to generate customized video content enhances engagement rates and improves customer satisfaction through more personal, direct communication.

**Innovation and Research:**

- Tavus is committed to ongoing innovation in AI and video technology. The platform continually evolves to improve the realism of generated videos and expand the range of customization options. Research efforts focus on enhancing the AI's capabilities while ensuring ethical standards are upheld.

**AI Safety and Ethics:**

- Ethical use of AI is a core principle for Tavus. The company implements strict guidelines and technical measures to prevent misuse of its technology, such as unauthorized impersonation. User consent and data protection are paramount, and Tavus complies with relevant regulations to safeguard personal information.

**Integrations and Compatibility:**

- Tavus' API allows seamless integration with various platforms and applications. This ensures that developers can incorporate Tavus' video generation and real-time interaction capabilities into their existing systems, enhancing functionality and improving user experience. The API is designed to be flexible and developer-friendly, accommodating a wide range of enterprise use cases.
Loading