A Streamlit-based AI dubbing system that allows you to:
- Upload or record audio/video.
- Transcribe audio using OpenAI's Whisper.
- Translate the transcription into a target language.
- Generate a dubbed voiceover using Play.ht Text-to-Speech.
- Replace the original audio in a video with the dubbed audio.
- Download the final dubbed video.
-
Multi-Input Support:
Upload an audio file, record audio in real time, or upload a video file. -
Speech-to-Text:
Transcribe audio using OpenAI Whisper. -
Translation:
Translate the transcribed text into a selected language using Google Translate API. -
Text-to-Speech:
Generate a dubbed voiceover using the Play.ht API.
Note: Users must enter their own Play.ht credentials (User ID and API Key) via the UI. -
Video Dub:
Replace the original audio in the video with the dubbed audio and download the final video.
-
Clone the Repository:
git clone https://github.com/afaq-ahmed07/ai-dubbing-system cd ai-dubbing-system
-
Install Dependencies:
pip install -r requirements.txt
- Obtain Play.ht Credentials:
- Sign up for a Play.ht account.
- Retrieve your Play.ht User ID and API Key.
- Enter these credentials in the app
- Run the App:
streamlit run app.py