Skip to content

AI Dubbing System is a Streamlit app that transcribes, translates, and dubs videos into other languages using OpenAI Whisper and Play.ht, then lets you download the final dubbed video.

Notifications You must be signed in to change notification settings

afaq-ahmed07/ai-dubbing-system

Repository files navigation

AI Dubbing System

A Streamlit-based AI dubbing system that allows you to:

  • Upload or record audio/video.
  • Transcribe audio using OpenAI's Whisper.
  • Translate the transcription into a target language.
  • Generate a dubbed voiceover using Play.ht Text-to-Speech.
  • Replace the original audio in a video with the dubbed audio.
  • Download the final dubbed video.

Features

  • Multi-Input Support:
    Upload an audio file, record audio in real time, or upload a video file.

  • Speech-to-Text:
    Transcribe audio using OpenAI Whisper.

  • Translation:
    Translate the transcribed text into a selected language using Google Translate API.

  • Text-to-Speech:
    Generate a dubbed voiceover using the Play.ht API.
    Note: Users must enter their own Play.ht credentials (User ID and API Key) via the UI.

  • Video Dub:
    Replace the original audio in the video with the dubbed audio and download the final video.


Installation

  1. Clone the Repository:

    git clone https://github.com/afaq-ahmed07/ai-dubbing-system
    cd ai-dubbing-system
  2. Install Dependencies:

    pip install -r requirements.txt

Usage

  1. Obtain Play.ht Credentials:
    • Sign up for a Play.ht account.
    • Retrieve your Play.ht User ID and API Key.
    • Enter these credentials in the app
  2. Run the App:
    streamlit run app.py
    

About

AI Dubbing System is a Streamlit app that transcribes, translates, and dubs videos into other languages using OpenAI Whisper and Play.ht, then lets you download the final dubbed video.

Resources

Stars

Watchers

Forks

Languages