Skip to main content

How Can I Quickly Create a Dubbed Output Using AI Dubbing? 🎬

Do you want to translate your videos into other languages? AI dubbing and AI translations can help! This guide is for beginners.

Updated over a week ago

What is AI Dubbing?

AI dubbing uses artificial intelligence to change the language of your video. It replaces the original speech with new speech in a different language. It sounds like the original speaker is talking in the new language.

How Can I Dub a New Video?

You can start dubbing a video on the CAMB.ai platform.

Step-by-Step Guide to Dubbing

  1. Go to the Home Page: Find the "Dub a New Video" button. Click it to start.

  2. Upload Your File: Choose your video or audio file. CAMB.ai supports many file types.

  3. Add a Title: Give your project a clear name.

  4. Select Languages: Choose your video's original language (source language). Then, pick the language you want to translate into (target language).

  5. Supported File Types:

What are My Dubbing Options?

CAMB.ai offers two main ways to dub your videos:

1. End-to-End (E2E) Dubbing

This option is fast and simple.

  • When to Use It:

    • Your video has one main speaker.

    • You need few changes to the video.

    • The voice cloning quality is good enough for your needs.

  • How it Works: CAMB.ai handles everything automatically.

2. Step-wise Dubbing

This option gives you more control.

  • When to Use It:

    • Your video has many speakers.

    • You need to check and adjust the voice synchronization (lip-sync).

    • The language pairs are complex.

    • You want to watch the dubbing process closely.

  • How it Works: You can review each step. This includes transcription (text from speech) and lip-sync (matching speech to mouth movements).

Can I Use Different Voices?

Yes, you have choices for voices.

  • Stock Voices: Use voices already available on CAMB.ai.

  • Custom Voice References: Upload your own voice samples. CAMB.ai can then use that voice for dubbing.

Tip: Clear audio input helps AI dubbing create better outputs.

Steps To Upload Your Video

Go to the Home page and select "Dubbing" or choose the "Dubbing" option from the left panel under Projects.

You can upload videos directly from your computer or paste a link to a YouTube or Google Drive video (ensure the link is accessible to anyone).

Fill in Essential Video Details

  1. Upload your file

    • Drag and drop a video/audio file into the upload area, or

    • Paste a YouTube or Google Drive (file or folder) link in the provided box.

  2. Enter project details

    • Type the name of your project in the text box.

  3. Select languages

    • Choose the Source language (original language of your video/audio).

    • Select one or more Target languages for dubbing.

  4. Enable End-to-End Dubbing (optional)

    • Turn on the toggle if you want the system to automatically run all steps of the dubbing process in one go.

Note: You can also upload using a Google Drive or YouTube link (make sure the Google Drive link is public).

Advanced Settings: (Optional)

General:

  • Description:
    Enter a short description of your project.

  • Number of Speakers in Video:
    Select or input the number of speakers featured in the video.

  • Select Folder:
    Choose the destination folder where the project will be saved.

  • Select Keywords:
    Add or select relevant keywords in Excel to preserve certain words unchanged across other languages, ensuring consistency.

    Please refer here: Dictionaries

Custom Audio:

Navigate to the Custom Audio tab (next to “General”).

Choose Your Audio Preferences (toggle options):

  • Silent Background:

    • Toggle ON to replace all background audio with silence in the dubbed output using AI.

  • Enable Overdubbing:

    • Toggle ON to layer new audio recordings on top of your original track for added depth and richness.

  • Background and Foreground Audio:

    • Toggle ON to upload and use your own custom audio files for background and foreground sound.

Note: Each toggle enables a specific audio customization mode. You can enable one or multiple depending on your dubbing needs.

Custom Script:

Select the Custom Script tab next to “Custom Audio.”

  • Upload Source Subtitle File:

    • Click the upload icon next to "Source Language SRT File".

    • Upload an .srt file containing the subtitles in the original/source language.

    • Note: File size must be under 2 MB.

  • Select Target Language:

    • Use the dropdown labeled "Target language for srt upload" to choose the desired output language for the dubbed content.

  • Upload Target Subtitle File (Optional):

    • If you have a prepared translation, upload a Target Language SRT File (also under 2 MB).

    • Otherwise, the platform may auto-generate the translated subtitles based on your selection.

Now, click on "Begin Dubbing" to start the dubbing process. Processing will begin, so please stay on the same page till file Upload is complete .

Note: By default, the checkbox for editing the video step-by-step is unchecked. Leave this unchecked if you want to perform end-to-end dubbing.

Enable Stepwise Video Editing (if needed):

  • Check the box or select the "Stepwise Video Editing" to enable this feature as shown in below figure, allowing you to review intermediate steps (like transcription, translated text, lip-sync, etc.).

  • Add Video Description and Number of speakers - Optional.

  • Select a folder to keep your video organized.

  • You can customize these settings through Advanced Editing in the user-friendly Editor.

  • Click on ‘Begin Dubbing’.

  • Processing will begin, so please stay on the same page till file Upload is complete .

How Do I Review My Dubbed Video?

After dubbing, you can check your new video in the editor.

  • Use the Timeline: A special bar helps you move through the video. You can jump to different parts to review them.

  • Make Adjustments:

    • Change speakers or voiceovers.

    • Edit the translated text (translations).

    • Modify timecodes (when speech starts and ends).

Timeline Navigation bar (Audio spectrogram at bottom)

  • These methods will help you move smoothly through the timeline, making your editing process faster and easier. Just follow along and start using these techniques! You can check the link mentioned below for reference.

How Can I Improve Audio Clarity?

Sometimes, dubbed audio might not sound perfect. Here's how to fix common issues and ensure good quality.

Tips for Clear Dialogue

  • Check Single Words: Listen carefully to short, single-word dialogues. Make sure they sound clear and natural.

  • Prevent Overlapping Timings: Ensure no two dialogues speak at the same time. You can check timecodes using the timeline navigation bar at the bottom.

  • Fix Distorted Dialogue: If a dialogue sounds strange or distorted, try to regenerate it. Click the three dots on the dialogue and select "Re-generate."

    Caution: Do not regenerate the same dialogue many times. This can lower the overall audio quality.

  • Split or Merge Dialogue: If the audio doesn't match the video (sync is off), you can split a long dialogue into shorter ones or merge short ones together.

  • Improve Pronunciation: If a word doesn't sound clear, try writing it differently to guide the AI.

    • Example 1: If "Beat" sounds wrong, try typing "Beet."

    • Example 2: For Tamil, "பறவை" (paṟavai - bird) could be written as "பரவை" (paravai).

    • Remember: Good pronunciation in the text helps the AI create the best sound.

Checking Overall Video Quality

  • Download and Listen: After you finish, download the dubbed video. Listen to the entire video.

  • Address Buzzing or Distortion: If you hear buzzing sounds or distortions throughout the whole video, consider changing the speaker (the AI voice) to one with a clearer voice reference.

How Can I Edit Translations in My Dubbed Video?

You can easily change the translated text in your video. This is helpful if you want to improve the accuracy or flow of the dialogue.

Steps to Edit a Single Translation

  1. Select the Dialogue: Click on the specific line of dialogue you want to change. It will light up, showing it's ready for editing.

  2. Make Your Changes: Type in your new translation.

  3. Regenerate Audio: After editing, the dialogue's audio might not match. Click the three dots at the top-right of the dialogue. Then, choose "Re-generate." This creates new audio for just that line.

  4. Review the Audio: Listen to the new audio. Make sure it sounds right and fits your video.

Important: Once you save changes to a translation, you cannot undo them.

How to Regenerate Multiple Edited Translations at Once?

If you have changed many parts of your script, you can update them all together.

  1. Find an Edited Dialogue: Go to any dialogue you have already changed.

  2. Select Bulk Regeneration: Click the three dots at the top-right of that dialogue.

  3. Choose "Re-generate all stale dialogues": This option will update all the dialogues you have edited.

  4. Check Your Project: After regenerating, play your whole video. Make sure all the updated dialogues sound correct.

How Can I Change Dialogue Timings (Timecodes)?

You can adjust when each line of dialogue starts and ends. This helps perfectly sync the audio with the video.

Ways to Modify Timecodes:

  1. Use the Navigation Bar: Look at the bottom of the editor. There is a time navigation bar. You can drag elements here to change timings.

  2. Edit Next to Dialogue: Each dialogue line has timecodes listed next to it. You can directly edit these numbers.

Download Output

Related Articles
How to Upload Videos for Easy Dubbing?
How to Generate and Review AI Translations Easily?📥
How To Download Output Files? 📥
AI-Powered Dubbing Services and Strategic Partnerships
Stories Feature: A Step-by-Step Guide 📖
Did this answer your question?