What is AI Dubbing?
AI dubbing uses artificial intelligence to change the language of your video. It replaces the original speech with new speech in a different language. It sounds like the original speaker is talking in the new language.
How Can I Dub a New Video?
You can start dubbing a video on the CAMB.ai platform.
Step-by-Step Guide to Dubbing
Go to the Home Page: Find the "Dub a New Video" button. Click it to start.
Upload Your File: Choose your video or audio file. CAMB.ai supports many file types.
Add a Title: Give your project a clear name.
Select Languages: Choose your video's original language (source language). Then, pick the language you want to translate into (target language).
Supported File Types:
Video: .mp4, .mov
Audio: .mp3, .aac, .wav, .flac
What are My Dubbing Options?
CAMB.ai offers two main ways to dub your videos:
1. End-to-End (E2E) Dubbing
This option is fast and simple.
When to Use It:
Your video has one main speaker.
You need few changes to the video.
The voice cloning quality is good enough for your needs.
How it Works: CAMB.ai handles everything automatically.
2. Step-wise Dubbing
This option gives you more control.
When to Use It:
Your video has many speakers.
You need to check and adjust the voice synchronization (lip-sync).
The language pairs are complex.
You want to watch the dubbing process closely.
How it Works: You can review each step. This includes
transcription(text from speech) andlip-sync(matching speech to mouth movements).
Can I Use Different Voices?
Yes, you have choices for voices.
Stock Voices: Use voices already available on CAMB.ai.
Custom Voice References: Upload your own voice samples. CAMB.ai can then use that voice for dubbing.
Tip: Clear audio input helps AI dubbing create better outputs.
Steps To Upload Your Video
Navigate to the Home page and click on "Dub a New Video" or use the "Dubbing" option on the left panel.
You can upload videos directly from your computer or paste a link to a YouTube or Google Drive video (ensure the link is accessible to anyone).
Fill in Essential Video Details
Title: Auto populated - Give your video a title for easy identification.
Source Language: Select the original language of your media.
Target Language(s): Choose the language(s) you want to dub the content into.
If you want end-to-end automated processing, you can click on 'Begin Dubbing Project’.
Processing will begin, so please stay on the same page till file Upload is complete .
Note: By default, the checkbox for editing the video step-by-step is unchecked. Leave this unchecked if you want to perform end-to-end dubbing.
Enable Stepwise Video Editing (if needed):
Check the box or select the "Stepwise Video Editing" to enable this feature as shown in below figure, allowing you to review intermediate steps (like transcription, translated text, lip-sync, etc.).
Add Video Description and Number of speakers - Optional.
Select a folder to keep your video organized.
You can customize these settings through Advanced Editing in the user-friendly Editor.
Click on ‘Begin Uploading Project’.
Processing will begin, so please stay on the same page till file Upload is complete .
How Do I Review My Dubbed Video?
After a video is completely dubbed, select "Go to Editor".
After dubbing, you can check your new video in the editor.
Use the Timeline: A special bar helps you move through the video. You can jump to different parts to review them.
Make Adjustments:
Change speakers or voiceovers.
Edit the translated text (
translations).Modify
timecodes(when speech starts and ends).
Timeline Navigation bar (Audio spectrogram at bottom)
These methods will help you move smoothly through the timeline, making your editing process faster and easier. Just follow along and start using these techniques! You can check the link mentioned below for reference.
How Can I Improve Audio Clarity?
Sometimes, dubbed audio might not sound perfect. Here's how to fix common issues and ensure good quality.
Tips for Clear Dialogue
Check Single Words: Listen carefully to short, single-word dialogues. Make sure they sound clear and natural.
Prevent Overlapping Timings: Ensure no two dialogues speak at the same time. You can check
timecodesusing thetimeline navigation barat the bottom.Fix Distorted Dialogue: If a dialogue sounds strange or distorted, try to
regenerateit. Click the three dots on the dialogue and select "Re-generate."Caution: Do not regenerate the same dialogue many times. This can lower the overall audio quality.
Split or Merge Dialogue: If the audio doesn't match the video (sync is off), you can
splita long dialogue into shorter ones ormergeshort ones together.Improve Pronunciation: If a word doesn't sound clear, try writing it differently to guide the AI.
Example 1: If "Beat" sounds wrong, try typing "Beet."
Example 2: For Tamil, "பறவை" (paṟavai - bird) could be written as "பரவை" (paravai).
Remember: Good pronunciation in the text helps the AI create the best sound.
Checking Overall Video Quality
Download and Listen: After you finish, download the dubbed video. Listen to the entire video.
Address Buzzing or Distortion: If you hear buzzing sounds or distortions throughout the whole video, consider changing the
speaker(the AI voice) to one with a clearervoice reference.
How Can I Edit Translations in My Dubbed Video?
You can easily change the translated text in your video. This is helpful if you want to improve the accuracy or flow of the dialogue.
Steps to Edit a Single Translation
Select the Dialogue: Click on the specific line of dialogue you want to change. It will light up, showing it's ready for editing.
Make Your Changes: Type in your new translation.
Regenerate Audio: After editing, the dialogue's audio might not match. Click the three dots at the top-right of the dialogue. Then, choose "Re-generate." This creates new audio for just that line.
Review the Audio: Listen to the new audio. Make sure it sounds right and fits your video.
Important: Once you save changes to a translation, you cannot undo them.
How to Regenerate Multiple Edited Translations at Once?
If you have changed many parts of your script, you can update them all together.
Find an Edited Dialogue: Go to any dialogue you have already changed.
Select Bulk Regeneration: Click the three dots at the top-right of that dialogue.
Choose "Re-generate all stale dialogues": This option will update all the dialogues you have edited.
Check Your Project: After regenerating, play your whole video. Make sure all the updated dialogues sound correct.
How Can I Change Dialogue Timings (Timecodes)?
You can adjust when each line of dialogue starts and ends. This helps perfectly sync the audio with the video.
Ways to Modify Timecodes:
Use the Navigation Bar: Look at the bottom of the editor. There is a
time navigation bar. You can drag elements here to change timings.Edit Next to Dialogue: Each dialogue line has
timecodeslisted next to it. You can directly edit these numbers.