YouTube has released a new tool to help video creators automatically translate their videos into different languages. This tool uses AI, which stands for Artificial Intelligence. TechCrunch reported that YouTube made the announcement at a conference called VidCon. YouTube has partnered with Aloud, a company that uses AI to dub videos. Aloud is part of Google’s internal incubator called Area 120.
Earlier this year, YouTube added a feature that allows creators to create multiple audio tracks in different languages. This means that creators can add dubbing to their videos so that speakers of other languages can understand them. By June 2023, creators have already dubbed over 10,000 videos in over 70 languages.
Before this new tool, creators had to work with other companies that provide voice-over services. This can require a lot of time and money. However, with Aloud, creators can now copy their videos for free.
read more: Are you looking for a smartphone? To check the Mobile Finder
Aloud was created by Google in 2022. It uses AI to transcribe the video, translate it, and then create a dubbed version. Creators can check and edit the transcript before dubbing it out loud.
YouTube is currently testing this tool with hundreds of creators. Amjad Hanif, YouTube’s VP of Creator Products, mentioned this to the audience at the conference. Hanif added that YouTube will soon make this tool available to all creators. Alodu is currently only available in English, Spanish and Portuguese. But in the future, languages like Hindi and Bahasa Indonesia will become more prevalent.
Hanif also mentioned that YouTube is working on making translated audio tracks sound like the creator’s voice. They want the dubbed version to have the same expression and lip movements as the original. YouTube confirmed to TechCrunch that it plans to use generative AI to add additional features, such as preserving the creator’s voice, improving emotion delivery, and reproducing lip movements.
