""Meta AI mimics the sound and tone of a creator's voice to translate reels, so the end result is content that feels authentically like the creator, just in another language," the company said in the announcement. In a technically ambitious step, creators can also enable a lip-syncing feature, which uses AI to match the translated audio to the movement of the speaker's mouth, creating a more natural and less jarring viewing experience."
"The feature democratizes a service that was once costly and complex, potentially enabling a creator in Mumbai or Delhi to seamlessly reach an audience in Brazil, or a Portuguese-language educator to grow a following in the United States without a production studio. For Meta, it's perhaps a way to increase engagement and time spent on its platforms by flooding users' feeds with a firehose of newly accessible, algorithmically recommended content from every corner of the globe."
Meta expanded its AI-powered video translation to automatically dub Facebook and Instagram Reels into Hindi and Portuguese. The capability builds on an English-Spanish translation launched in August. Meta AI mimics the sound and tone of a creator's voice to translate Reels so the end result feels authentically like the creator in another language. Creators can enable an AI-driven lip-syncing feature that matches translated audio to mouth movements for a more natural viewing experience. The feature targets large Hindi- and Portuguese-speaking markets, democratizes costly localization services, enables cross-market audience growth, and could increase engagement through more accessible multilingual content. The rollout remains controlled.
Read at Forbes
Unable to calculate read time
Collection
[
|
...
]