- Meta AI now translates, dubs and lip-syncs videos in English, Spanish, Hindi and Portuguese.
- The new tool allows authors to reach new audiences without localization tools.
- Viewers can control language settings using tags for translated videos.
The meta just made Reels speak your language, even if they started out in a different one. The company implemented Meta AI to translate, dub and sync Facebook and Instagram videos in English, Spanish, Hindi and Portuguese.
So you might see a cooking tutorial filmed in Brazil that sounds like it was recorded in your own kitchen, or an English translation of the lyrics playing during a dance video filmed in Delhi. Meta AI can imitate the tone, tempo and voice of a creator in another language, with optional lip-syncing to add a level of realism that even big-budget content has previously struggled with.
You may not be able to do the same with your own videos unless you've gone slightly viral yourself. Translation tools are free for creators on Facebook with at least 1,000 followers, and for all public Instagram accounts in countries where Meta AI is available. Mehta says the idea is to make short-form content more accessible and enjoyable across cultures.
International drums
And while videos translated by Meta AI are clearly labeled so you won't confuse the dubbed voice with the original, viewers can also turn off translations, turn off lip-syncing, or stick to the video's original language if they so choose.
This isn't the first time Meta has tried to cross language boundaries. Automatic captioning, captioned stories, and global hashtag campaigns have been around for years. But this is the first time the company has used artificial intelligence to clone voices and match lip movements.
This also gives Meta an advantage as the world of videos created and supported by artificial intelligence rapidly evolves. YouTube has long offered captions and subtitles, but real-time lip-synced voice dubbing is not yet widely available. TikTok has experimented with translation overlays, but not full voice cloning or lip-syncing. If Meta can implement this seamlessly in more languages, it could be the basis for international content.
So if you feel like you're seeing a lot of Latin American and Indian authors who speak English fluently appear on your reels, it could be because AI is helping with translation. To be sure, you'll have to look for the “Translated by Meta AI” label in the corner.
