Meta Launches Global AI Translation for Creators in English & Spanish
▼ Summary
– Meta is globally launching an AI voice translation feature on Facebook and Instagram that translates creators’ content into other languages using their own voice’s sound and tone.
– The feature supports English and Spanish translations at launch, with plans to add more languages, and includes an optional lip-sync function for natural-looking results.
– It is available to Facebook creators with 1,000+ followers and all public Instagram accounts in regions where Meta AI is offered, accessible before publishing a reel.
– Creators can preview and toggle translations and lip-syncing, and they gain new metrics in Insights to track views by language for audience reach analysis.
– Meta recommends creators face forward, speak clearly, and minimize background noise for optimal translation, and Facebook creators can also upload up to 20 dubbed audio tracks manually.
Meta has introduced a global AI-powered voice translation tool for creators on Facebook and Instagram, enabling real-time translation of video content to help creators expand their reach across language barriers. The feature, now available in all markets where Meta AI operates, initially supports English and Spanish translations, with plans to incorporate more languages in the future.
Creators can now translate their reels using AI that mimics their own voice tone and style, making dubbed content sound more authentic. An optional lip-sync function aligns translated audio with the speaker’s mouth movements, enhancing the natural feel of the final video. To use the tool, creators select “Translate your voice with Meta AI” before posting and can preview or adjust settings before publishing.
The translation feature is available to Facebook creators with 1,000 or more followers and to all public Instagram accounts in eligible regions. Translated reels include a small notice indicating they were processed using Meta AI, and viewers can opt out of seeing translated content via their settings if preferred.
A new metric in the Insights panel allows creators to track views by language, offering valuable data on how their content performs in different regions. This is especially useful as Meta plans to expand language support over time.
For best results, Meta advises creators to face the camera directly, speak clearly, and minimize background noise. The tool currently supports up to two speakers, provided they don’t talk over one another. In a complementary move, Facebook creators can also upload up to 20 custom dubbed audio tracks per reel through the Meta Business Suite, offering more flexibility for targeting specific language audiences.
Adam Mosseri, Head of Instagram, emphasized the company’s goal of helping creators overcome linguistic and cultural barriers to grow their audience. The rollout coincides with internal reports that Meta is reorganizing its AI division to sharpen focus on research, superintelligence, product development, and infrastructure.
(Source: TechCrunch)