Universal translators are tantalizing close as Facebook's Meta reveals its tech can translate between 101 languages

Text to speech
Image credit: Pixabay (Image credit: Pixabay)

Back in August 2023, Meta revealed an ‘all-in-one’ AI translation model capable of understanding close to 100 different languages.

Dubbed SeamlessM4T (Massively Multilingual and Multimodal Machine Translation), this is Meta’s attempt at creating a ‘universal translator’ akin to the Babel Fish in Douglas Adams’ classic sci-fi series The Hitchhiker’s Guide to the Galaxy.

The team behind the SeamlessM4T tool has now detailed its work in a piece in the journal Nature, revealing the advanced system delivers an all-in-one solution for text-to-text, speech-to-text, speech-to-speech, and text-to-speech translations across an impressive, and growing, array of languages.

Over 400 years of raw audio

SeamlessM4T, which, among other things, is being used to automatically dub videos on Facebook and Instagram, currently supports speech-to-speech translation from 101 to 36 languages, speech-to-text translation for from 101 to 96 languages, text-to-text translation for 96 languages, text-to-speech translation from 96 to 36 languages, and automatic speech recognition for 96 languages. This unified approach overcomes the limitations of traditional cascaded systems, which often require separate subsystems for speech recognition, translation, and text-to-speech synthesis.

By streamlining these processes, Meta says SeamlessM4T outperforms existing models, achieving up to 23% higher BLEU (Bilingual Evaluation Understudy) scores in translation accuracy and demonstrating impressive resilience to background noise and speaker variations.

To create SeamlessM4T, Meta started with 4 million hours (over 400 years) of multilingual raw audio originating from a publicly available repository of crawled web data. The team developed SeamlessAlign, a multimodal corpus containing over 470,000 hours of aligned speech and combined the dataset with cutting-edge machine learning techniques, including SONAR (Sentence-level Multimodal and Language-Agnostic Representations) embeddings, which enable multilingual and modality-agnostic encoding for text and speech.

Meta says that by addressing social and ethical challenges through the use of safeguards, SeamlessM4T can be a valuable tool for global communication. These safeguards reduce gender bias - errors in grammatical gender determination - and mitigate the problem of added toxicity - where offensive words appear in translations but not in the original source.

You might also like

Wayne Williams
Editor

Wayne Williams is a freelancer writing news for TechRadar Pro. He has been writing about computers, technology, and the web for 30 years. In that time he wrote for most of the UK’s PC magazines, and launched, edited and published a number of them too.

Read more
DeepL
What is DeepL? Everything we know about the best AI translation service
Meta AI Typing
Meta can turn your thoughts into words typed on a screen if you don't mind lugging a machine the size of a room around
Meta AI on a smartphone
What is Meta AI: everything you need to know about the social network’s AI assistant
A world map made up of fiber optics
Best translation software of 2025
Sam Altman at Apple Developer Conference
Meta plans to release a stand-alone AI app to compete with ChatGPT, as Sam Altman responds to the threat
A hand reaching out to touch a futuristic rendering of an AI processor.
Best AI tools of 2025
Latest in Pro
Protection from AI hacker attacks
Maintaining SAP’s confidentiality, integrity, and availability triad
A trough sensor at Overbury farm
“It's wildlife working for you” - how Agri-Tech can help revolutionize British farming as we know it
Epson EcoTank ET-4850 next to a TechRadar badge that reads Big Savings
I found the best printer deal you won't see in the Amazon Spring Sale and it's got a massive $150 saving
NVIDIA RTX PRO 6000 Blackwell Server Edition
Nvidia's most expensive Blackwell card gets massive price cut but it is not the RTX 5090
Microsoft Copiot Studio deep reasoning and agent flows
Microsoft reveals OpenAI-powered Copilot AI agents to bosot your work research and data analysis
Group of people meeting
Inflexible work policies are pushing tech workers to quit
Latest in News
Buzz Lightyear Space Ranger Spin Rennovations
Disney’s giving a classic Buzz Lightyear ride a tech overhaul – here's everything you need to know
Hisense U8 series TV on wall in living room
Hisense announces 2025 mini-LED TV lineup, with screen sizes up to 100 inches – and a surprising smart TV switch
Nintendo Music teaser art
Nintendo Music expands its library with songs from Kirby and the Forgotten Land and Tetris
Opera AI Tabs
Opera's new AI feature brings order to your browser tab chaos
An image of Pro-Ject's Flatten it closed and opened
Pro-Ject’s new vinyl flattener will fix any warped LPs you inadvertently buy on Record Store Day
The iPhone 16 Pro on a grey background
iPhone 17 Pro tipped to get 8K video recording – but I want these 3 video features instead