AI will start subtitling your videos thanks to VLC

News
By
published

Real-time captions and translation are coming

VLC AI Subtitles
(Image credit: VLC)

AI will start making videos on popular media player VLC more accessible, the company announced at CES. VLC is adding a new feature that uses AI to generate subtitles and translations in real time. No more digging through shady subtitle databases or syncing files. Instead, VLC’s AI will transcribe audio and display it as the video plays, even translating it into any of more than 100 languages.

It's a notable shift from the way you currently have to add subtitles. If your video didn’t come with captions baked in, you had to go hunting for the right file online VLC’s new AI-powered subtitles aim to make that process obsolete. VLC is using open-source AI models for the feature and said that the whole thing will work on your device, meaning you won't need to be online or send any data about what you're watching.

Of course, the AI doesn’t just transcribe; it translates too. Say you’re watching a Korean drama and want to share it with a friend who doesn’t speak the language. VLC’s AI can generate subtitles in English, Spanish, or one of the dozens of other languages.

Ill communication

VLC's AI plans aren't a perfect solution, of course. Any AI transcription or translation may fall prey to confusion, bad transcription, and awkward translation. Accents, fast-talking, and other elements may make the captions more of a hindrance than you'd like. The feature is also likely to demand some serious processing power. Real-time transcription and translation are no small tasks, and older devices might struggle to keep up. It might be time for an upgrade if you’re still running VLC on a laptop from the pre-HD era.

Still, the potential is enormous for more than just casual viewers. People with impaired hearing or who are learning a new language will definitely benefit from immediate and (mostly) accurate transcription and translation. It could be a real boon for students, international travelers, or others who want or need text to accompany their viewing.

While VLC isn't unique in leveraging AI for subtitles, it stands out in terms of ease of use and practicality. Skipping the need for internet connectivity or a subscription service makes it both cheaper and more private than other options. It might not always get things perfect, but for most users, “good enough” will probably feel like a revelation.

You might also like

Eric Hal Schwartz
Eric Hal Schwartz
Contributor

Eric Hal Schwartz is a freelance writer for TechRadar with more than 15 years of experience covering the intersection of the world and technology. For the last five years, he served as head writer for Voicebot.ai and was on the leading edge of reporting on generative AI and large language models. He's since become an expert on the products of generative AI models, such as OpenAI’s ChatGPT, Anthropic’s Claude, Google Gemini, and every other synthetic media tool. His experience runs the gamut of media, including print, digital, broadcast, and live events. Now, he's continuing to tell the stories people want and need to hear about the rapidly evolving AI space and its impact on their lives. Eric is based in New York City.