This Google Glass app captions conversations in real time

For most Google Glass explorers, the wearable is a fun novelty that at best gives them an icebreaker and bragging rights.

But researchers at the George Institute of Technology have developed an app that could make Glass an incredible tool for the hearing-impaired.

Google Glass's microphone normally can't pick up on sounds from too far away, including the speech of people around you, but the Captioning on Glass app circumvents that limitation by the speaker talk into a paired smartphone's microphone.

That speech is then converted to text and transmitted to the Google Glass display in near real time.

Clarity

The app was conceived by George Institute of Technology School of Interactive Computing Professor Jim Foley. The video below shows it in action.

"This system allows wearers like me to focus on the speaker's lips and facial gestures," Professor Foley told CNET. "If hard-of-hearing people understand the speech, the conversation can continue immediately without waiting for the caption. However, if I miss a word, I can glance at the transcription, get the word or two I need and get back into the conversation."

The paired smartphone has the dual benefit of being much more reliable at detecting others' speech than Google Glass's microphone and also forcing participants to think more carefully about the clarity of their words, project leader Professor Thad Starner added.

And if you're thinking that the next logical step is to have the app translate users' speech between languages, then there's good news for you: they're working on that as well, and they plan to release a combination translation and transcription app in the near future, according to the site.

TOPICS
Michael Rougeau

Michael Rougeau is a former freelance news writer for TechRadar. Studying at Goldsmiths, University of London, and Northeastern University, Michael has bylines at Kotaku, 1UP, G4, Complex Magazine, Digital Trends, GamesRadar, GameSpot, IFC, Animal New York, @Gamer, Inside the Magic, Comic Book Resources, Zap2It, TabTimes, GameZone, Cheat Code Central, Gameshark, Gameranx, The Industry, Debonair Mag, Kombo, and others.

Micheal also spent time as the Games Editor for Playboy.com, and was the managing editor at GameSpot before becoming an Animal Care Manager for Wags and Walks.

Latest in Websites & Apps
Quordle on a smartphone held in a hand
Quordle hints and answers for Sunday, March 23 (game #1154)
NYT Strands homescreen on a mobile phone screen, on a light blue background
NYT Strands hints and answers for Sunday, March 23 (game #385)
Quordle on a smartphone held in a hand
Quordle hints and answers for Saturday, March 22 (game #1153)
NYT Strands homescreen on a mobile phone screen, on a light blue background
NYT Strands hints and answers for Saturday, March 22 (game #384)
Quordle on a smartphone held in a hand
Quordle hints and answers for Friday, March 21 (game #1152)
NYT Strands homescreen on a mobile phone screen, on a light blue background
NYT Strands hints and answers for Friday, March 21 (game #383)
Latest in News
Apple iPhone 16 Review
The latest iPhone 18 leak hints at a major chipset upgrade for all four models
Quordle on a smartphone held in a hand
Quordle hints and answers for Sunday, March 23 (game #1154)
NYT Strands homescreen on a mobile phone screen, on a light blue background
NYT Strands hints and answers for Sunday, March 23 (game #385)
NYT Connections homescreen on a phone, on a purple background
NYT Connections hints and answers for Sunday, March 23 (game #651)
Google Pixel 9 Pro Fold main display opened
Apple is rumored to be prioritizing battery life on the foldable iPhone – which could also feature a liquid metal hinge for added durability
Google Pixel 9
The Google Pixel 10 just showed up in Android code – and may come with a useful speed boost