Google teases new AI-powered Google Lens trick in feisty ChatGPT counter-punch

Google I/O 2024 tease
A sneak peek at the Google I/O stage and some new AI (Image credit: Google)

It's another big week in artificial intelligence in a year that's been full of them, and Google has teased a new AI feature coming to mobile devices just hours ahead of its Google I/O 2024 event – where we're expecting some major announcements.

A social media post from Google shows someone asking their phone about what's being shown through the camera. In this case, it's people setting up the Google I/O stage, which the phone correctly identifies.

User and phone then go on to have a real-time chat about Google I/O 2024, complete with a transcription of the conversation on screen. We don't get any more information than that, but it's clearly teasing some of the upcoming reveals.

As far as we can tell, it looks like a mix of existing Google Lens and Google Gemini technologies, but with everything running instantly. Lens and Gemini can already analyze images, but studying real-time video feeds would be something new.

The AI people

It's all very reminiscent of the multimodal features – mixing audio, text, and images – that OpenAI showed off with its own ChatGPT bot yesterday. ChatGPT now has a new AI model called GPT-4 Omni (GPT-4o), which makes all of this natural interaction even easier.

We've also seen the same kind of technology demoed on the Rabbit R1 AI device. The idea is that these AIs become less like boxes that you type text into, and more like synthetic people who can see, recognize, and talk.

Based on this teaser, it looks likely that this is the way the Google Gemini AI model and bot is going. While we can't identify the smartphone in the video, it may be that these new features come to Pixel phones (like the new Google Pixel 8a) first.

All will be revealed later today, May 14: everything gets underway at 10am PT / 1pm ET / 6pm BST, which is May 15 at 3am AEST. We've put together a guide to how to watch Google I/O 2024 online, and we'll be reporting live from the event too.

You might also like

David Nield
Freelance Contributor

Dave is a freelance tech journalist who has been writing about gadgets, apps and the web for more than two decades. Based out of Stockport, England, on TechRadar you'll find him covering news, features and reviews, particularly for phones, tablets and wearables. Working to ensure our breaking news coverage is the best in the business over weekends, David also has bylines at Gizmodo, T3, PopSci and a few other places besides, as well as being many years editing the likes of PC Explorer and The Hardware Handbook.

Read more
AI
Our predictions for AI in 2025 – what next for ChatGPT, Apple Intelligence and more
Pixel 9 Pro og Pixel 9 Pro XL
Gemini AI can see and talk to you about what's on your screen – which could be more helpful than it sounds
AI
The year in AI: how ChatGPT, Gemini, Apple Intelligence, and more changed everything in 2024
Visual Intelligence on an iPhone 16
Don't judge Apple Intelligence by today's summaries, smartphone AI is going to be amazing... eventually
a google TV
I got a sneak peek of 3 great new AI features for Google Home devices and TVs, and one is straight out of a Black Mirror episode
Next-Gen Google TV
The next-generation of Google TV is on the way with an improved Gemini that’ll make smarter and better
Latest in Artificial Intelligence
Gemini on a mobile phone.
Worryingly, Google Gemini’s new AI image generation features can be used to remove watermarks from images and I'm concerned
Apple Intelligence
It’s crunch time for Apple Intelligence as Apple execs look for a solution to the company’s AI woes
A super close up image of the Google Gemini app in the Play Store
It's official: Google Assistant will be retired for phones this year, with Gemini taking over
Super Mario Odyssey
ChatGPT is the ultimate gaming tool - here's 4 ways you can use AI to help with your next playthrough
Apple CEO Tim Cook delivers remarks before the start of an Apple event at Apple headquarters on September 09, 2024 in Cupertino, California. Apple held an event to showcase the new iPhone 16, Airpods and Apple Watch models. (Photo by Justin Sullivan/Getty Images)
The big Siri Apple Intelligence delay proves that maybe we really don't know Apple at all
AI writer
Coding AI tells developer to write it himself
Latest in News
European Union technical background
EU tech companies push for digital sovereignty, reducing reliance on US and others
Star Wars Knights of the Old Republic
Knights of the Old Republic remake developer Saber Interactive states all its projects are 'still in development'
google nest
Google is slowly phasing out its Assistant helper to make room for Gemini's reign in smartphones - here’s how it’s doing the same for smart home devices
Renault 5 Turbo 3E
Renault unveils its wildest EV to date and it comes with in-wheel motors and a rally-style vertical handbrake for drifting
Circular smart ring
Circular's new smart ring is getting blood pressure and blood glucose monitoring before the Apple Watch
Gemini on a mobile phone.
Worryingly, Google Gemini’s new AI image generation features can be used to remove watermarks from images and I'm concerned