Google confirms Gemini Live's next big AI upgrade will be widely available on Android – with one catch

Man using Gemini Live on an phone.
Gemini Live is getting smarter (Image credit: Shutterstock/Rokas Tenys)

  • Google confirms more Android devices will get this AI upgrade
  • Real-time camera and screen access is being added to Gemini Live
  • We've previously seen the tech demoed with Project Astra

Last year we got a tantalising preview of Project Astra, Google's next-gen, multi-modal AI upgrade that interprets the world through your phone's camera. Now it seems the upgrade will be appearing on more Android phones than originally thought.

According to a Google support article (via 9to5Google), the ability to share your camera or screen with Gemini Live inside the Gemini app – so key aspects of the Project Astra update – is going to be available on "any Android device with Gemini Advanced".

There had been rumors that this enhanced functionality was going to be exclusive to Gemini running on flagship Google Pixel and Samsung Galaxy devices, but it appears that won't be the case. The catch is, you'll need to pay $19.99 / £18.99 / AU$32.99 a month for Gemini Advanced.

The features are actually in the process of rolling out now, as we reported last week, but Google advises that "these features are being released gradually, so they might not be available to you just yet". So far we haven't seen them pop up on the phones of the TechRadar team.

Gemini Live meets Project Astra

There are so many modes and sub-modes in Google's Gemini AI chatbot that you'd be forgiven for being a little confused about what each one does. Gemini Live is the more natural, conversational chat mode on mobile that lets you interrupt it, while speaking in a more human-like way compared to the standard Gemini voice mode.

The upgrade on the way now will give Gemini Live access to your camera feed and phone screen, so you can ask it about anything you're looking at in the real world or on your mobile device. The early demos look promising, with Gemini identifying objects, remembering locations, and even solving math problems.

Gemini can already analyze images and screenshots you give to it, and identify what's in them, but the upgrade will make all of this a real-time experience you can call on as you make your way around the world.

You can access the core Gemini Live features – minus the new Project Astra upgrades – with or without a Gemini Advanced subscription. In the Gemini app for Android or iOS, tap the sound wave icon on the far right, next to the text input box.

You might also like

TOPICS
David Nield
Freelance Contributor

Dave is a freelance tech journalist who has been writing about gadgets, apps and the web for more than two decades. Based out of Stockport, England, on TechRadar you'll find him covering news, features and reviews, particularly for phones, tablets and wearables. Working to ensure our breaking news coverage is the best in the business over weekends, David also has bylines at Gizmodo, T3, PopSci and a few other places besides, as well as being many years editing the likes of PC Explorer and The Hardware Handbook.

You must confirm your public display name before commenting

Please logout and then login again, you will then be prompted to enter your display name.