Gemini Live's background mode and app extensions could blow Apple Intelligence away

Google Gemini website displayed on Google Pixel 7a
(Image credit: Future / James Ide)

During Google I/O 2024, the tech giant previewed Gemini Live, a unique version of the AI on mobile capable of holding “natural conversations.” You can think of it like Siri, as you’ll be able to engage in a two-way dialogue with Gemini and have the AI respond concisely.

Since the initial announcement, we haven’t heard much about the tech until recently, when strings of code referencing Gemini Live were found in a Google app beta. The code mentions a “background mode” letting users continue conversations “while using other apps or while [their] screen is locked.” As 9To5Google points out, this effectively turns the Gemini Live experience into a phone call of sorts.

The AI will continue to accept vocal inputs and reply as you do other things. A user could, for example, open Chrome on their Android phone, look up something on the search engine, and seamlessly relay that information back to Gemini. Again, the goal is to make talking with the AI natural. 

9To5Google states interactions can be ended by “looking for a persistent notification” or saying “Stop” to Gemini Live aloud.

Possible features

There was more uncovered in the beta beyond the background mode, though.

Google is apparently working on a way to give users quick access to Gemini when their smartphone is locked. Looking at the report's screenshot, you’ll be able to utilize four extensions to first-party services: Google Maps, Google Flights, Google Hotels, and YouTube.

It’s unknown exactly what you’ll be able to do with those extensions, as details are scarce. But judging from what was shown, users might be able to ask Gemini for directions, play music on YouTube, or book a flight.

Those four will be turned on by default, and Google seemingly has plans to add support for more extensions; however, there is a small catch. According to the screenshot, “extensions that don’t require user credentials or don’t access private data will be on by default.” Everything else would presumably require manual activation.

Additionally, users can toggle three extra features for Gemini on the lock screen, expanding the AI’s level of control. Messages lets you text friends and family, while  Workspace can locate and summarize emails or documents. Then there is Home Automation, which is arguably the most interesting as it allows homeowners to manage smart home devices from the lock screen.

Surpassing Apple 

It’s unknown when Gemini Live will launch. The May announcement said the software was supposed to arrive within the coming months to Gemini Advanced subscribers. So far, Google has been silent. Maybe we’ll see it before summer ends or later in the fall.

Whenever it is released, the background mode and lock screen interactivity could allow the upgrade to stand out against the likes of Apple Intelligence. Apple’s tech is highly capable, too, offering all sorts of tools for organization, content creation, and more. However, judging from what we’ve seen, constant interaction is required. Gemini Live is less stringent, which could make it easier to use.

As always, take these leaks with a grain of salt. Things can always change last minute.

If you're interested in what is the best AI chatbot out there, check out our Versus article where we compare the big three: Meta AI, ChatGPT, and Google Gemini.

You might also like

TOPICS
Cesar Cadenas
Contributor

Cesar Cadenas has been writing about the tech industry for several years now specializing in consumer electronics, entertainment devices, Windows, and the gaming industry. But he’s also passionate about smartphones, GPUs, and cybersecurity. 

Read more
Gemini 2.0
What is Gemini: everything you need to know about Google’s AI chatbot
Pixel 9 Pro og Pixel 9 Pro XL
Gemini AI can see and talk to you about what's on your screen – which could be more helpful than it sounds
Gemini 2.0
Google has just announced the ability to chain actions in Gemini and it could change the way we use AI for good
Google Gemini iPhone Lock Screen
You can now access Gemini from your iPhone's lock screen
Three iPhones on a blue and red background running Apple Intelligence
You’ll soon be able to use Gemini in Apple Intelligence as iOS 18.4 beta hints at upcoming integration
Chrome browser icons
Chrome could get a massive AI upgrade if this rumor is true
Latest in Artificial Intelligence
Deep Resarch
I test AI agents for a living and these are the 5 reasons you should let tools like ChatGPT Deep Research get things done for you
ChatGPT vs. Manus
I compared Manus AI to ChatGPT – now I understand why everyone is calling it the next DeepSeek
Two business men playing chess in the office.
It turns out ChatGPT o1 and DeepSeek-R1 cheat at chess if they’re losing, which makes me wonder if I should I should trust AI with anything
Google Gemini Calendar
Gemini is coming to Google Calendar, here’s how it will work and how to try it now
Netflix
Netflix tried to fix 80s sitcom A Different World with AI but it gave us a different nightmare
Pictory
What is Pictory: Everything we know about this business-focussed AI video generator
Latest in News
Vision Pro Metallica
Apple Vision Pro goes off to never never land with Metallica concert footage
Mufasa is joined by another lion, a monkey and a bird in this promotional image
Mufasa: The Lion King prowls onto Disney+ as it finally gets a streaming release date
An American flag flying outside the US Capitol building against a blue sky
Sean Plankey selected as CISA director by President Trump
An Nvidia GeForce RTX 4060 on a table with its retail packaging
Nvidia RTX 5060 GPU spotted in Acer gaming PC, suggesting rumors of imminent launch are correct – and that it’ll run with only 8GB of video RAM
Indiana Jones talking to a friend in a university setting with a jaunty smile on his face
New leak claims Indiana Jones and the Great Circle PS5 release will come in April
A close up of the limited edition vinyl turntable wrist watch from AndoAndoAndo
This limited-edition timepiece turns the iconic Technics SL-1200 turntable into a watch, and I want one