Google I/O showcases new 'Ask Photos' tool, powered by AI – but it honestly scares me a little

Google IO 2024
(Image credit: Google)

At the Google I/O 2024 keynote today, CEO Sundar Pichai debuted a new feature for the nine-year-old Google Photos app: 'Ask Photos', an AI-powered tool that acts as an augmented search function for your photos.

The goal here is to make finding specific photos faster and easier. You ask a question – Pichai's example is 'what's my license plate number' – and the app uses AI to scan through your photos and provide a useful answer. In this case, it isolates the car that appears the most, then presents you with whichever photo shows the number plate most clearly.

Google IO 2024

I really want to know if this is a Google employee's actual child or if it's a Gemini-generated kid... (Image credit: Google)

It can reportedly handle more in-depth queries, too: Pichai went on to explain that if your hypothetical daughter Lucia has been learning to swim, you could ask the app to 'show me how Lucia's swimming has progressed', and it'll present you with a slideshow showcasing Lucia's progression. The AI (powered by Google's Gemini model) is capable of identifying the context of images, such as differentiating between swimming in a pool and snorkeling in the ocean, and even highlighting the dates on photos of her swimming certificates.

While the Photos app already had a search function, it was fairly rudimentary, only really capable of identifying text within images and retrieving photos from selected dates and locations. 

Ask Photos is apparently "an experimental feature" that will start to roll out "soon", and it could get more features in the future. As it is, it's a seriously impressive upgrade – so why am I terrified of it?

Eye spy

A major concern surrounding AI models is data security. Gemini is a predominantly cloud-based AI tool (its data parameters are simply too large to be run locally on your device), which introduces a potential security vulnerability as your data has to be sent to an external server via the internet, a flaw that doesn't exist for on-device AI tools.

Ask Photos is powerful enough to not only register important personal details from your camera roll, but also understand the context behind them. In other words, the Photos app – perhaps one of the most innocuous apps on your Android phone's home screen – just became the app that potentially knows more about your life than any other.

I can't be the only person who saw this revealed at Google I/O and immediately thought 'oh, this sounds like an identity thief's dream'. How many of us have taken a photo of a passport or ID to complete an online sign-up? If malicious actors gain remote access to your phone or are able to intercept your Ask Photos queries, they could potentially take better advantage of your photo library than ever before.

Google says it's guarding against this kind of scenario, stating that "The information in your photos can be deeply personal, and we take the responsibility of protecting it very seriously. Your personal data in Google Photos is never used for ads. And people will not review your conversations and personal data in Ask Photos, except in rare cases to address abuse or harm."

It continues that "We also don't train any generative AI product outside of Google Photos on this personal data, including other Gemini models and products. As always, all your data in Google Photos is protected with our industry-leading security measures."

So, nothing to worry about? We'll see. But quite frankly... I don't need an AI to help me manage my photo library anyway. Honestly Google, it really isn't that hard to make some folders.

You might also like

Christian Guyton
Editor, Computing

Christian is TechRadar’s UK-based Computing Editor. He came to us from Maximum PC magazine, where he fell in love with computer hardware and building PCs. He was a regular fixture amongst our freelance review team before making the jump to TechRadar, and can usually be found drooling over the latest high-end graphics card or gaming laptop before looking at his bank account balance and crying.

Christian is a keen campaigner for LGBTQ+ rights and the owner of a charming rescue dog named Lucy, having adopted her after he beat cancer in 2021. She keeps him fit and healthy through a combination of face-licking and long walks, and only occasionally barks at him to demand treats when he’s trying to work from home.

Read more
Visual Intelligence on an iPhone 16
Don't judge Apple Intelligence by today's summaries, smartphone AI is going to be amazing... eventually
Pixel 9 Pro og Pixel 9 Pro XL
Gemini AI can see and talk to you about what's on your screen – which could be more helpful than it sounds
Google Gemini AI logo on a smartphone with Google background
Here's why Google's Gemini AI getting a proper memory could save lives
Samsung's Galaxy AI features
What is Galaxy AI: Samsung was first out of the blocks with AI device integration but is it any good?
Google TV smart interface showing movies page
Google TV is testing AI news summaries on the home page, and I can't think of anything I want less
Google AI Mode
Google previews AI Mode for search, taking on the likes of ChatGPT search and Perplexity
Latest in Artificial Intelligence
A super close up image of the Google Gemini app in the Play Store
It's official: Google Assistant will be retired for phones this year, with Gemini taking over
Super Mario Odyssey
ChatGPT is the ultimate gaming tool - here's 4 ways you can use AI to help with your next playthrough
Apple CEO Tim Cook delivers remarks before the start of an Apple event at Apple headquarters on September 09, 2024 in Cupertino, California. Apple held an event to showcase the new iPhone 16, Airpods and Apple Watch models. (Photo by Justin Sullivan/Getty Images)
The big Siri Apple Intelligence delay proves that maybe we really don't know Apple at all
AI writer
Coding AI tells developer to write it himself
Apple iPhone 16 Pro Max REVIEW
Apple Intelligence is a fever dream that I bet Apple wishes we could all forget about
DeepSeek on an iPhone
OpenAI calls on US government to ban DeepSeek, calling it ‘state-subsidized’ and ‘state-controlled’
Latest in News
Google Pixel 8a in aloe green showing
Google Pixel 9a benchmark link teases the performance of the upcoming mid-ranger
Quordle on a smartphone held in a hand
Quordle hints and answers for Monday, March 17 (game #1148)
NYT Strands homescreen on a mobile phone screen, on a light blue background
NYT Strands hints and answers for Monday, March 17 (game #379)
NYT Connections homescreen on a phone, on a purple background
NYT Connections hints and answers for Monday, March 17 (game #645)
Apple iPhone 16 Pro HANDS ON
Leaked iPhone 17 dummy units may have given us our best look yet at all four models
A super close up image of the Google Gemini app in the Play Store
It's official: Google Assistant will be retired for phones this year, with Gemini taking over