Searching Through Your Google Photos Library Just Got a Lot Better

A collage of photos and text. Two women laughing with drinks, two women posing outdoors, a bowl of food, a conversation with "Hi Elisa, What can I help you with?", and a search bar with “Alice and me laughing”. Buttons for "Ask Photos" and search are also visible.

Google is bringing improved search to Google Photos so that navigating the piles of photos is a lot more like using the company’s “classic search” which supports the use of everyday language.

The company says that searching through photos will feel more natural as the platform supports natural, descriptive queries. Basically, the goal is to make searching through Photos feel like using Google Images. Google points to several examples of what this might look like, including “Alice and me laughing,” “Kayaking on a lake surrounded by mountains,” and “Emma painting in the backyard.” 

A smartphone displaying a search bar at the top with the partially typed text "Emma painting in the ba," suggesting search predictions. The keyboard below shows various word suggestions, and the screen's time shows "10:00" with a 5G signal.

The update not only promises better results but also allows users to sort search results by date and relevance, adding another layer to help find a specific image even faster. Google is rolling out the improved search in Photos in English to all users on Android and iOS starting today and intends to expand to more languages “over the coming weeks.”

‘Ask Photos’ Early Access

In addition to adding “classic search” to Google Photos, today the company also announced that it would be adding early access to “Ask Photos” to select U.S. users as part of Google Labs. Ask Photos is described as an experimental experience that is meant to go beyond standard search thanks to Google’s Gemini AI models. Google claims that Ask Photos doesn’t just see the content of an image, it understands the context and can see relevant details that make it easier to find images of specific moments.

“For example, if you are trying to plan your next camping trip and want to return to a favorite site, you could ask,’Where did we camp last time we went to Yosemite?’ Or if you want to go back to a restaurant you enjoyed and order the same thing, just ask, ‘What did we eat at the hotel in Stanley?'” Jamie Aspinall, Group Product Manager at Google Photos, says.

“Ask Photos understands details, like where you took photos with your camping gear or what dish is sitting on the table in your picture at the restaurant, to give you the answer. And because Ask Photos is conversational, if it doesn’t find the right answer immediately, you can provide extra clues or details to nudge it in the right direction.”

The Gemini AI-powered Ask Photos can also support some queries, such as its ability to provide suggestions for what it thinks is the best photo from a series or can provide a summary of events over a photo set.

As this is an AI-driven update, Google says that it is approaching it with concern for data privacy and is launching Ask Photos through the lens of its AI Principles.

A smartphone screen displays the Google Photos app, featuring a welcome message to a user named Jamie Aspinall. The interface offers options to switch to classic search, and a search bar at the bottom for photos, memories, collections, and an "Ask me anything" feature.

“While we strive to always improve our products based on actual usage, we take our responsibility to protect your data and privacy very seriously. As always, your data in Google Photos is never used for ads and protected with our industry-leading security measures. To help us improve Ask Photos, queries may be reviewed by humans, but only after being disconnected from your Google Account to protect your privacy. The answers provided by Ask Photos, including your photos and videos, are not reviewed by humans, unless you provide feedback or in rare cases to address abuse or harm,” Aspinall says.

Ask Photos is rolling out to select users today in early access so that it can be properly tested before it is expanded to more users. Google has set up a waitlist to join the early access test for those who want to try it.


Image credits: Google

Discussion