Sometimes a traditional Google Search doesn’t cut it. When you want to find a pair of snazzy sneakers worn by a celebrity or a cheaper alternative to designer denim, bashing out text on Safari or Chrome probably won’t fetch your desired results. For times like these, you need to get visual.
That’s where Google Lens comes in. Google’s digital helper uses your phone’s camera or photo gallery to identify objects, text and scenes on the fly. Just point it at what you want to look up, snap a photo and wait for the results. Behind the scenes, Google’s AI algorithm processes the visual data and matches what it sees with Google’s vast database of online information.
While you can use it for everything from helping with homework to identifying dog breeds, it’s especially helpful as a personal shopper. And, although it's available on desktop web browsers, the most convenient way to use it is via the Google app on iPhone and Android.
Now, Google is giving Lens a significant upgrade that should make it even more intuitive. Firstly, you can ask Google Lens what’s in an image or video with your voice, making it even quicker to interact with the visual helper.
Some users got the new feature early and are already asking it diverse questions including the make and model of a specific smartwatch. Or, as Google suggests, you could use it to troubleshoot your tech problems or to look up furniture.
Even if you’ve already got your heart set on a sofa in a store, you may not be thrilled about the colour or the price. With Lens, you can at least look up if it’s available for less elsewhere and in a shade that’s more to your liking.
You can now send a video to Google to ask questions about it!
— Mishaal Rahman (@MishaalRahman) September 30, 2024
If you open Google Lens on Android and hold down the shutter button, it'll record a short video that you can ask a question about.
If you're in a region where AI overviews are enabled, then you'll get an AI-generated… pic.twitter.com/qeGWy6u1TM
To that end, Lens can also list more shopping information than ever, including the price across retailers, current deals, reviews and where to buy a product. This being Google, you should also be prepared to see more ads, including sponsored products from other brands. But, any seasoned searcher will scroll right past those.
To use the new perk, point your phone’s camera at what you want to capture, hold the shutter button and start talking. Lens will then show you results, including AI-generated summaries, based on the picture and your query.
The upgrade is made possible via an update to the Google app, where you can also access the company’s Gemini AI chatbot.
Google says that Lens is now used for nearly 20 billion visual searches monthly with Gen Z users aged 18-24 most inclined to use it. But, it’s not just youngsters who are behind the trend; we’re all getting more visual with our searches thanks to the rise of TikTok and YouTube. These video apps are the go-to destination for many who want to know if the appliance or gadget they’re buying is worth it.
Meanwhile, Google’s Circle to Search, which lets you search anything on your screen by simply drawing a circle around it, is taking on Apple’s Shazam with a new song recognition feature. The broader function is still limited to select Google Pixel and Samsung phones but is coming to more Android devices this year.