Google Lens Introduces Video Search and Voice Query Features

Google has recently revealed significant advancements in AI-driven search capabilities that are poised to transform how users interact with search. These innovative features will enhance the overall search experience across its platform.

One of the standout updates is the introduction of video understanding in Google Lens. This new functionality allows users to inquire about objects displayed in videos. Essentially, by recording a video within the Lens app and verbally posing a question, Google’s AI algorithms can process both the video content and the query, yielding pertinent information.

Additionally, Lens now facilitates voice interaction, enabling users to simply hold down the shutter button while viewing a photo and articulate their questions aloud.

To utilize this feature, open Lens in the Google app, hold the shutter button, and ask your question verbally—like, “why are they swimming together?” Our AI systems will interpret the video alongside your question to generate an AI Overview, complete with useful links from around the internet.

Shopping features have also seen enhancements. When users perform visual product searches through Lens, they now gain access to comprehensive pages that include reviews, pricing from various retailers, and clear purchase options. This functionality has been extended to over 150 million Android devices beyond the Google app.

Moreover, Google employs AI to better categorize and present search results. For instance, when users search for recipes, dedicated pages of assorted content will be highlighted in a customized layout. In initial testing phases, users reported that these AI-organized pages were more beneficial for open-ended searches.

Links to relevant websites are increasingly being included directly within the text summaries of AI Overviews, providing users immediate access to diverse perspectives on the web. Furthermore, some AI Overviews may soon display advertisements that feature pertinent products and services.

Source