Microsoft Introduces Free Copilot Vision for Edge on Windows 11: Hands-On Review

Last year, Microsoft announced the development of Copilot Vision, which is designed to revolutionize the way users interact with web pages in Microsoft Edge. Initially launched for Pro subscription users in the United States, this innovative AI Assistant is now available to free users, albeit with geographical restrictions still in place.

Following its rollout, Windows Latest took the initiative to explore the capabilities of Copilot Vision using a US-based virtual machine. The process began by initiating a Bing search for “Copilot Vision, ”selecting a relevant link, and clicking on “Try it now.” Accepting the terms and conditions set the stage for this cutting-edge experience.

While Microsoft provided a brief overview of how Copilot Vision operates, many users found the initial instructions lacking in clarity.

Getting Started with Copilot Vision in Microsoft Edge on Windows 11

Upon launching Copilot Vision within Edge’s sidebar, I began by exploring the official Vision page by clicking here. Excited to understand its functionalities, I posed a question to Copilot Vision about the content of the webpage. Unfortunately, the AI quickly blanked out during our conversation.

Thinking it was a temporary glitch, I repeated my inquiry. Sadly, after a brief engagement, the AI paused mid-response, attempting to devise an answer but failing to maintain a coherent dialogue. It became evident that Copilot was struggling to grasp the context and engage in a fluid conversation.

Staying on Microsoft’s site, I asked how many buttons appeared on the page. Copilot Vision answered correctly that there was one prominent button labeled “Try it.” However, it failed to recognize a second vital button for playing a video.

As I attempted to engage Copilot Vision further—requesting it to click the button or play the video—I was met with rejections. The AI expressed an inability to interact with page elements or even to pause its verbal output.

Assessing the Utility of Copilot Vision

Once I had closed the unnecessary window, I navigated to Windows Latest’s homepage and revisited Copilot Vision. To my relief, it accurately described a new article. This moment sparked optimism about Vision’s potential, yet its reliability still posed significant concerns.

Next, I tested Copilot on Amazon UK, asking for insights on the best SSDs according to search results. The AI listed details about many SSDs but faltered when asked to compare offerings from Acer and WD. Although Copilot provided a surface-level analysis, it fell short due to its lack of external web querying capabilities.

When I inquired about the performance specs of an Acer SSD, the Copilot couldn’t provide specific information as it was beyond its current understanding and capabilities. Attempting to access additional data via Bing resulted in failure as it declined my request to search.

While Copilot can assist with quick data extraction from visible areas, its lack of depth makes it a less-than-reliable partner for serious research. Alerted to sponsored products, the AI identified only Sandisk, missing competitors like Samsung despite being present on the page.

This oversight reinforces that Copilot Vision can only interpret visible screen elements and fails to navigate entire pages, limiting its functionality. Even when scrolling down the site to find additional items, it lost continuity and could not remember previous mentions.

Inquiring about sponsored items with Copilot Vision

Ultimately, Copilot Vision’s current performance leaves much to be desired. Its tendency to overly seek user approval—often apologizing for deficiencies—demonstrates a need for further enhancements. Important features such as improved scrolling capabilities or the ability to access the full content of a webpage must be integrated to elevate the user experience.

Frequently Asked Questions

1. What is Copilot Vision and how does it work in Microsoft Edge?

Copilot Vision is an AI Assistant integrated into Microsoft Edge that allows users to engage with web pages through voice commands. By activating the feature, users can ask questions and receive spoken responses about the content displayed on their screen.

2. Why does Copilot Vision struggle with web page interactions?

The current limitations of Copilot Vision include its inability to interact with page elements or search external information online, reducing its effectiveness in providing comprehensive responses. It can only analyze visible text but fails to engage in a deep and meaningful conversation regarding the content.

3. Is Copilot Vision available to all users of Microsoft Edge?

Initially available only for Pro subscription users in the United States, Copilot Vision has now been extended to free users as well. However, this rollout is also limited to users in the United States at present.

Source & Images