Microsoft Edge’s Ambitious AI Integration with Copilot
Microsoft is set to challenge Perplexity Comet with a series of advanced AI features in Edge for Windows 11. Recent observations by Windows Latest reveal a new feature that allows users to send browser tabs to Copilot, along with potential deeper integrations between Copilot and Edge. Notably, Copilot will soon be able to utilize the information contained in the Edge user profile.
The screenshot indicates that a feature labeled “Browser Actions” is currently in testing. When activated, this feature grants Copilot access to the Edge profile, which holds critical information like saved passwords, websites you’re logged into, browsing history, and more.
Copilot already utilizes “Copilot Actions, ” an AI agent powered by in-house ChatGPT models designed to facilitate web navigation. Presently, Copilot employs a Linux terminal alongside a standard instance of Chromium on Azure to execute web tasks. While you can employ Copilot to locate tickets or services, it currently lacks knowledge of your personal browsing habits.
Enhanced Functionality with Edge Profile Integration
Though the exact operation of the “Browser Actions” toggle remains somewhat unclear, it appears that enabling this feature allows the Copilot Agent to browse using the Edge profile. This capability includes opening web pages, interacting with their content, such as clicking buttons, following links, and filling out forms, all while leveraging the logged-in state of your Edge profile.
“Copilot can browse the web and complete tasks using your Edge profile, ” states the copilot description within Edge.
From this, it seems Copilot will operate “as you, ”meaning it will access sites where you are already logged in. Notably, these AI Actions are restricted to the specific chat context where you requested them, maintaining a high level of privacy as they do not navigate outside of your browser’s environment.
Importantly, Copilot cannot control system-level functions or bypass security measures such as passwords or multi-factor authentication. Users will be required to provide any necessary login credentials or verification codes manually. Furthermore, Copilot can’t access tabs unless they are explicitly sent to it from the New Tab Page or from within the Copilot interface; users can tag tabs for Copilot to read as well.
Journeys Feature: A New Way to Summarize Browsing History
In addition to the browsing abilities, we’ve also seen the emergence of the Journeys feature, which enables Copilot to access your browsing history. According to a now-deleted piece of documentation, Microsoft may leverage your past week of browsing activity (excluding actual page content) to enhance your Journeys experience.
When prompted to opt in, users will need to confirm that they wish to grant Copilot access to their Edge profile, noting that this must not be linked to a work or school account.
Utilizing Journeys, Copilot can provide a summarized perspective of your browsing habits, displaying this information in convenient card format on the New Tab Page. Microsoft maintains that all data remains on the user’s device, assuring that personal browsing data is not used for AI training or advertising purposes.
Leave a Reply