Microsoft is actively advancing its use of artificial intelligence (AI) within Windows, taking strides to integrate these technologies into the functionality of the operating system. A new setting titled “Share any window from my taskbar with virtual assistant” has emerged in the Taskbar settings. This feature enables compatible applications, like Copilot and Microsoft 365 Copilot, to interact with any selected window directly through the taskbar interface.
In addition, Microsoft is refining Ask Copilot, a potentially AI-driven alternative to the traditional Windows Search function found in the taskbar. This new feature simplifies access to both Copilot Voice and Copilot Vision, which allows users to share their screens and have tasks performed by Copilot on their behalf.
Windows 11 Enhances AI Integration with New Sharing Features
As noted by Windows enthusiast @phantomofearth, this new taskbar option corresponds to a feature initially tested as “Share with Copilot.” This feature grants the ability to share specific app windows with Copilot by hovering over the respective app’s thumbnail in the taskbar, allowing Copilot to evaluate the on-screen content and provide contextual assistance.
Extensive testing with applications like Outlook and Cloudflare WARP has shown that once a window is shared, Copilot can perform a range of supportive tasks such as reading content, summarizing information, suggesting responses, and guiding users through specific actions by highlighting elements within the user interface. It’s important to note that Copilot operates in a read-only capacity, meaning it does not commandeer the application or interact with sensitive information.
The introduction of this toggle indicates that Microsoft is formalizing these capabilities into a system permissions model, allowing users to selectively grant access to various AI applications that can query window content. Presently, this includes Copilot and Microsoft 365 Copilot, with potential for third-party AI agents to join this roster in the future.
Utilizing the Windows API known as Windows. UI. Shell. ShareWindowCommandSource, Microsoft is enabling different apps, such as Teams, to integrate seamlessly with the taskbar. This API is categorized as a “Limited Access Feature”.
This sharing infrastructure was originally designed for communication apps, but Microsoft appears to be extending its capabilities, allowing AI agents to register as valid sharing targets. This will enable a selected window ID to be communicated from the taskbar directly.
Currently, Copilot and Microsoft 365 Copilot are the only approved apps; however, for additional third-party AI agents to be whitelisted, developers must go through Microsoft’s approval process. It is anticipated that, following this, a broader array of AI agents will be included in the sharing list.
Users can control which AI agents have permission to access window content by enabling or disabling individual agents—a feature that is off by default. To activate this setting, navigate to Settings > Personalization > Taskbar and check the options under Taskbar behaviors:
Configuring AI Agent Prioritization for Enhanced User Control
An intriguing feature allows users to prioritize AI agents when sharing an app window. As depicted in the screenshot, six dots next to each AI agent can be selected, long-pressed, and dragged to reorder their priority. However, there is some ambiguity regarding how users will select the AI agent for window sharing.
Revolutionizing the Windows 11 Taskbar for the AI Age
Historically, the taskbar served primarily as a launcher, providing access to the Start button and running applications. Its design has remained largely static from Windows 7 through Windows 10.
Critics initially voiced discontent over Windows 11’s removal of certain traditional taskbar functionalities, including the flexibility to reposition it around the screen, a change that displeased power users accustomed to a more customizable setup.
In response, Microsoft appears to be reconsidering and enhancing the taskbar while simultaneously broadening its functionality. Plans are underway to restore features allowing users to reposition and resize the taskbar in future updates.
Microsoft is continuously incorporating new features, such as enhanced battery indicators and built-in network speed monitoring directly accessible from the taskbar. The company is pursuing a vision where users can interact with critical information and tasks effortlessly via this interface.
This drive to integrate AI access points aligns with that vision, embedding these functionalities into familiar user interactions. Recent developments with Ask Copilot further illustrate how AI agents can be made accessible right from the taskbar.
It is essential to note that Microsoft is not fundamentally altering the taskbar’s identity but rather enhancing its capabilities on a familiar platform. These new features, while currently in limited testing, may evolve based on user feedback before reaching a broader audience.
Related Articles:
Microsoft Recommends 32GB RAM as the Ideal Upgrade for Windows 11 Gaming
19:34
Satya Nadella Confirms 1.6 Billion Monthly Windows Users and Bing Surpasses 1 Billion Users
15:14
Satya Nadella Acknowledges Microsoft’s Need to Regain Windows 11 Users and Enhance Performance for Low RAM Computers
0:54
Leave a Reply