Microsoft Copilot Vision for Windows: Enabling AI Screen Recognition

Microsoft Copilot Vision for Windows: Enabling AI Screen Recognition

Introducing Copilot Vision with Highlights: A New Era for Windows Users

Today marks an important milestone for Microsoft as it launches the innovative “Copilot Vision with Highlights”feature for its Copilot app on both Windows 10 and 11. This groundbreaking functionality enables artificial intelligence to analyze what’s displayed on your screen and provides real-time insights, context, and analysis, effectively acting as a “second set of eyes”for users.

Enhancing Your Workflow

Copilot Vision introduces a dual-app functionality, allowing users to maintain their workflow seamlessly between two different applications. This interoperability is particularly beneficial for users who juggle multiple tasks across various platforms. The Highlights feature further adds value by offering interactive guidance; users can simply ask the AI for assistance on specific tasks within applications. For instance, inquiries about how to trim a video in Clipchamp or remove an object from an image in the Photos app are easily addressed.

How to Activate Copilot Vision

Utilizing Copilot Vision is straightforward. Start by launching the Copilot app and clicking the glasses icon located in the bottom-right corner of the composer interface. From there, select the application you wish to share with Copilot and click “Share.”You can then engage with Copilot by asking for suggestions, tips, and additional context. If you wish to stop sharing your screen, simply click “Stop.”Importantly, this feature is available without needing a Copilot Pro subscription, making it accessible to all users.

Privacy-Centric Approach

Microsoft has emphasized that Copilot Vision with Highlights is an opt-in feature, meaning it will not activate without the user’s explicit permission. Following the controversies surrounding the Recall incident in 2024, Microsoft is adopting a more cautious and privacy-focused approach to the release of new features, particularly those sensitive to user data.

Availability and Future Plans

Currently, Copilot Vision with Highlights is being rolled out to users in the United States on Windows 10 and 11 platforms. Microsoft has indicated that users in other non-European countries will soon gain access to this remarkable feature. After rigorous testing among Windows Insiders for several weeks, Copilot Vision is now ready for broader adoption.

For more information, explore the official announcement here.

Leave a Reply

Your email address will not be published. Required fields are marked *