Copilot Now Identifies Your Current Windows App and Provides Usage Guidance

Sharing your screen with AI tools has never been easier! Instead of relying solely on text prompts to convey tasks, you can leverage Microsoft’s Copilot to navigate through Windows applications seamlessly. Whether you’re new to a certain program or just need a refresher, Copilot can be your digital guide.

Copilot Now Guides You Through Windows Apps

Introducing Highlights, a revolutionary feature that enables Copilot to assist you visually as you complete tasks in shared browser tabs or applications. To utilize it, simply share your desired app window via Copilot Vision and request guidance on a specific operation.

Microsoft has illustrated the potential of this feature with compelling use cases. For example, you can present the Settings app window, prompting Copilot to demonstrate how to activate the Night Light feature. Alternatively, ask it to guide you on inserting footers in your productivity app or adding text to a project in your video editing software.

Copilot Highlights feature running on Windows 11 — Microsoft

This groundbreaking feature is designed to enhance your ability to grasp complex programs with minimal hassle, particularly tools widely used by professionals such as those in Adobe’s Premiere Pro or Photoshop. Say goodbye to sifting through tedious YouTube tutorials!

While Highlights currently operates one app or browser tab at a time, Copilot Vision expands its capabilities by supporting the sharing of two applications simultaneously. This allows for an enriched interaction where Copilot can analyze data from both sources, answering your questions effectively. For instance, maybe you’re preparing a packing list in one app and using a web browser for an online checklist—Copilot can help you cross-reference and ensure nothing’s missed.

Furthermore, this functionality can significantly streamline coding tasks. Instead of constantly switching between your online documentation and code editor, imagine the convenience of having Copilot assist by analyzing your code with reference to a documentation sample or querying your online resources to identify bugs. This could truly be a game-changer for developers!

How to Get Started with Highlights

To access these innovative features, ensure you have Copilot app version 1.25044.92.0 installed on your device. The rollout of this update is gradual across all Insider Channels through the Microsoft Store, so patience may be necessary for some users even if you belong to the Windows Insiders program.

Currently, these features are exclusive to Windows Insiders residing in the US, but a broader global rollout is anticipated. If you want to secure early access, enrolling in the Windows Insiders program is advisable, alongside regularly checking for updates in the Microsoft Store for the Copilot app.

Keep in mind that the current implementation of these features is in beta. This means you may encounter occasional glitches or issues, but you should still find it relatively easy to navigate through essential Windows applications.

In a broader context, Microsoft is also introducing AI agents capable of helping users locate and adjust Windows settings using natural language. As the company integrates more AI features across its ecosystem, it appears to be on a promising path toward making Copilot a truly valuable asset for Windows users.

Frequently Asked Questions

1. What is the Copilot Highlights feature?

The Copilot Highlights feature allows users to receive visual guidance through Windows applications by sharing their screens. It helps in completing specific tasks with easier cues and instruction.

2. Which Windows apps can I use with Copilot Highlights?

While Copilot Highlights can potentially work with any compatible Windows application, currently it specifically guides you through one app or browser tab at a time, supporting programs like Adobe’s Premiere Pro, Photoshop, and various productivity applications.

3. When will Copilot Highlights be available globally?

The rollout of Copilot Highlights is currently limited to Windows Insiders in the US. However, a worldwide rollout is expected, and your best chance for early access is by enrolling in the Windows Insiders program and keeping your app updated.

Source & Images