Microsoft Copilot for Android Unveils “Share Screen” Feature, Competing with Gemini Live

Introducing Screen Sharing with Copilot on Android

Microsoft has unveiled a new feature for Copilot on Android, titled “Share screen.” Before this update, users could only share their camera view with Copilot Vision; now, they can also display the contents of their device screen. This exciting enhancement has been confirmed by Microsoft in a statement to Windows Latest, indicating that this screen-sharing feature is available for free on Android.

“We’re excited to roll out the new screen sharing experience for Vision on mobile. Now, in addition to showing the world through your camera with Copilot, you can also share exactly what’s on your device screen, ” Microsoft shared with Windows Latest.

Capabilities of Screen Sharing

With the newly integrated screen-sharing functionality, users can prompt Copilot to assist with various tasks, including:

Summarizing or translating on-screen content
Providing guidance for application usage
Crafting responses to messages or emails
Troubleshooting device issues in real time

How to Access Screen Sharing

According to reports from Windows Latest, the screen sharing capability is automatically activated through a server-side update. Users should ensure that they have installed the latest version of Copilot, as this feature does not require joining a beta program; it is rolling out universally.

To initiate screen sharing, users simply tap the goggles icon (representing vision) and select the “share screen” option. If this option is unavailable, it indicates that the feature has not yet been enabled for your device. Upon tapping “Share screen, ” you’ll see a pop-up prompting you to start recording or casting with Copilot.

Screen Sharing Limitations

Currently, users can only share their entire screen, as Copilot does not support the sharing of specific applications or windows. However, navigating through the feature is straightforward.

Personalization Options

Accessing the settings via the cog icon allows users to customize their experience slightly. While the options are somewhat limited, users can select from eight different voice accents and adjust the speaking speed, ranging from 0.5x to 2x. This feature allows for personalized interaction, although any changes would reset the current conversation.

Real-Time Assistance and Limitations

During testing, I found Copilot Vision to be impressively responsive. For example, when I opened the Microsoft Launcher, Copilot began providing contextual information about my screen, like the time in New York. As I began speaking, Copilot intelligently muted itself and listened, which is reminiscent of human conversations.

Its contextual awareness was evident when I asked how to change to the light theme in the settings. Copilot quickly identified the user interface as OneUI and suggested using the search bar. However, when I requested an alternative navigation method, it guided me step-by-step to open the Display settings and select Light under Appearance.

Notably, while Copilot can assist in navigating settings, it does not execute commands on behalf of the user; rather, it acts as a guide through the interface.

Comparative Technologies

In a similar vein, Gemini Live operates under a comparable principle, positioning Microsoft to compete directly with Google in the realm of assistive technologies. As these advancements continue to evolve, the efficacy and convenience of AI assistants like Copilot Vision become increasingly apparent.

Conclusion: Will You Embrace This New Feature?

As this feature rolls out, it poses an interesting question for users: Will you utilize Copilot Vision to interact with your screen or camera? Share your thoughts in the comments below!

Source & Images