What’s New in iOS 18.2 Beta 2: Features and Siri Enhancements

The rollout of iOS 18.2 beta 2 commenced on Monday for developers, introducing an array of exciting features aimed at enhancing user experience. Notably, this update includes the integration of ChatGPT within the Settings app, a new “Create Image” option in Notes, an upgraded Find My functionality, and updated notification badges in the Mail app, among other improvements. A stable version of this update is anticipated to be available next month.

Siri’s New Contextual Awareness Features

In addition to the broader feature set, the iOS 18.2 beta is paving the way for significant advancements in Siri’s functionality. Apple is currently developing a sophisticated feature that enhances Siri’s contextual awareness, as part of its Apple Intelligence suite. New APIs have been provided to developers, allowing Siri to access onscreen content from their applications.

How Siri Can Interact with Onscreen Content

According to Apple’s documentation, when users inquire about onscreen content or seek to execute an action related to it, Siri and Apple Intelligence are equipped to retrieve such content to deliver appropriate responses. For example, if a user is viewing a document, they can simply ask, “Hey Siri, what’s this document about?” and receive a detailed summary.

Integrating ChatGPT with Siri

The ongoing iOS 18.2 beta update also features enhanced integration of ChatGPT with Siri, which allows users to inquire about various formats such as images, videos, PDFs, and presentations. For instance, by asking Siri “What’s this document about?”, Siri can capture the information via a screenshot, pass it to ChatGPT, and provide the user with the necessary details.

Distinguishing Features: ChatGPT vs. Onscreen Awareness

However, as highlighted by MacRumors, it’s crucial to note that the integration with ChatGPT does not equate to the full onscreen awareness capabilities described in Apple’s documentation. This feature is designed for Siri to comprehensively process, analyze, and interact with visible content on the screen. For example, a user receiving a text with a phone number can ask Siri to add this number directly to their contacts.

Availability and Future Prospects

Interestingly, the advanced onscreen awareness feature is not yet included in the current iOS 18.2 beta 2. Currently, ChatGPT is limited to accessing screenshots, suggesting that a more integrated Siri experience may arrive with future updates, potentially not appearing until next year.

For further insights and images, visit the original source here.