With ChatGPT integrated into Apple Intelligence, Apple has released iOS 18.2 Developer Beta 1, their most recent software version.
The new feature is a part of a larger upgrade that expands Apple’s toolkit to include Genmoji, Image Playground, Visual Intelligence, and Image Wand.
These functionalities will be made available to the general public with the forthcoming releases of iOS 18.1, iPadOS 18.1, and macOS Sequoia 15.1, although full access to OpenAI’s platform will require future updates.
User Consent and Accessibility
Users must choose to use ChatGPT’s integrated capabilities with Apple Intelligence either during setup or later via their device settings.
Notably, you may accomplish this without a separate ChatGPT account or app. But you won’t be able to ask as many questions if you don’t have a premium membership.
All users will have access to all of OpenAI’s models, including GPT-4, in spite of this.
ChatGPT’s Role in Enhancing Siri and Writing Tools
The two primary functions of ChatGPT’s integration with Apple Intelligence are text writing in Writing Tools and knowledge base expansion for Siri.
For instance, the new Siri may ask the user for permission to access ChatGPT in response to certain requests. For tasks like searching for recipes or organising a trip, this can be really helpful.
Even easy is the option to tell Siri to “ask ChatGPT,” which makes it even simpler.
Compose: A New Feature for Content Generation
‘Compose,’ which is available in any program that supports the new Writing Tools functionality, is another noteworthy feature of ChatGPT integration.
This ground-breaking tool complements already-available writing tools like Style and Summary by generating content in response to a prompt.
Additionally, by providing access to OpenAI’s picture generating capabilities, the integration enhances Apple’s recently introduced picture Playground feature, which allows users to create images with prompts.
Exploring Apple’s new features: Image Playground and Genmoji
Both publicly crawled webpages and licensed content are used to train Apple’s Image Playground. In order to avoid any ethical or legal difficulties with counterfeit photographs, it offers two primary styles: animation and drawing. Photorealism is purposefully avoided.
using the help of the Genmoji feature, which was included in the iOS 18.2 and iPadOS 18.2 developer upgrades, you can make your own emojis using prompts like descriptions, people you can identify in your images, and unique characters that you can use in the Messages app, Stickers, and Tapbacks.
Visual Intelligence: Apple’s Response to Google Lens
The most recent update also added Visual Intelligence, Apple’s response to Google Lens.
The feature, which can be accessed using the Camera Control button on the iPhone 16, can translate languages, recognise phone numbers and email addresses, copy and summarise text, and scan QR codes.
Additionally, it offers context for the visuals in front of it, such as business hours and restaurant ratings.
It’s interesting to note that Visual Intelligence may access ChatGPT for information on a variety of topics and Google’s knowledge base for shopping searches.
