Apple on Monday made several major artificial intelligence (AI) announcements during the keynote session of its annual developer event, the Worldwide Developers Conference (WWDC) 2024. The event was kicked off by CEO Tim Cook, who emphasized that “intelligence” updates would be announced at the end events. The artificial intelligence segment started with Apple Intelligence, which has dropped the Cook name and which appears to be the Cupertino tech giant’s version of integrating generative artificial intelligence into its devices.
Apple Intelligence
Highlighting the five pillars of Apple Intelligence – capable, integrated, intuitive, personal and private – the company unveiled recent AI-powered writing tools that can summarize content and transcribe text across a variety of app devices. The company is also adding image generation capabilities to its devices that will run in applications such as Messages, Keynote, Freeform and Pages. Users will not be able to create realistic images, but they can generate artistic images in a variety of styles. These images will be generated based on the photos in the user’s gallery.
In explaining Apple Intelligence’s emphasis on privacy, the company promises “on-device intelligence,” which is simply processing on the device using the device’s chipset. Claiming that enormous AI models will require more computing power, the company also unveiled Private Cloud Compute, Apple’s encrypted cloud solution that balances privacy while offering advanced AI features.
Siri based on Apple intelligence is gaining recent possibilities
As we have already reported, Siri is undergoing a thorough artificial intelligence modernization. The basis for updating is understanding the context. The virtual assistant can now understand natural language and slurred sentences to find their hidden meaning. Additionally, AI-powered Siri will also be integrated with various native Apple apps. With this integration, Siri will be able to take actions in applications using verbal messages. For example, Siri can open a photo in edit mode and can augment the brightness and contrast when prompted to “make the image glow.”
Siri receives recent Apple Intelligence capabilities
Image source: Apple
Apple says Siri will be able to understand things and complete tasks that it has never done before. In the demo, Siri answers the question “When will my mom’s plane land” and checks the flight information in the email to provide the answer. The recent look and capabilities of Siri will be available on iPhone, iPad and Mac devices.
Apple intelligence features in the app
The Memories feature in the Photos app has now been enhanced by Apple Intelligence. The AI feature will automatically select the best photos and videos based on the description and create a storyline. A recent Cleanup tool has also been added to the Photos app, which allows you to remove unwanted objects from the background of a photo without changing the subject. It works similarly to Magic Eraser in Google Pixel devices and Object Eraser in Galaxy AI.
Recent writing tools in Mail
Image source: Apple
Another app that gains Apple Intelligence capabilities is the Mail app. It will include several writing tools, including Rewrite, which will allow users to rephrase their messages in different tones, such as affable, professional and concise. Users can also rewrite it into different styles using manual suggestions as well. Proofreading, another writing tool, will check the grammar, word choice and sentence structure in your prepared emails. Summarizing is another tool that extracts the most critical information from long emails. Intelligent Replies have also been introduced.
The Messages app will also get recent Apple Intelligence features. Users will be able to create custom emojis, called Genmojis, by typing a text prompt in the Messages app. The artificial intelligence will generate different iterations of the described emoji, and users will be able to choose one of them.
ChatGPT is coming to Apple devices
Expanding its AI ecosystem with third-party tools, Apple announced integration with ChatGPT OpenAI. Free users will be able to operate ChatGPT without having to log in or without their information leaving their device. Paid users will be able to connect their accounts to the platform. You will also be able to operate it on Apple devices.
ChatGPT integration with Apple devices
Image source: Apple
ChatGPT will be integrated with Siri and system-wide typing tools on Apple platforms. It will also support image and document processing capabilities in tools integrated with the application. Essentially, GPT AI models will provide multimodal LLM capabilities for most of the AI capabilities announced within Apple Intelligence.
Apple Intelligence will run on Apple silicon and its neural engine. These AI features will be available in beta on iPhone 15 Pro, iPhone 15 Pro Max, and iPads and Macs running M1 and later. In beta, Siri features will be available when the device language is set to English (US) in iOS 18, iPadOS 18 and macOS Sequoia later this year.
