A new report from AppleInsider claims to have inside information on the upcoming AI capabilities of iOS 18 and macOS 15. It mostly lines up with previous reports and rumors, although there are some specific new claims that are worth investigating. ‘be mentioned.
For example, there is Gray Matter Project, the codename for a host of AI features expected to come to iOS 18 and macOS 15. Greymatter focuses on using AI to bring “practical benefits” to users of the operating system. ‘Apple. For example, it’s claimed that you’ll be able to ask Siri to update you on recent notifications and get a summary of them. You will also be able to automatically generate text responses to messages or emails.
Siri would be at the center of many improvements. Siri should get much richer and more personal responses, thanks to a “new intelligent response framework as well as Apple’s in-device LLM.” This means Siri will take into account people, businesses, calendar events, locations, dates and more, using all the data on your iPhone to know You better and elaborate answers that match your own real life.
The voice transcription and text summarization features available in the Notes app will likely also be available with Siri.
AppleInsider claims that Apple has been testing “more natural” Siri voices and text-to-speech improvements, so it should sound less robotic and more emotive.
If you own many Apple devices, you’ll appreciate the ability to use Siri to control media playback and volume across devices, although this feature isn’t expected until later this year.
Photo editing is a key area where Apple intends to use advanced AI. The “Retouch” tool would be replaced with a “Clean” tool capable of removing objects, as similar tools do in other popular photo editing apps.
Apple reportedly has an internal tool called “Generative Playground” that can use gen-AI to create and edit images, and is integrated into Messages via an app extension. In Apple’s testing environments, AppleInsider claims, it is possible to generate an image using AI and send it via iMessage. This is an internal tool, but Apple may have a similar feature in the works for end users, although this may refer to the generative emoji feature. AI image generation is a tricky area and Apple probably won’t want to ship anything until it has undergone strict security checks.
AppleInsider’s report corroborates previous reports about the Notes app; that it will feature voice recording, audio transcription and support math equations with the ability to solve formulas and generate graphs.
The visionOS 2 update for Apple Vision Pro will also get some AI improvements, including better voice control and smart replies in Messages, Mail, and Siri.
We’ll learn a lot more about Apple’s AI ambitions in a few weeks, when WWDC kicks off on June 10.
