At its iPhone 16 event on Monday, Apple frequently mentioned AI, though the new generative Apple Intelligence features won’t be available with the public release of iOS 18 on September 16th or when the new iPhones launch on September 20th. The first wave of Apple’s AI tools is set to be released next month in most regions, except the EU, as part of a beta test for the iPhone 15 Pro, all iPhone 16 models, and Macs and iPads with M1 or newer Apple Silicon chips. Initially, these features will only be available in US English.
Table of Contents
ToggleWhat’s Coming to Apple Intelligence in October
- Writing Tools
- Text Rewrite: Helps turn your email drafts into more polished versions, with options to change the tone to friendly or concise.
- Proofread: Corrects grammar, improves sentence structure, and suggests better word choices.
- Summarize Text: Allows you to condense text to key points or generate a bulleted list or table.
- Smart Reply: Offers context-based suggestions for replying in Mail or other apps.
- New Siri
- New Look: Siri will appear as a rainbow ring on iPhone, iPad, and CarPlay, while on Mac, it can be placed anywhere on your desktop.
- Apple’s New Language Model: Siri will get better at understanding natural language with an on-device language model, while more complex queries will be handled by Apple’s “Private Cloud Compute” server, which doesn’t store data.
- Type to Siri: Users will be able to type questions to Siri instead of speaking them.
- Photos
- Clean Up: Similar to Google’s Magic Eraser, it will remove unwanted objects from photos.
- Search: Natural language search will help you find specific photos in your library.
- Memories: You can create movies from your photo library by providing a prompt, and it will generate a story with chapters.
- Transcription
- Call Recording and Transcription: Record phone calls and receive a transcription, with notification given to all parties.
- Voice Recording in Notes: Record audio directly in the Notes app, which will transcribe the speech to text. You can also use writing tools to summarize the session.
Upcoming Features
- Visual Intelligence: This feature will let you gather information by taking photos. For example, snap a picture of a café to view its hours and menu, or take a photo of a concert poster to add the event to your calendar. This will be accessible through the Camera Control button on the iPhone 16 and 16 Pro.
- Genmoji: Users will be able to create custom emojis by entering a text prompt, and Apple’s image generator will produce a new emoji for sharing.
- Image Playground: In addition to custom emojis, users can create custom images by providing a text prompt, though some restrictions will apply.
- Siri Personal Context: Siri will later gain the ability to help with contextual information on your iPhone, iPad, or Mac.
- OpenAI Integration: Apple Intelligence writing tools will offer an option to use ChatGPT for additional generative AI capabilities, including processing Siri requests for more advanced responses.
- Third-Party App Integration with Siri: In the future, Siri will be able to complete in-app tasks, such as editing photos in an image editing app using images from your Photos library.