Apple has announced a major expansion of Siri’s capabilities, adding visual intelligence, advanced writing tools and deeper integration across iPhone, iPad, Mac and Vision Pro at WWDC.
The new features are powered by Apple Intelligence and are designed to help users understand what they see, take action on information and create content more easily.
One of the biggest additions is a new visual intelligence mode on iPhone. Integrated directly into the Camera app, the feature allows Siri to analyze what the camera is looking at and provide information or complete tasks based on what it sees.
Users can point their iPhone at objects, documents, food or other items and ask questions about them. Siri can then provide detailed responses and answer follow-up questions.
Apple demonstrated several examples, including analyzing a meal to provide nutritional information and identifying items on a restaurant bill to help split costs using Apple Cash.
The company says images and conversations from visual intelligence sessions can be saved and revisited later through the Siri app.
Visual intelligence is also expanding to Mac. Users can activate it with a dedicated keyboard shortcut, select content displayed on screen and ask Siri questions about it. Siri can then analyze the selected content and suggest actions.
For example, Apple showed Siri recognizing a schedule and recommending that multiple events be added to a calendar with a single action.
On iPad, visual intelligence is built directly into the screenshot experience, allowing users to ask questions about content displayed on screen, search visually and perform actions without switching apps.
Apple is also bringing visual intelligence to the Vision Pro headset. During a demonstration, Siri answered questions about travel gear by analyzing both products shown on screen and physical objects in the surrounding environment.
Alongside visual intelligence, Apple introduced new AI-powered writing tools integrated throughout its platforms.
Users can ask Siri to generate documents, emails and messages from scratch using natural language prompts. Apple says the assistant can also adapt its writing style based on the person receiving the message.
For example, Siri can draft concise bullet-point emails for a manager or create more casual messages for friends and family.
The company also showed Siri reviewing written content and providing suggestions to improve clarity, tone and structure.
In addition, Apple Intelligence now automatically proofreads text as users type across the operating system. Apple says the feature works system-wide, including in many third-party apps, without requiring users to manually invoke writing tools.
Apple says the new visual intelligence and writing features are powered by Apple Foundation models running on-device and through Private Cloud Compute, helping protect user privacy while delivering advanced AI capabilities.
The company described the update as another step toward making Siri a more capable AI assistant that can understand, create and take action across Apple’s ecosystem.
These AI Siri features are useful as they are baked into the iPhone and more. But it’s coming way too late to the game.
Want to see more of our stories on Google?
P.S. Want to keep this site truly independent? Support us by buying us a beer, treating us to a coffee, or shopping through Amazon here. Links in this post are affiliate links, so we earn a tiny commission at no charge to you. Thanks for supporting independent Canadian media!
