Apple has unveiled the next generation of Apple Intelligence, revealing that it worked closely with Google to build the AI models that will power its latest software experiences.
During the WWDC keynote, Apple said it collaborated with Google and the technology behind the Gemini family of AI models to create new Apple Foundation models. These models have been adapted to run directly on Apple devices and through the company’s Private Cloud Compute infrastructure.
The upgraded Apple Intelligence platform brings improved reasoning, understanding and multimodal capabilities, allowing it to work with text, images and speech.
Apple says the new models can understand visual content, generate realistic images, edit photos and answer questions about what users are looking at on screen.
The company also announced a more powerful version of its on-device AI model for newer Apple Silicon devices. This version can understand and generate speech in addition to processing text and images.
According to Apple, the new models also improve dictation accuracy, natural language understanding and voice quality across its platforms.
Apple Intelligence is now deeply integrated into iOS, iPadOS and macOS through a new architecture that combines personal context, web knowledge, app actions and on-screen awareness.
For example, users can search for old photos, notes and other personal information using natural language. Apple Intelligence can also retrieve current information from the web and use app-specific tools to complete tasks such as drafting emails, editing photos or sharing content.
The system can also understand what is currently displayed on screen and provide assistance based on the app being used.
Apple said these capabilities are coordinated by a new system orchestrator that works across apps and services.
Privacy remains a key focus, according to Apple. The company said Apple Intelligence processes requests either on-device or through Private Cloud Compute, which is designed so that user data is not stored and cannot be accessed by Apple.
Apple said the new architecture lays the groundwork for an all-new Siri, which the company says will be more intelligent, context-aware and capable of helping users across their devices.
Want to see more of our stories on Google?
P.S. Want to keep this site truly independent? Support us by buying us a beer, treating us to a coffee, or shopping through Amazon here. Links in this post are affiliate links, so we earn a tiny commission at no charge to you. Thanks for supporting independent Canadian media!
