Google’s Project Astra AI Can See and Explain the World [DEMO]

Not to be outdone by OpenAI’s ChatGPT-4o announcement yesterday showcasing demos of AI seeing and explaining the world, Google has revealed Project Astra.
This prototype from Google DeepMind is “exploring how a universal AI agent can be truly helpful in everyday life.”
The demo below was captured in a single take in real-time, shared at Google I/O happening right now. We see Project Astra on a smartphone with the device’s camera pointing at objects in an office. The AI explains what it sees and responds to conversational prompts, such as coming up with alliteration when seeing crayons.
Project Astra is a prototype from @GoogleDeepMind exploring how a universal AI agent can be truly helpful in everyday life. Watch our prototype in action in two parts, each captured in a single take, in real time ↓ #GoogleIO pic.twitter.com/uMEjIJpsjO
— Google (@Google) May 14, 2024
AI that can explain and see the world is going to change life for those with vision impairments and accessibility issues. It’s also going to change the game for education.
Want to see more of our stories on Google?
P.S. Want to keep this site truly independent? Support us by buying us a beer, treating us to a coffee, or shopping through Amazon here. Links in this post are affiliate links, so we earn a tiny commission at no charge to you. Thanks for supporting independent Canadian media!
after the openai presentation it looks like it’s another rubbish from a century ago. Meh.