Meta announced Project CAIRaoke, an end-to-end neural model for building on device systems, to help deliver better dialogue capabilities, true world creation, and exploration.
CEO Mark Zuckerburg spoke about a few breakthroughs in AI research geared for the metaverse, alongside his vision for AI assistants (aka Project CAIRaoke) and more during his keynote speech at Meta’s Inside the Lab: Building for Metaverse for AI event.
Highlighting the challenges in building the metaverse, Zuckerburg said the key to unlocking a lot of advances relies on AI. Further, he said, as these worlds will be dynamic and always changing, AI will need to understand the context and learn in the way that humans do. “When we have glasses on our faces, that will be the first time that an AI system will be able to really see the world from our perspective,” said Zuckerberg.
He said computing is becoming more contextual. “As devices have gotten better at understanding and anticipating what we want, they have also gotten more useful. I expect that these trends will only increase in the future,” he added.
Zuckerberg said the metaverse would consist of immersive worlds the user can create and interact with, including the position in 3D space, body language, facial gestures, etc. “So, you experience it and move through it as if you are really there,” he added.
Meta announced project CAIRaoke, an end-to-end neural model for building on device systems, to help deliver better dialogue capabilities, true world creation, and exploration.