Muse: A Platform Approach to AI

3min Snip

00:00

Play full episode

Summary

Transcript

Episode notes

John Carmack: I spent a lot of time around 3D and developers and creators. And, you know, as far as what brought me to the company, I knew our CEO quite well for my time in Xbox. It seems clear to us that over time, everything in every game is going to be touched by AI at create time," he says. "And then also, how do we unlock the real power of AI at runtime when the game's actually being played? So Unity Muse is our platform for creation side AI"

Hosts Andrew Kim and Nicholas Grous venture into the world of artificial intelligence (AI) in the gaming sector with Marc Whitten, the President of Create at Unity. They discuss AI’s role in creating vivid, immersive 3D experiences. Marc gives them a behind-the-scenes look at the complexities and opportunities involved in deploying AI for content creation in games. They also explore Unity’s mission to make game design accessible to all. The conversation doesn’t stop at gaming; they also cast a wider look at how real-time 3D technology is making waves across various industries. So join Andrew, Nicholas, and Marc on this insightful journey where they blend technology, creativity, and gaming into a captivating exploration.

“I believe that we’re going to enter this golden age of inference based techniques used at Runtime and many of those are going to be very small models.” @MarcWhitten Key Points From This Episode:

Mark Whitten’s background and role as President of Create at Unity
Gaming industry competitiveness and use of AI
AI targeting specific players and improving ad monetization
Focus on building and maintaining gaming communities
AI at Runtime for immersive and dynamic game worlds
Non-player character (NPCs) having meaningful conversations and shaping game experiences
Implications and challenges of generative AI in game development
Unity’s use of AI tools and collaboration with Apple
Apple’s approach to spatial computing and Vision OS
Orchestration of AI techniques through Muse platform
Solving content creation crisis in the industry
Productivity gains and increased number of creators with AI tools
Challenges and benefits of using neural network-based features in games
Cintus platform for local model execution and improved performance
Designing games for different platforms and input methods
Real-time and 3D technology in non-gaming industries
Unity’s goal of expanding applications and accessibility of tools
AI’s role in content creation across various industries
Unity’s focus on real-time and 3D technology in different sectors
Partnerships with various platforms and potential for creativity