Muse: A Platform for AI-Based Training

4min Snip

00:00

Play full episode

Summary

Transcript

Episode notes

Muse has acquired a company called Ziva Dynamics that's focused on ML and AI-based training to solve this problem. The old way of creating a high quality character was to create it and then you hand-rig every point that's potentially animatable. It's extremely time consuming, which is one reason why the quality of characters that you often see, especially in real time, has not increased at the same level as GPU or hardware capabilities. Something that might take a team of artists three months suddenly can take a server run about ten minutes to get you back something that you can use in real time and interactively.

Hosts Andrew Kim and Nicholas Grous venture into the world of artificial intelligence (AI) in the gaming sector with Marc Whitten, the President of Create at Unity. They discuss AI’s role in creating vivid, immersive 3D experiences. Marc gives them a behind-the-scenes look at the complexities and opportunities involved in deploying AI for content creation in games. They also explore Unity’s mission to make game design accessible to all. The conversation doesn’t stop at gaming; they also cast a wider look at how real-time 3D technology is making waves across various industries. So join Andrew, Nicholas, and Marc on this insightful journey where they blend technology, creativity, and gaming into a captivating exploration.

“I believe that we’re going to enter this golden age of inference based techniques used at Runtime and many of those are going to be very small models.” @MarcWhitten Key Points From This Episode:

Mark Whitten’s background and role as President of Create at Unity
Gaming industry competitiveness and use of AI
AI targeting specific players and improving ad monetization
Focus on building and maintaining gaming communities
AI at Runtime for immersive and dynamic game worlds
Non-player character (NPCs) having meaningful conversations and shaping game experiences
Implications and challenges of generative AI in game development
Unity’s use of AI tools and collaboration with Apple
Apple’s approach to spatial computing and Vision OS
Orchestration of AI techniques through Muse platform
Solving content creation crisis in the industry
Productivity gains and increased number of creators with AI tools
Challenges and benefits of using neural network-based features in games
Cintus platform for local model execution and improved performance
Designing games for different platforms and input methods
Real-time and 3D technology in non-gaming industries
Unity’s goal of expanding applications and accessibility of tools
AI’s role in content creation across various industries
Unity’s focus on real-time and 3D technology in different sectors
Partnerships with various platforms and potential for creativity