Merging Audio and Gameplay in Cocoon with Jakob Schmid
Dec 11, 2023
auto_awesome
Jakob Schmid, Co-Founder, Audio Director, and Music Director of Geometric Interactive, discusses the intricate integration of audio and gameplay in their debut title Cocoon. He shares how generative systems create the game's music, his collaboration with Jeppe Carlsen on Inside, and the use of music cues and custom components to provide feedback to players in puzzle solving. They also explore the commitment to synthesis in audio creation and the intersection of game design and puzzle design for a unique and well-executed experience.
Cocoon utilizes generative music that reacts to player actions, creating a dynamic audio experience.
The game balances pre-baked and generative music, with the majority of the music being generative and seamlessly integrated.
Audio cues and sound design enhance the gameplay experience by guiding players and adding depth to the audio landscape.
Deep dives
The Creative Vision Behind Cocoon
The podcast explores the creative vision behind Cocoon, a game developed by the studio Exola. The podcast features a conversation with Jacob Schmid, the All Things Audio Composer Programmer for Cocoon. Schmid discusses his background in music and programming, as well as his involvement in the game's development.
The Importance of Real-Time Synthesis
The podcast highlights the importance of real-time synthesis in Cocoon's music. The game's composer, who also serves as the audio programmer, explains his decision to use synthesizers and plugins to create a unique and immersive musical experience. He discusses how the generative music system in the game reacts to player actions, providing a rewarding and dynamic audio experience.
Balancing Pre-Baked and Generative Music
The podcast explores the balance between pre-baked and generative music in Cocoon. The composer explains that while some moments in the game trigger pre-made music cues, the majority of the music is generative and reacts to the player's actions and progression. He discusses how the generative music is implemented using plugins and custom components, providing a seamless and immersive audio experience.
Designing Audio Feedback for Puzzle Solving
The podcast delves into the design philosophy behind the audio feedback in Cocoon. The game's designer emphasizes the importance of guiding players and providing them with feedback to reinforce their understanding of the game's mechanics and puzzles. He discusses the implementation of custom audio cues, such as jingles and motifs, to indicate to players that they are on the right track in solving puzzles.
The Role of Sound Design in Cocoon
The podcast discusses the role of sound design in enhancing the gameplay experience in Cocoon. The studio enlisted sound designers to create synthetic sound effects and immersive audio elements that blend seamlessly with the generative music. The composer expresses pride in the sound design team's work, which adds depth and texture to the game's audio landscape.
Austin Wintory chats with Jakob Schmid, Co-Founder, Audio Director, and Music Director of Geometric Interactive. Together they discuss Geometric's debut title Cocoon including the way the audio works together with the gameplay to help players solve the games many puzzles; how his background in programming led to the generative systems that create the Cocoon's music; and his long relationship with Jeppe Carlsen who he worked with prior on the critically acclaimed Inside.
If you enjoyed this episode, please consider leaving us a rating and review: https://apple.co/3rF0EtC
The Game Maker's Notebook is sponsored by Xsolla. To learn more, go to xsolla.pro/AOIAAS.