The AIAS Game Maker's Notebook

Merging Audio and Gameplay in Cocoon with Jakob Schmid

Dec 11, 2023

Jakob Schmid, Co-Founder, Audio Director, and Music Director of Geometric Interactive, discusses the intricate integration of audio and gameplay in their debut title Cocoon. He shares how generative systems create the game's music, his collaboration with Jeppe Carlsen on Inside, and the use of music cues and custom components to provide feedback to players in puzzle solving. They also explore the commitment to synthesis in audio creation and the intersection of game design and puzzle design for a unique and well-executed experience.

01:11:55

Creator website

Episode guests

Jakob Schmid

AI Summary

Highlights

AI Chapters

Episode notes

Podcast summary created with Snipd AI

Quick takeaways

Cocoon utilizes generative music that reacts to player actions, creating a dynamic audio experience.

The game balances pre-baked and generative music, with the majority of the music being generative and seamlessly integrated.

Audio cues and sound design enhance the gameplay experience by guiding players and adding depth to the audio landscape.

Deep dives

The Creative Vision Behind Cocoon

The podcast explores the creative vision behind Cocoon, a game developed by the studio Exola. The podcast features a conversation with Jacob Schmid, the All Things Audio Composer Programmer for Cocoon. Schmid discusses his background in music and programming, as well as his involvement in the game's development.

Creating Non-Repetitive Game Audio with Frequency Spectrum Division

01:52

Evolution of Game Prototype and Graphics Style

01:18

Observation of Music Cues in Puzzle Game

01:25

Introduction

3min

Discussion about Cocoon and Inside, and bonding over coffee and temperatures

2min

The Journey of a Musician and Audio Programmer

9min

Dynamic Music Systems in 4X Strategy Games

12min

Starting a New Adventure

8min

Commitment to Synthesis

17min

Game Design and Puzzle Design Intersection

16min

Discussing Creativity, Design, and Reception

5min

Austin Wintory chats with Jakob Schmid, Co-Founder, Audio Director, and Music Director of Geometric Interactive. Together they discuss Geometric's debut title Cocoon including the way the audio works together with the gameplay to help players solve the games many puzzles; how his background in programming led to the generative systems that create the Cocoon's music; and his long relationship with Jeppe Carlsen who he worked with prior on the critically acclaimed Inside.

If you enjoyed this episode, please consider leaving us a rating and review: https://apple.co/3rF0EtC

The Game Maker's Notebook is sponsored by Xsolla. To learn more, go to xsolla.pro/AOIAAS.

Watch this episode on our Youtube channel: https://www.youtube.com/@OfficialAIAS

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.

The AIAS Game Maker's Notebook

Merging Audio and Gameplay in Cocoon with Jakob Schmid

Episode guests

Podcast summary created with Snipd AI

Quick takeaways

Deep dives

The Creative Vision Behind Cocoon

The Importance of Real-Time Synthesis

Balancing Pre-Baked and Generative Music

Designing Audio Feedback for Puzzle Solving

The Role of Sound Design in Cocoon

Creating Non-Repetitive Game Audio with Frequency Spectrum Division

Evolution of Game Prototype and Graphics Style

Observation of Music Cues in Puzzle Game

Remember Everything You Learn from Podcasts