Clocker: Designing Interactive Music (Part 2)

게임 오디오 / 상호작용 음악

Clocker is an indie adventure puzzle game, developed by Wild Kid Games. The storyline focuses on the relationship between a father and his daughter, with time as the connecting bond. The game features a unique time mechanism, compelling storylines and challenging puzzles to solve, and is delivered in an artistic hand-painting graphics style. It tells the story of a father and his daughter, using a two-character narrative technique, and allows you to control either of the two characters separately when solving puzzles during your adventure.

In part 1 of this blog, we focused on how we designed audio that complemented the game's complex logic.  Here, we will focus on the game's interactive music. We knew that we wanted to influence the players' experience and guide the player’s actions via the in-game music. We also wanted to and express creative ideas with the game music. Altogether, we created 14 pieces of music for the game. In the image below, you can see them as they appear in our Wwise project.

 

image031

We used the Father-Daughter Theme and the Chapter Theme to reflect emotional changes. As previously mentioned, the father’s world is all in black and white. The producer wanted to emphasize the father's depressed state. So, we created the Father Theme with sorrow as its keynote. In contrast, the Daughter Theme was created with lively musical elements. For special scenes and storyline considerations, we added more emotional elements for each chapter, based on the keynote, making players feel they are getting closer to the daughter while moving on to the next chapter. We hoped that the in-game music could create an atmosphere with the proper emotional elements at the right time.

In fact, we wanted players to stay in the daughter’s world longer, because there are more hidden storylines for her in the game. After several test runs, we discovered something: most players did in fact spend longer periods of time in the daughter’s world. They found the Father Theme too sad and  the Daughter Theme more relaxing. So, we essentially achieved what we wanted: which was to guide players with the in-game music - in this case, specifically guide them to spend more time in the Daughter Theme. 

Clocker

 

Designing the interactive music for Clocker

At the end of the game, there is a very touching storyline. Players have to control the father and walk through the time rift. During this period, he grows old very quickly. But he doesn’t care, all he wants is to find his daughter. As the father keeps moving forward, the background changes dramatically to reflect the rapid passage of time and his aging.

Players go through the game content in several action phases:

  1. The father goes into the time rift;
  2. He explores his surroundings carefully and accidentally falls down;
  3. He keeps moving forward and gets out through a rock tunnel;
  4. Everything changes dramatically, and the father grows old very quickly;
  5. He reaches the end and falls into the abyss of time and space.

These action phases are deployed progressively, so the music has to be designed in the same way. We created 5 progressive music segments based on these interaction phases:

  1. Intro (introducing mysterious emotions);
  2. Verse1 (building up the atmosphere with block chords and simple melodies);
  3. Verse2 (adding some low-frequency sounds and hi-hats to underscore the exploration);
  4. Verse3 (adding drums, guitar, pads and vocals to emphasize emotion);
  5. End (quieting down and ending the process).
image0335 progressive music segments

As a result, players experience emotional changes throughout the game. Whenever the game content changes, the atmosphere also changes to reflect the father's love and the passage of time. This was our main focus in the music design: emotional shifts.

As for the composition, there are many ways to express a character’s emotions, such as rhythms, melodies, harmony patterns and instruments. However, in Clocker, only melodies and instruments can be used in the game score. And so, we considered a second element in the music design: interaction.

Game music is quite different from other kinds of music. In a game, the visuals, the camera and the content are not fixed. They change in real time based on the player’s actions. The music has to interact with these actions accordingly.

Players can control the character to move forward/backward or stand still. If players just stop as they are moving forward or backward but the music doesn’t, the visuals and the audio won’t match. In this case, players could stop at action phase 2, but the music for action phase 4 might already be playing - that’s not good. And, there is no way to predict the player’s actions. But in order to guide them, we created interactive music.

As previously mentioned, there are many approaches to composition, but only few can be used in this game score. To get what we wanted, the following requirements had to be met:

  • Except for Intro and End, the remaining 3 music segments must be seamlessly looped. No matter how long players stop and stay, the proper segment must keep playing until they resume.
  • The transition between music segments must also be seamless to make sure the emotional changes feel natural.
  • Variations must be introduced, when looping a single music segment. When players stop and stay for a long time, they should not be annoyed or bored.
  • When players move on, the music segment should change naturally. Otherwise, the sense of immersion is affected. If it’s too slow, the atmosphere will be out of line with the game content.

Based on these requirements, we came up with the following solutions:

1. All music segments were looped seamlessly, using FL STUDIO as the DAW.

image035Looped segments from the chord part

2. All music segments were designed with the same tempo (BPM), underlying instruments as well as harmony patterns. And we used a 1-3-6-1 chord pattern to render emotions and ensure natural transitions, regardless of their order. This also laid a foundation for the playback logic design later.

image0371-3-6-1 root note pattern

3. We added some melody and content variations on top of each music segment, harmoniously augmenting the underlying instruments and being played randomly. When a music segment is looped and repeated, you always hear different content, but with the same emotions. In the image below, you can see more details.

image039

4. We split a whole music piece into multiple sections (horizontal) and layers (vertical). In the image below, except for Intro and End, the three remaining music segments were split into Verse1 - 3. Each Verse has 64 beats and 16 bars. However, a complete loop has 32 beats and 8 bars. So we split Verse1 - 3 into A and B, so that no new content needed to be added to any of the loops. In addition, we split Verse1 - 3 into melody tracks (Verse Random Parts). These tracks are used to add variations to looped segments and to avoid auditory fatigue. Finally, we created another two tracks (FX track and Fills track) to transition between segments and build emotion (Build_verse1 to 2).

image041

So far, we looked at creating and splitting music segments based on the above requirements. After a lot of trial and error, we established our final playback logic.

 image043An example of raw playback logic (draft)
 
image045The final playback logic (draft)

As you can see, in our final playback logic, we divided the map into 4 areas. In each area, a Verse is played. And there is a transition at the boundaries between the different parts (i.e. the triggering point). When players move to the next area, the current Verse automatically plays a 4-beat bar, then seamlessly transitions to Build_verse 1 to 2 (or Build_verse 2 to 3 for the transition from Verse2 to Verse3), and then transitions to the next Verse.

The tempo for the game score is 70 BPM, so it’s 3.44 seconds for every 4-beat bar. When the character reaches a triggering point, we only need 1 beat (0.86 s) ~ 3 beats (2.58 s) to make the transition between the two verses (without players even noticing).

The latency was acceptable to us, so we moved on to the next task: implementing and testing the sound engine.

Implementing the sound engine

We created transitions for all music segments in our Wwise project. In the image below, you can see how we did it.

image047Transitions

1. For the transition from Intro to VerseA, we used "Exit Cue" as the exit point. Intro is relatively short, as is the transition, so no loops were needed.

2. For the transition from VerseA to VerseB, we used "Next Bar" as the exit point. It transitions to VerseB when that bar completes. As previously mentioned, we used a 1-3-6-1 harmony pattern to switch the music. VerseB starts with a harmony at 1. So the transition is seamless.

3. For the transition from VerseB to VerseC, we used "Next Bar" and a transition segment. VerseC is richer than VerseB in regards to instrumentation. Without a transition segment between them, it would have been awkward. We therefore used a chord at 1 and added drums to that segment, to transition the music. With the added drums, it feels more natural when transitioning to other instruments, such as a guitar.

image049VerseB to VerseC

4. For the transition from VerseC to VerseD, "Next Bar" could not be used, because VerseC has two vocal lines, while VerseD is an ending segment with a strong finale. There is no way to predict when players will reach the triggering point of VerseD. Segments could be transitioned while playing the first Vocal, but this would sound unnatural. We therefore used "Next Cue" to transition to VerseD. In the image below, you can see two cue points with the same name. They are positioned right at the end of the fourth bar.

image051

Performance Optimization

Managing SoundBanks in the project

In the game, there are 22 scenes in total. Logic lines, ambient sounds and music pieces were split into different SoundBanks, which are loaded and unloaded for the corresponding scenes. This reduces memory and improves the performance. In the image below, you can see the SoundBanks and the scenes from the project.

image053SoundBanks

Compressing the audio for different platforms

This game is available on multiple platforms including Windows, Android, Mac and Xbox One. The in-game audio totals more than 1 GB. This is too big for a mobile platform. We used the Conversion Settings feature in Wwise to set the different formats for these platforms. For Android, the compressed package is only 58 MB.

 image055

Conclusion

Wwise is a very powerful sound engine. It saved us a lot of time and provided us with many more possibilities in the sound design than the stock Unity sound engine. Thanks to the Wwise community and readers. I look forward to learning from you and sharing with you from time to time.

YU TAN

Senior Audio Designer

Salt Sound Studio

YU TAN

Senior Audio Designer

Salt Sound Studio

Yu Tan loves game audio design. He is devoted to the research and promotion of audio technologies.

댓글

댓글 달기

이메일 주소는 공개되지 않습니다.

다른 글

Wwise Unity 커닝 페이퍼

Wwise Unity 통합에 대해 말해봅시다. 언제든지 참조할 수 있는 수년간 제작된 교육 자료가 꽤나 많습니다. Audiokinetic 교육 자료로 말하자면 Youtube에도...

2.2.2021 - 작성자: 매스 마라티 소노로 (MADS MARETTY SØNDERUP)

3D 상호작용 음악 경험에 Wwise를 사용해야 하는 이유

‘Dirty Laundry by Blake Ruby (더러운 빨래 - 블레이크 루비)’ 모바일 VR 앱: 오디오 소개....

2.9.2021 - 작성자: 줄리안 메시나 (Julian Messina)

게임 사운드 보관 | 제 1부: 기본 지식

게임 업계에서 사운드 보관은 상당히 민감한 부분입니다. 데모씬과 레트로 게임에 각별한 애정이 있든, 혹은 최신 도구와 엔진으로 작업하는 사운드 전문가이든 (아니면 옛날 사운드에 푹...

9.9.2021 - 작성자: 파니 러비야르 (Fanny REBILLARD)

‘잇 테이크 투(It Takes Two)’ 사운드 비하인드 스토리 | Hazelight 오디오 팀과의 Q&A

Hazelight Studios(헤이즈라이트 스튜디오)에서 제작한 잇 테이크 투(It Takes Two)는 분할 스크린 액션 어드벤처 플랫폼 협동 게임입니다. 이 게임은 엄청나게...

5.4.2022 - 작성자: Hazelight (헤이즐라이트)

텔 미 와이(Tell Me Why) | 오디오 다이어리 제 3부: 사운드 디자인

텔 미 와이(Tell Me Why)의 오디오 팀에게는 독특하면서도 인상 깊은 서사적 시퀀스를 향상시킬 수 있는 기회가 많았습니다. 저희 시네마틱 및 크리에이티브 디렉터는 영상에 꼭...

19.7.2022 - 작성자: 매튜 피오렌티니 (Mathieu Fiorentini)

상호작용 음악: '여러분이 직접 선택하는 모험' 스타일의 발라드

2018년 크라우드 펀딩 캠페인을 성공적으로 마친 inXile Entertainment(인엑사일 엔터테인먼트)는 '웨이스트 랜드 3(Wasteland 3)' 게임의 본격적인 제작에...

23.5.2023 - 작성자: Alexander Brandon (알렉산더 브랜드)

다른 글

Wwise Unity 커닝 페이퍼

Wwise Unity 통합에 대해 말해봅시다. 언제든지 참조할 수 있는 수년간 제작된 교육 자료가 꽤나 많습니다. Audiokinetic 교육 자료로 말하자면 Youtube에도...

3D 상호작용 음악 경험에 Wwise를 사용해야 하는 이유

‘Dirty Laundry by Blake Ruby (더러운 빨래 - 블레이크 루비)’ 모바일 VR 앱: 오디오 소개....

게임 사운드 보관 | 제 1부: 기본 지식

게임 업계에서 사운드 보관은 상당히 민감한 부분입니다. 데모씬과 레트로 게임에 각별한 애정이 있든, 혹은 최신 도구와 엔진으로 작업하는 사운드 전문가이든 (아니면 옛날 사운드에 푹...