Interview with Martin Stig Andersen Composer and Sound Designer, on Playdead's LIMBO

게임 오디오 / 사운드 디자인

After setting the game world abuzz at GDC and winning multiple awards at the Independent Games Festival, Denmark based independent platform developer Playdead released their highly anticipated LIMBO game in the summer of 2010, on XBLA.

With a small team of 14 (at peak) and three years of development, Playdead were able to create a one-of-a-kind puzzle game about a nameless boy searching for his lost sister in LIMBO, a highly artistic, yet strikingly eerie black and white world. We sat down with Martin Stig Andersen, the composer and sound designer on LIMBO, to find out more about this unique project, how the audio came to life, and what it was like using Audiokinetic’s Wwise. 



Background

What is your work background?

My background is actually quite diverse. I started my professional career a decade ago doing contemporary instrumental composition. I then moved on to electroacoustic composition working within various disciplines including acousmatic music, interactive music, sound installation, and electroacoustic performance. More recently, I’ve been exploring how electroacoustic music can contribute to audiovisual work, playing the role of sound design and music at the same time.

How did you get started in the game industry?

It was actually LIMBO that made me venture into game audio. When I first came across the original concept trailer, I immediately spotted several qualities in the visuals that I could relate to my own compositional work. There was so much ambiguity in the blurred, black & white artistic style that I began to see the visuals as a canvas for each players own associations and interpretations. Fortunately, the game director spotted corresponding qualities in my musical work, and I eventually got the chance to pitch my ideas for the project.

Screen_Shot_2016-07-16_at_1.43.33_PM.png

What are your primary responsibilities?

On LIMBO, my job was to articulate the overall sound world through sound recording, processing, and implementation. By dividing up the tasks, as recommended in the Wwise SDK, we were able to establish a workflow that enabled us to get the most out of Wwise. I worked closely with LIMBO’s game director, Arnt Jensen, to define the particular needs for the audio, and thanks to the willingness and support of the development team, the final result ended up being equally complex and compelling. What does sophisticated audio bring to game production? By making game audio sophisticated, we’ve promoted sound from being a mere mechanical, passive passenger to an active contributor to the overall game experience. While many game developers remain focused on enhancing realism in games, I believe the future of game audio lies in the articulation and support of other, more abstract aspects of video games, such as drama, narratives and subjective points of views.

Rather than being passively hooked up to game objects in the game world, audio needs to be dynamic. This means that sounds associated with different objects are balanced not only based on the positioning of the objects within the game geometry, but also on more abstract, dramaturgical information derived from the game.

Screen_Shot_2016-07-16_at_1.43.16_PM.png

LIMBO

Can you describe LIMBO to us?

LIMBO is an artistic 2D black & white platform puzzle game about a nameless boy searching for his lost sister in LIMBO. LIMBO is the result of a unique approach to game development in which creative decisions are made on the basis of experimentation and perceptual experience with the game environment rather than abstractly through script writing. The overall atmosphere is dark, evocative and sinister, with an unsettling uncertainty that comes directly from the ambiguous audiovisuals and lack of explicit story line. What were your ideas for the audio on LIMBO? Since LIMBO doesn’t look like a regular video game, we didn’t want the audio to sound game-like either. The visuals appear very retro, not in a video game sense, but more in terms of film. So when it came time to start working on the audio, it became obvious to us to look for inspiration in the soundtracks of old films. We adopted several qualities, including the frequent use of nearsilence, and the lack of audiovisual correspondence, all bound up within a lively, homogeneous yet immensely dull and muffled sound texture. As with LIMBO’s visuals, the lack of sound clarity and ambiguity in the relationship between the audio and visual elements leaves the door completely open for the players own associations and interpretations.

To give the audio a more contemporary and spacious feel (after all we’re not living in the 30’s), the dull, monophonic sounds were juxtaposed with temporally smeared, stereophonic versions of the very same sounds, giving way to a rather delusive sound space. We really wanted to degrade the sounds so that they matched the reductive quality of the silhouette world. This was achieved by running the sounds through antique wire recorders and other obsolete equipment. The spacious shadowing, on the other hand, was created by applying fast Fourier transform and convolution processing to the original distorted sounds. This created a completely new range of, smeared, stretched, and swelled sounds that organically weave throughout the soundscape. On a larger scale, we wanted the sound to help focus the attention of the player by letting only selected objects make sound at any given instant. This technique is somewhat representative of how old films were mixed. Back in the day, only a limited amount of audio tracks were available to the sound designer, so they were forced to decide at every instance what objects would trigger a sound.

How did using Wwise help you to achieve your creative vision?

The versatility of Wwise allowed me to take a rather generative approach to sound structuring. For example, rather than simply looping background noise and other recorded ambiances, I was able to decompose each into small fragments of various kinds, and then regenerate them in Wwise. In other words, by creating a structure of blend, random, and sequence containers in which trigger-rates, volume, filters, and pitch were randomized, the original ambience sound re-emerged in an ever-varying, adaptive guise. Because our game was so unique, I didn’t want to just compose linear music in a sequencer and then attempt to squeeze it into the otherwise non-linear environment of the game. With Wwise, I was able to create complex structures of event actions, switches, and RTPC assignments that dynamically weaved together musical fragments based on incoming events from the game. The ability to apply states to various properties in Wwise made it possible to create the dynamic mix that reacted to all kinds of information from the game.

Screen_Shot_2016-07-16_at_1.43.45_PM-1.png

What were the main challenges on this title and how did using Wwise help you to overcome these?

In order to establish a rather silent environment, we decided that the sound of the protagonist would be relatively loud. As a result of this decision, it became crucial that we have a wide variety of footstep sounds, as the player would hear them throughout the game. Besides creating sound bundles for more than a dozen different ground materials, we separated each footstep sample into a “heel” and “toes” component. This allowed us to create more variation, as instances from each respective category could be combined randomly. In Wwise, we were able to easily manage the gradual change from walk to run using a trigger rate transition between “heel” and “toes” that would decrease as the velocity of the protagonist increases. RTPCs came in very handy when dealing with the change in intensity of the protagonist’s footsteps. The audio developer of the team provided me with several RTPCs related directly to the protagonist and I simply had to map them to the properties of the footstep sounds. For example, there’s an RTPC representing the “exhaust level” of the protagonist that allows us to gradually attenuate the footstep sounds after the boy has been running for a specific amount of time. When the boy’s “exhaust level” returns to normal, the footstep sounds automatically return to their original settings.

Besides these global assignments, I also took full advantage of Wwise’s “State” functionality to change the volume of the footsteps in accordance with specific environments or even psychological states. Finally, I used the attenuation editor to change the volume, reverb, and LPF dynamically based on the boy’s distance from the camera. Considering that the sound of footsteps corresponds to more than 10 properties, each of which can attenuate the sound by 1.5 dB or more, you end up with a possible variation of more than 15 dB. The result is a continuous variation of the footstep sounds, generally providing a relatively loud point of reference in regards to the overall level balancing yet without becoming annoying to the player.

Which audio aspect are you the most proud of?

I am really proud of how we were able to create a completely unified sound environment, where elements take on the role of both music and sound design at the same time. There is no separate music track per se in LIMBO, which means players won’t be able to alter the mix between “sound effects” and “background music”. It will be more like a movie experience, where you aren’t able to alter the mix of a film. Game players may not be used to this approach, but it works extremely well in LIMBO and is exactly what we were aiming for.

 

Screen_Shot_2016-07-16_at_1.42.59_PM.png

Using Wwise

How did you find working with Wwise?

Aside from the impressive amount of features, Wwise is incredibly stable. The software is very responsive, and I experienced considerably few anomalies over the course of the entire development period. In game development, issues can arise from any number of sources and it is easy to get overwhelmed. It is essential that the software you are using be stable and Wwise certainly delivers on that front.

Can you describe your learning process for Wwise?

I already have experience with other non-linear environments such as Max/MSP, so it was relatively easy getting up and running with Wwise. In order to get an overall picture of the possibilities, I started off by reading through the manual, watching the tutorials, and studying the Wwise sample project. This upfront investment really helped me to avoid making unnecessary workarounds caused by a lack of knowledge of the features available. While it might seem daunting to get started with Wwise, it is actually very straight forward, and before you know it, you are building very sophisticated projects.

What are your favorite features?

I have a few, but Wwise’s ability to connect to the game, allowing me to tweak the audio while the game is being played, is so powerful. I also really like being able to apply states to a variety of functions.

What are the main benefits to using Wwise?

Wwise provides a bridge between the coding and sound design worlds, establishing a common ground for those working within their respective fields. This common ground ultimately enhances the outcome of their individual efforts. Many of the concepts in Wwise should already be familiar to most sound designers. Wwise does introduce a few new concepts though, but these new concepts only help the sound designer to better understand the nature of games, and get the most out of their game audio design. The abundance of features in Wwise makes for a complete and versatile game audio solution that allows us to realize our audio-visions.

Can you talk about your experience with the Support from Audiokinetic?

Audiokinetic’s support team is very responsive. In game development, you need a quick turnaround on issues in order to keep moving forward with your work. Audiokinetic’s support did not disappoint me, as they would regularly respond to my issues within the same day.

  

Martin Stig Andersen

Composer & Sound Designer

Martin Stig Andersen

Composer & Sound Designer

Composer, sound designer and audio director for video games and film.

 @martinstigand

댓글

댓글 달기

이메일 주소는 공개되지 않습니다.

다른 글

머더러스 퍼수츠(Murderous Pursuits)의 대사와 대화 설계 - 제 2부

안녕하세요, 머더러스 퍼수츠의 대화와 대사 시스템의 제 2부로 다시 돌아온 제이미입니다. 제 1부를 아직 보지 않으셨다면 여기를 클릭하여 읽어주세요! 제 1부에서는 게임에서의...

20.5.2020 - 작성자: 제이미 크로스(JAIME CROSS)

꿈의 직업: 게임 오디오에서의 윤리적 고용

저는 약간의 두려움과 함께 이것을 쓰고 있습니다. 저는 그렇게 오랫동안 고용주가 아니었고, 한 신뢰할 수 있는 개발자가 저에게 말했습니다. "저는 여러분이 적어도 한 번은 크게...

16.6.2020 - 작성자: 고든 맥글래더리 (GORDON MCGLADDERY)

상호작용 사운드를 통한 기능적 오디오 인터페이스: 자동차 안전, 안내 및 엔터테인먼트 응용을 위한 청각적 디스플레이 사용하기

본 백서에서는, 자동차 HMI(Human-Machine Interface)를 향상시키고 전반적인 사용자 환경을 개선하기 위해 소리가 혁신적인 방법으로 사용되는 고급 사용 사례를...

15.7.2020 - 작성자: 프랑수아 티보 (François Thibault)

누구나 사용할 수 있는 WAAPI - 제 1부: 개요

안녕하세요. 저는 왕양 (汪洋) 이라고 합니다 (혹은 ‘씨 예’, 溪夜라고도 불립니다). 저는 작년 하반기에 WAAPI에 대해 알게 되었습니다 (Wwise 저작 API). 저같이...

30.3.2021 - 작성자: 토마스 왕 (THOMAS WANG, 汪洋)

Wwise+GME 게임 음성 솔루션: 다양한 음성 플레이 대방출, 생생한 몰입감 선사

AppAnnie2021 모바일 게임 리포트는 강력한 소셜 인터랙션 속성을 가진 배틀 그라운드, 슈팅 및 온라인 MOBA가 플레이어들의 사랑을 많이 받았으며 게임 시간 증가를...

13.1.2022 - 작성자: Tencent Cloud

상호작용 음악: '여러분이 직접 선택하는 모험' 스타일의 발라드

2018년 크라우드 펀딩 캠페인을 성공적으로 마친 inXile Entertainment(인엑사일 엔터테인먼트)는 '웨이스트 랜드 3(Wasteland 3)' 게임의 본격적인 제작에...

23.5.2023 - 작성자: Alexander Brandon (알렉산더 브랜드)

다른 글

머더러스 퍼수츠(Murderous Pursuits)의 대사와 대화 설계 - 제 2부

안녕하세요, 머더러스 퍼수츠의 대화와 대사 시스템의 제 2부로 다시 돌아온 제이미입니다. 제 1부를 아직 보지 않으셨다면 여기를 클릭하여 읽어주세요! 제 1부에서는 게임에서의...

꿈의 직업: 게임 오디오에서의 윤리적 고용

저는 약간의 두려움과 함께 이것을 쓰고 있습니다. 저는 그렇게 오랫동안 고용주가 아니었고, 한 신뢰할 수 있는 개발자가 저에게 말했습니다. "저는 여러분이 적어도 한 번은 크게...

상호작용 사운드를 통한 기능적 오디오 인터페이스: 자동차 안전, 안내 및 엔터테인먼트 응용을 위한 청각적 디스플레이 사용하기

본 백서에서는, 자동차 HMI(Human-Machine Interface)를 향상시키고 전반적인 사용자 환경을 개선하기 위해 소리가 혁신적인 방법으로 사용되는 고급 사용 사례를...