Building a Career in Sound Today: Film, Games and Shades of Gray

상호작용 오디오 / 사운드 디자인

On one side there’s sound for films- linear, on the other there’s sound for video games- interactive. In the middle, there is this gray area where immersive XR soundscapes can be created using both linear and interactive sound design approaches. Coming from the linear world, learning interactive audio has been a journey (and still is) but the ability to combine both to explore new ways of storytelling is extremely rewarding and makes me more passionate about my work every day. My name is David Grinbaum and I’m the Head of Post Production at Chapter Four, a NYC-based full service production company specializing in immersive and interactive content. I began my journey in the linear world before venturing into interactive audio.

ch43

From traditional film and television to 360 video production

A few years ago, I had the opportunity to learn game audio but I was resisting the idea at first. My goal was always to work on big blockbuster movies, so there was only one thing I wanted to do: post production sound for film and television. In 2015, José Frías, one of my friends and now business partners, told me that he had been working on a few 360 video productions with ambisonics and thought it would be interesting if we could work with those recordings in post production. After a bit of research, I found Two Big Ears (now Facebook360), and started exploring spatial audio. After talking to two other friends, Sarah Gibble-Laska and Karim Douaidy, we all decided to form Chapter Four and focus our work on spatial audio. We could tell that sound was the secret ingredient to providing viewers with truly immersive experiences: we had found our holy grail! The transition from standard film and television to 360 videos was fairly straight forward. It was still linear, and spatializing audio felt similar to working in surround, just more rewarding!  On our first year, we got to work on some really cool pieces, including The Circle of Life in 360, the opening number from The Lion King on Broadway, and The White Helmets 360, a documentary by Vice and Samsung taking place in Syria.

 ch41-1

Discovering the world of game audio

Soon after, I was fortunate enough to meet the Dolby Atmos VR team and became a beta tester of their Dolby Atmos for VR suite. Thanks to them, I went to my first GDC in 2017 and discovered the world of video games and game audio. It was overwhelming! I met a few people from Audiokinetic as well as folks from Vibe Avenue who were kind and patient enough to walk me through the basic steps of what game audio was, and coming from the linear world, I found it fascinating. Instead of attaching an event to a timeline, I can attach sound and physical properties to an object to dictate how it is going to behave in a virtual world. Mind blown.

Back in NY, I started learning Wwise by going through the Wwise 101 certification. At GDC18, I went back to the Audiokinetic booth and saw that VR was more and more present. Late to the game (pun intended), I finally realized learning game audio was the next step in my career and that I had a lot to catch up on. Luckily, the game audio community is very welcoming, so I knew I would be able to find help if needed. I went back to NY and finished the Wwise 101 certification, and after a few months, I jumped into the Wwise 201 certification, and then finally the Wwise 301 certification.

I love sound. I’m passionate about creating soundscapes and bringing things  to life. I’m constantly amazed by what technology allows us to do and by what people keep creating. Wwise and interactive audio opened a whole new world of possibilities for me. A world of creating sounds for new mediums and experiences, a world of thinking differently about my role as a sound designer, but it certainly required a mind shift and commitment. I think one of my favorite things about interactive audio is how scientific it can be as much as it is creative. This may also be why many sound designers coming from the linear world hesitate to jump into game audio however. Interactive audio can certainly seem overwhelming, but it certainly inspired me with a lot of ideas for storytelling. To me, the discovery of interactive audio was the equivalent of a kid going to Disney World, but for a sound designer.

 ch44

Stepping out of your comfort zone with small victories

For those of you who come from the film industry, I want you to know that transitioning to game audio is not as scary as it looks! Coming from an IT background, I had a slight advantage because object-oriented languages and coding were concepts that I was already familiar with (although not passionate about). That being said, you don’t actually need to know a lot about coding when starting out, as the Wwise integration already comes with pre-made functions that allow you to integrate sound into the game engine of your choice. While the learning curve can be fairly steep because there is pretty much nothing from the DAW world you can use in the interactive world (besides preparing stems), the reward is hugely gratifying! 

For me, this is the beginning of a new adventure. Interactive audio made me even more passionate about sound. Like a kid with new toys! Everytime I finally figure out what’s missing for the object to be able to emit sound, or for the engine to use the RTPC value, or for the soundbank to be recognized (all of which, I’m sure, sounds very easy to some of you), I hear the Zelda music for opening a chest! 

For those of you who come from the linear world, and would like to learn game audio but don’t know where to start, here are a few checkpoints to help you get your feet wet. This is by no means comprehensive, as I'm still discovering new tools and techniques myself:

  • Jump into the Wwise 101 Certification. It will all sound weird at first but after your second run through their lessons, you’ll start understanding the logic behind it. By the end of it, you won’t know exactly how to implement your own sound objects in Unity or Unreal but you’ll have a better grasp of how engines and Wwise communicate.
  • If you don’t know anything about programming, there are tons of free tutorials (and also paid ones) that you can explore to learn the basics of coding. The most useful programming language to start with is C#. Brackeys’ YouTube channel is a fantastic resource for game engine and programming tutorials. I recommend getting a bit familiar with C# and at least one engine (if you’ll be learning with Brackeys, then it’ll be Unity) so that you are able to understand more than just interactive sound.  An audio programmer's role might involve helping game designers with minor bugs so that the back and forth between the audio and game dev teams are reduced. 
  • The Wwise 201 Certification for interactive music is not a mandatory course (at first) but it will eventually become important that you learn about the mechanics of game music. From implementing transitions to generating a random cue so that music is never repetitive, a lot of the tools you learn in this module can be used for other effects.
  • The Wwise 301 Certification is probably the most important after you're done with the Wwise 101 Certification. You can try to figure out on your own how to integrate Wwise into Unity and maybe trigger your first event, but if you want to do it right and learn all the different ways available, this course really does an excellent job at teaching you the good habits. You’ll learn how to use pre-made functions available to you through the Wwise integration, but also learn to write in C#, which will give you a lot more flexibility.

 

Some high level differences between linear and interactive projects that you'll first notice 

If you’re coming from the film industry, you’ve been used to certain specs and timelines. The specs are standardized depending on the distribution medium (number of channels or loudness requirements, etc.) and you usually start working once the picture is locked (note the “usually”). You are not limited by how many sounds can be used (besides creative direction) nor limited in how much DSP you can put on your tracks (provided your computer can handle it). All that matters is that your audio file matches the length of the video, has the correct number of channels and is synced. There is no limit on the size of the file. As a matter of fact, the file size can be calculated in advance since you already know the sample rate, word length and number of channels. 

Things are slightly different in video games and interactive media. You will be dealing with restrictions on how much CPU can be allocated to process sound or how much space is left for the audio assets - your ‘audio budget’. When working in Wwise, you can choose to have some of the DSP happening in real-time (using more CPU) or bake it into audio files (using more storage). Footsteps are a good example of how you could lower the amount of storage it requires: you can use as little as two different footstep files per surface and then randomize how much pitch is applied every time they’re played to get an infinite variety of footsteps, always sounding different to our ears. Another big difference I found is how we think about panning. There are three different panning modes in Wwise: 2D, 3D user-defined and 3D game-defined. Without going into detail, you can either associate a sound event to an object (3D game-defined), or automate sounds in 2D or 3D around the user for visual objects that aren’t actual game objects, or music and narrative that don’t necessarily need to be panned in 3D.

 ch45

Next steps in my journey

There is still so much to learn! Now that I realize how many possibilities there are in interactive sound and game engines in general, I want to explore as much as I can. One of the things I mentioned earlier is interactive storytelling. While this is a concept well known within the video game industry, we could use this form of storytelling without the gaming aspect, giving a choice to the user to explore a specific part of a story and creating their own experience. I’m very curious to see where this takes me in my career as I intend to keep working in the film industry as well as getting more projects in the interactive world (games and immersive media).

David Grinbaum

Co-Founder and Head of Post Production

Chapter Four

David Grinbaum

Co-Founder and Head of Post Production

Chapter Four

David is the co-founder and head of post production of Chapter Four, a NY-based, full service production company. He has been working in the film industry for nearly 10 years and was one of the early adopters of spatial audio in the VR industry. He has been involved in many immersive project, from documentary films all the way to Broadway shows. Some notable projects he worked on are The Lion King’s Circle of Life in 360 and Aladdin’s A Friend Like Me in 360.

https://chapterfour.com/

Instagram

 @chapterfourlive

댓글

댓글 달기

이메일 주소는 공개되지 않습니다.

다른 글

상호작용 오디오 비지니스

저희는 Wwise 상호작용 음악 심포지움에서 최고의 분들을 패널에 모셔서 상호작용 오디오에서 작업 그 자체만큼이나 아주 중요한 분야인 비즈니스의 측면에 대해 대화를 나누었습니다....

26.1.2021 - 작성자: Audiokinetic (오디오키네틱)

파이널 판타지 VII 리메이크의 사운드

수많은 사람들의 사랑을 받는 파이널 판타지 VII의 음악은 새로운 세대의 팬들이 경험할 수 있도록 수 년에 걸쳐 새롭게 재고되어 왔습니다. 최근 Square Enix(스퀘어...

4.5.2021 - 작성자: SQUARE ENIX (스퀘어 에닉스)

Impacter와 Unreal - 게임 물리를 사용하여 Impacter 플러그인 제어하기

소개 Impacter(임팩터)는 Wwise를 위한 새로운 타격음 모델링 플러그인입니다. 플러그인 소개는 이 글을 통해 확인해주세요. 이 글에서는 Impacter를 사용하여...

3.6.2021 - 작성자: 션 소라한 (Sean Soraghan)

Wwise로 현실 세계의 상호작용 음악 만들기

저는 몇 년 전부터 상호작용 오디오를 좀 더 깊게 탐구해보기로 했습니다. 제가 하는 작업과 연관된 프로젝트로 만들되, 지루하지 않게 흥미로우면서도 배울 것이 있는 프로젝트를...

24.8.2021 - 작성자: 리사 슈바르츠발트 (Ressa Schwarzwald)

텔 미 와이(Tell Me Why) | 오디오 다이어리 제 1부: 환경음과 보이스오버

'텔 미 와이(Tell Me Why)'는 DONTNOD(돈노드)가 개발하고 Xbox Games Studios(엑스박스 게임 스튜디오)가 출판한 싱글 플레이어 서사적 어드벤처...

4.5.2022 - 작성자: 루이 마르탱 (Louis Martin)

임펄스 응답 리버브로 현실감 있는 사운드 만들기

임펄스 응답은 실제 공간을 초현실적으로 재구현하는 것으로 유명합니다. 최고 품질의 임펄스 응답을 녹음하는 것은 다소 기술적이며 고급 장비가 필요한 일입니다. 공간적인 품질을 갖춘...

8.9.2023 - 작성자: BOOM Library

다른 글

상호작용 오디오 비지니스

저희는 Wwise 상호작용 음악 심포지움에서 최고의 분들을 패널에 모셔서 상호작용 오디오에서 작업 그 자체만큼이나 아주 중요한 분야인 비즈니스의 측면에 대해 대화를 나누었습니다....

파이널 판타지 VII 리메이크의 사운드

수많은 사람들의 사랑을 받는 파이널 판타지 VII의 음악은 새로운 세대의 팬들이 경험할 수 있도록 수 년에 걸쳐 새롭게 재고되어 왔습니다. 최근 Square Enix(스퀘어...

Impacter와 Unreal - 게임 물리를 사용하여 Impacter 플러그인 제어하기

소개 Impacter(임팩터)는 Wwise를 위한 새로운 타격음 모델링 플러그인입니다. 플러그인 소개는 이 글을 통해 확인해주세요. 이 글에서는 Impacter를 사용하여...