Open World Ambient Design Using Image Based Parameters

游戏音频 / 声音设计 / Wwise 技巧和工具

The Blend Container can be a powerful sequencing and mixing tool. Simply learning its functions can bring all sorts of new ideas into the mind of a game sound designer. This is especially true when combined with the power of the RTPC, and a good amount of brainstorming with your game designer and programmer.

I am going to share a recent Blend Container idea with you. It can be a great method for “painting” ambient audio zones around a landscape. This developed in two different stages, both of which I will outline.

All of the pictures, audio assets, and approaches I am going to share with you are part of a prototype scenario. Here is an aerial picture of part of a map we are going to use to demonstrate.

A 3D Perspective with a small viewable area - Wwise

A 3D Perspective with a small viewable area

 

Development Stage 1 of 2

The gameplay of this map takes place mostly while you swim underwater or cruise along at the waterline as a Shark. You are able to access deep parts of the ocean where the waves are several feet high, or you can travel away from the ocean where the inland water is very calm. I started implementing ambient audio with a series of actors to trigger the wave assets, but this was not a good solution as it left the ambient water sounding both static and disconnected from the visuals. Swimming is a fundamental part of this title and it must look, feel, and sound immersive. The waves in this map are dynamic, so the audio events should be as well. Somewhere there was a new RTPC value, and we were going to find it.

It occurred to me that if there were a game value commanding the waves when and how to grow in height, then maybe I could use that value as an RTPC to control the dynamic mix of the wave assets.

I asked our game producer about the ocean wave modulation and he explained how it worked. Then I asked him to explain it in a way that a sound designer might understand, and it began to make sense. Basically, the ocean wave modulation is created by mapping a world space coordinate to a UV coordinate in the HeightMap and then the color information is read from a pixel. The code that influenced the RTPC value we ended up creating is part of an Unreal community project called Ocean Simulation, Weather and Dynamic TOD system.

 

The RTPC value was named WaveHeight. When the value is 0 there is no wave modulation, and at 1 we have our most dynamic wave modulation. I created a Blend Container with three tracks.

Blend Container and RTPC Value - Stage 1 of 2 - Wwise

Blend Container and RTPC Value - Stage 1 of 2

 

The pictured Blend Tracks from top to bottom are Big Waves, Medium Waves, and Light Waves. You can see the Wave Height RTPC controlling Volume in red envelopes across each track.

This scenario worked far better than static ambient actors, but there were two main issues with this setup. The RTPC value would occasionally produce inconsistent value jumps which did not create a reliable or smooth transition. Also, when you were close to the beach the wave height was already at 0. That meant that we would hear the same background water behavior near the beach shore as we would all the way inland in the rivers and canals. As is often the case with implementing game audio with Wwise, there was a more elegant option.

 

Stage 2 of 2

Converting the values from the HeightMap to an RTPC was the starting point, but using a simple color channel to drive our RTPC was where we ended up. In Photoshop, we were able to “draw” and map out the ambient areas on top of the 2D World Texture.

A 2D World Texture - RTPC Value Stage 2 of 2 - Wwise

A 2D World Texture - RTPC Value Stage 2 of 2

 

The Ocean would be pure white with a Wave Height RTPC Value of 1. The inland water areas would be black with a Wave Height RTPC value of 0. The transition areas near the shore would blend with the intensity of gray from about 0.2 up to 0.8. This ended being very smooth and efficient for processing and voice count, and it offered a lot of control between the 3 zones.

 

2D World Texture map converted into colors with Photoshop - RTPC Value Stage 2 of 2 - Wwise

2D World Texture map converted into colors with Photoshop - RTPC Value Stage 2 of 2

 

This second Blend Container has a 4th Blend Track added at the bottom. This asset was made up of very gentle inland water lapping. The ocean ambience is the Blend Track just above that, which picks up around 0.2 on the Wave Height RTPC value.

 

“WaveHeight” Blend Container - Stage 2 of 2 - Wwise

“WaveHeight” Blend Container - Stage 2 of 2

 

This is a video capture of the Stage 2 Blend Container in game. Although it is very small, the Wave Height RTPC value is being printed to the top left-hand corner of the editor screen. in purple text.

 

Demonstration video 

 

This painting of ambient areas method could be used for a variety of audio events. We are currently only utilizing the red channel, but blue and green are just waiting to be painted into a new RTPC value!

 

  

 

 

Tom Todia

Game Audio Designer

Engine Audio

Tom Todia

Game Audio Designer

Engine Audio

Tom is the Co-owner and an audio developer at Engine Audio, a game audio contract group. Tom has been in audio production for 20 years, and currently teaches audio for video games at Full Sail University.

 @EngineAudioTom

评论

Alex Quick

September 22, 2016 at 12:16 pm

RTPC'in like a boss!

留下回复

您的电子邮件地址将不会被公布。

更多文章

Wwise 工程文件的版本控制

很多游戏开发商会利用版本控制系统来存储工程文件,藉此为多人团队协作提供便利。那么,在本文中我们就来解答如下问题:Wwise 工程文件夹内哪些文件应当存储在版本控制系统中? 巧用...

5.6.2018 - 作者:纪尧姆·雷诺 (GUILLAUME RENAUD)

我如何在 12 天内运用 Wwise 和 Unity 完成互动拟音设计

每次单击鼠标都会生成具有不同外形、姿态和构成的行走角色,这对拟音师来说既是求之不得的机会又是困难重重的挑战。 不管怎么说,接了活总得做。之前,本杰明·维德恩 (Benjamin Vedrenne)...

9.12.2019 - 作者:皮埃尔·玛丽·布莱恩德(Pierre-Marie Blind)

关于动态音乐设计的思考-Part 1-设计分类学

引子...

6.4.2020 - 作者:侯晨钟

连通 Wwise 和 REAPER – 第 2 部分:ReaOpen

ReaOpen 是一款免费的小程序,方便快速选择音频文件并打开其原始 REAPER 工程。它能在 Windows 和 Mac 上运行,并可集成到 Wwise、Explorer/Finder 和...

25.5.2020 - 作者:尼古拉·卢基奇 (Nikola Lukić)

Igniter Live 简介

在 Dehumaniser 的基础上,Krotos 打造了一体化解决方案,以帮助用户设计自定义车辆音效。 今年早些时候,我们发布了基于 Igniter Technology 的 VST/AU/AAX...

18.11.2020 - 作者:MATTHEW COLLINGS

人人都能用 WAAPI(三)Functions(执行类 API)剩余部分及 Topics(订阅类 API)

大家好,我是溪夜。 在《人人都能用 WAAPI(三)》中,我们会继续上一篇的内容,讨论 WAAPI 的 Functions(执行类)中剩下的其他的 API 及 Topics(订阅类)。...

15.1.2021 - 作者:汪洋

更多文章

Wwise 工程文件的版本控制

很多游戏开发商会利用版本控制系统来存储工程文件,藉此为多人团队协作提供便利。那么,在本文中我们就来解答如下问题:Wwise 工程文件夹内哪些文件应当存储在版本控制系统中? 巧用...

我如何在 12 天内运用 Wwise 和 Unity 完成互动拟音设计

每次单击鼠标都会生成具有不同外形、姿态和构成的行走角色,这对拟音师来说既是求之不得的机会又是困难重重的挑战。 不管怎么说,接了活总得做。之前,本杰明·维德恩 (Benjamin Vedrenne)...

关于动态音乐设计的思考-Part 1-设计分类学

引子...