Audiokinetic, provider of spatial audio and sonification solutions, has become a member of Basemark’s Rocksolid Ecosystem. The partnership positions both companies at the forefront of developing audiovisual immersion solutions. In this article, we go deeper into the concept of audiovisual immersion, shedding light on its purpose and future applications.
What Is Audiovisual Immersion?
According to statistics from National Highway Traffic Safety Administration (NHTSA), around 8% of all the fatal car crashes in 2018 across the United States were distraction-affected crashes. Whether it is someone scrolling on the phone, fumbling on the infotainment screen trying to find the navigation settings, or intense conversations with the kids in the backseat, we all know how easy it is to lose your concentration while driving. To address this issue, car manufacturers are trying to find solutions that help drivers keep their focus and minimize distractions. Thus, the goal is not just to detect potential hazards on the road but also communicate warnings in the fastest and most intuitive way to the drivers.
Audiovisual immersion is seen as an ideal solution, as it combines advanced spatial audio with elegant spatial compute such as Augmented Reality (AR) on windshields and AR heads-up displays (AR HUD). This helps to direct the driver’s focus to the most critical information, making driving safer and more intuitive.
Before we go deeper into the concept of audiovisual immersion, let’s first clear out what automotive AR and sonification are.
Augmented Reality For Automotive
Automotive AR applications are becoming a more common feature found in cars today. With automotive AR, you transform real-time vehicle data into visual representations that are overlaid on a vehicle screen, such as the windshield, instrument cluster or infotainment screen. With AR it is possible to increase the situational awareness by augmenting the surroundings around the vehicle through AR visualizations. Basemark is a forerunning provider of software solutions for automotive AR application development.
Example of AR visualizations on wide Field of View AR HUD.
Automotive Sonification
Sonification refers to the process of transforming data into an acoustic signal to provide information. In the automotive context, it means that you use data from the embedded systems, like ADAS, and generate a sound based on the data. Sonification is a common technology found in vehicles today, for example, in a situation where you mistakenly embark from a lane while driving, the ADAS is activated, and you can hear alarming sound cues. This grabs the driver’s attention to indicate that the vehicle crossed the lane unintentionally. Audiokinetic is a pioneering provider in automotive audio solutions that help with the design and interactive audio rendering of such sound alarms including spatial audio information.
Although the concept of audiovisual immersion is somewhat new to the automotive sector, the technology already exists and is independently employed in vehicles today. By combining these technologies together, you have a rigid support system triggering multiple human senses that help drivers keep their concentration.
Sound spatialization adds hazard localization information for the driver.
Why Audiovisual Immersion?
Sonification serves as an excellent complement to AR visualizations. The sound cues generated by the sonification catches the attention of the driver and directs the eyes to the windshield. The strength of using audio, is that the human auditory system is always on and doesn’t require a certain precondition, such as, light, which is needed for the visual sense. Consequently, as the driver hears the sound cue and directs his gaze to the windshield, the overlaid AR visualizations on the HUD immediately informs the driver of the situation, allowing them to make an informed maneuver.
Some of the main benefits of audiovisual immersion are heavily related to safety and enhancement of driving experiences:
- Improving driver safety: Through audiovisual immersion the driver will be in a constant feedback loop, receiving information from the vehicle in the form of intuitive audio cues and visual AR overlays. This helps focus the drivers attention to the most important information, and helps them react faster in different driving situations.
- Ease complex driving situations: Audiovisual immersion can significantly help drivers in complex driving scenarios. For instance, while navigating city streets, it can provide clear guidance for lane changes and upcoming turns. Over time, such technology has the potential to serve as an educational tool, aiding drivers in mastering complex driving situations and encouraging safer driving habits, ultimately reducing the likelihood of encountering risky driving situations.
- Build trust between drivers and autonomous vehicles: As vehicles reach higher levels of autonomy, it’s essential to inform drivers about the vehicle’s decisions and actions, fostering trust. A clear alert system for when driver-assist systems take control is crucial to reduce confusion. Using audiovisual immersion, including AR content and spatial audio, helps maintain driver awareness, enhancing trust in the vehicle.
- Personalized and branded driving experiences: Finally, audiovisual immersion allows you to create distinctive, branded experiences that align seamlessly with a brand’s unique attributes. For instance, envision a scenario where your brand claims a distinctive sound profile and interior ambiance. With audiovisual immersion, you can effortlessly extend these brand-specific elements into the driving experience, creating a cohesive and memorable brand experience.
Comments