5/30/23

Immersive XR Audio

The Filtsy "Water" AR effect is an awe-inspiring LIDAR-driven extended reality (XR) spatial experience that lets you add flood waters to your room. While a lapping water audio loop sets the mood throughout the iOS app experience, it remains unchanged as you submerge and move through your space. But what if we could take this immersive experience even further?

As a passionate advocate of immersive audio capabilities and design, I imagined an underwater voice effect and interactive sound design linked to my motion and interactivity. This video demonstration showcases the power of dynamic sound for voice and spatial experiences, which motivates creators and consumers of XR to spend more time in the product, share more often, and inspire others to join in on the fun! 🌟 πŸ“ˆ

Design Considerations:

πŸ”Ή Voice Effects & Immersive Sounds: With scene understanding and a known point established in XR, waterline in this case, we can use that horizon as a trigger to initiate a voice effect and enable above and underwater sound design. Imagine hearing bubbles that appear when you’re talking, or the sound of distant whales as you explore longer! πŸ—£πŸ‹

πŸ”Ή AR Audio Playback & Capture: Sound is crucial in setting the mood and inspiring people to dive further into the XR world. It's important to understand audience needs and provide controls that allow them to capture XR audio in high quality, mute XR audio altogether, or customize their voice and interactive sounds to match their creative style. This results in engaging, personalized, and shareable experiences for both professionals and casual users of XR.🌟

Previous

Augmented World Expo 2023 Recap!

Next

"Soundtracks" for Generative AI Video