Sound in AR

Sound is one of the most important elements in any extended reality experience. In this section, we’ll cover the important concepts related to sound.

Without sound, a virtual environment would be entirely unrealistic, even worse than watching a movie on a 2D screen. Sounds, if done right, add manifolds to the sense of immersion in the augmented reality experience. Audio must be spatialized3D sound illusion and in line with the visual elements in the scene to ensure a realistic AR experience. So if the car object is moving away from us in the XR setting, we should also hear the vehicle sound moving away from us. If this doesn’t happen, the sense of immersion breaks.

Making an immersive sound experience is possible by incorporating numerous speakers around the listener. A full array of 50 speakers can accurately create complex soundscapes with sounds coming from all sides, but the approach is costly and not very scalable. Accurately representing a good scene over multiple speakers requires extending the strategies used in stereo recording and playback.

If we have a ...