Perceive the Spatial Flow of the Canvas —— Enhancing the Experience of Roaming Chinese Landscape Scrolls Using Augmented Audio Reality (AAR)

Traditional Chinese landscape scrolls embody the concept of ”Wandering/ Roaming”, inviting viewers to immerse themselves in compositions that convey time, movement, and spatial flow. While existing studies explore the integration of traditional aesthetic forms with novel technologies, they often treat these artworks as static, overlooking the spatial-temporal dimensions inherent in Chinese scroll paintings. This research explores how Augmented Audio Reality (AAR) can reinterpret and enhance the immersive experience of roaming scrolls.

The prototype utilizes Ultra-Wideband (UWB) sensors to track the position of the user’s headphones within a defined space, capturing real-time movement. An Inertial Measurement Unit (IMU) 1 monitors tilt and orientation, enabling sound to respond spatially and adapt to user perspective. Unity serves as the development platform, managing spatialized soundscape via the Audio-Source components, corresponding with scroll elements and user interactions.

Spatial-temporal movement analyses and soundscape heatmaps revealed that three categories of spatialized audio prompts most effectively guided attention and deepened engagement with the roaming experience. By merging AAR with traditional art, this framework reimagines cultural artifacts as multisensory, interactive encounters—bridging heritage and contemporary audiences