Interactive Audio Augmented Reality in Participatory Performance

Anna N Nagele (1) , Valentin Bauer (2) , Patrick G T Healey (1) , Joshua D Reiss (1) , Henry Cooke (3) , Tim Cowlishaw (3) , Chris Baume (3) , Chris Pike (3)

1 EECS - School of Electronic Engineering and Computer Science
2 VENISE - Virtual & augmented ENvIronments for Simulation & Experiments - LISN
3 BBC Research and Development

Interactive Audio Augmented Reality (AAR) facilitates collaborative storytelling and human interaction in participatory performance. Spatial audio enhances the auditory environment and supports real-time control of media content and the experience. Nevertheless, AAR applied to interactive performance practices remains under-explored. This study examines how audio human-computer interaction can prompt and support actions, and how AAR can contribute to developing new kinds of interactions in participatory performance.This study investigates an AAR participatory performance based on the theater and performance practice by theater maker Augusto Boal. It draws from aspects of multi-player audio-only games and interactive storytelling. A user experience study of the performance shows that people are engaged with interactive content and interact and navigate within the spatial audio content using their whole body. Asymmetric audio cues, playing distinctive content for each participant, prompt verbal and non-verbal communication. The performative aspect was well-received and participants took on roles and responsibilities within their group during the experience.

Mots clés: audio augmented reality; 3D audio; audio-only game; experience design; immersive theater; interaction design; participatory performance; interactive storytelling

Domaines: Interface homme-machine [cs.HC]; Son [cs.SD]

Anna N Nagele, Valentin Bauer, Patrick G T Healey, Joshua D Reiss, Henry Cooke, et al.. Interactive Audio Augmented Reality in Participatory Performance. Frontiers in Virtual Reality, 2021, 1 (610320), ⟨10.3389/frvir.2020.610320⟩. ⟨hal-04447862⟩