Augmented Reality for DAW-Based Spatial Audio Creation Using Smartphones

Most tools used to create and manipulate 3D sound are based on a 2D screen GUI and usually controlled using consumer peripherals. The main concept of this paper is to develop and analyse AR capabilities on smartphones to augment spatial audio production in a DAW. This paper describes the development of an app that sends OSC control signals to a DAW for real-time spatial panning and manipulation of sound sources. The three methods presented in this paper explore the AR framework of the native iOS system (ARKit) to control spatial audio, and are evaluated by running user tests. Results show that the use of AR to control spatial audio is a feasible option to consider in further research.

Authors: Adrià M. Cassorla (AudioLab, Department of Electronic Engineering, University of York), Gavin Kearney (AudioLab, Department of Electronic Engineering, University of York), Andy Hunt (AudioLab, Department of Electronic Engineering, University of York), Hashim Riaz (Abbey Road Studios), Mirek Stiles (Abbey Road Studios) and Damian T. Murphy (AudioLab, Department of Electronic Engineering, University of York)

https://www.aes.org/e-lib/browse.cfm?elib=20761