This idea was formulated with theatre applications in mind, the intention being that actors could react to cues triggered by an audience’s interaction with a space. If a set designer were to design the space within the Unity platform, it would then be possible for a sound designer to create an immersive experience within Wwise in a similar method to game design.
The crux of this project relies on communication between the Arduino sensors and Wwise, whether this be a direct connection or by using Unity a ‘way in’. I have seen an example connecting an Arduino board directly to FMod but would prefer to use Wwise as it is a software I am more familiar with and it appears to be the more flexible option.
It might also be possible to work with a Design and Digital Media student to develop a standard asset pack of objects which could be used to design a prototype set which could then be represented in the real world.