In-vehicle gesture interactive spatial audio system

One embodiment of the present invention sets forth a technique for modifying an audio parameter based on a gesture. The technique includes acquiring (910) sensor data associated with a hand of a user and analyzing (920) the sensor data to determine at least one hand position. The technique further includes determining (930), based on the at least one hand position, an interaction between a first virtual object that corresponds to an audio event and a second virtual object that corresponds to the hand of the user. The technique further includes, based on the interaction, modifying (940) a spatial audio parameter associated with the audio event to generate a modified audio stream and causing the modified audio stream to be reproduced for output to the user.