yue xi - face musicap

Face MusiCap

Affect the acoustic virtual environment through face movement.

SOFTWARE

Unity, VRoid Studio

TIMELINE

April 2022

OVERVIEW

Face MusiCap is an interactive music experience. It captures one's face movement to drive the movement of a virtual camera in real time, which controls the pitch, volume, and relative position of the background music in play. This project explores the experience and implication of using real-time body tracking technology to affect ambient virtual environment, which shows a lot of potential especially in the world of XR technologies.

© 2024 Yue Xi