yue xi - face musicap

Face MusiCap

Affect the acoustic virtual environment through face movement.


Unity, VRoid Studio


April 2022


Face MusiCap is an interactive music experience. It captures one's face movement to drive the movement of a virtual camera in real time, which controls the pitch, volume, and relative position of the background music in play. This project explores the experience and implication of using real-time body tracking technology to affect ambient virtual environment, which shows a lot of potential especially in the world of XR technologies.

© 2024 Yue Xi