SENTIMENT VOICE : VR

SENTIMENTVOICE is a live VR performance art project that utilizes emotion-tracking AI technology to amplify the narratives of immigrant populations. Inspired by the pervasive use of emotional surveillance and the vulnerabilities surrounding emotion data, SentimentVoice subverts emotion AI technology, typically used for surveillance or commercial purposes, into an empathetic mediator for actively listening to the stories of immigrants. The project incorporates human voice and movement as the core material for the performance art, which is detected and analyzed by emotion AI. This analysis leverages various technologies, including face tracking, the ChatGPT API, voice analysis, and speech-to-text conversion. Emotion-tracking AI, such as lie detectors and facial recognition, has often been used to create monitored environments, frequently targeting minority populations. However, it is important to recognize that emotion data can also be harnessed to cultivate empathy, foster deep connections, and promote mutual understanding. The environments designed for this project are typical in the stories of immigrants and change colors based on perceived emotions of the viewer. Designed with minimal props for maximum exploration of the viewer in the VR space.

Exhibited in THE 2024 cyberarts initiative at the torpedo factory art center, Alexandria va 

To be exhibited at SIGGRAPH 2025 in Vancouver, Canada from August 11th-14th and the Hong Kong International Media arts Festival.

FIVE ENVIRONMENTS

Click below to see a more detailed view of each environments

Or scroll to see the overview!

FIVE ENVIRONMENTS

Click below to see a more detailed view of each environments

Creative Director: Semi Ryu

Scientific Director: Alberto Cano

AI Engineer/VR Developer: Miles Popiela, Henry Bryant

3D Modeler and Texture Artist: Matthew Labella

Video Editor: Hanna Chou

Sound Artist: Chrystine Rayburn 

Actors: Ryan Flores, Katherine Nguyen

Script Writer: Hanna Chou, Katherine Nguyen, Ryan Flores

Videographer: Hanna Chou, Kiara Brown, Uday Illa, Ryan Alvarado

Interviewer: Hanna Chou, Richmond Animation Archive, Menna Hassanain ​​​​​​​

Assistant AI Engineer: Ariana Thomas, Josiah Wilson

Interviewee: Hanna B, Kevin C, Tradie D, Kevin G, Maria G, Tina H. Dominica Ko, Sabrina Kim, Grace Kim, Magdalena Song, Sumaya S, Watt S, and more.

Technical diagram: Rayna Hugo

Special thanks to Noren Gelberg-Hagmaier, the VCU AAPIA student group, and everyone who shared their stories with us

Funded by Commonwealth Cyber Initiative 2024