
SENTIMENT VOICE : VR
SENTIMENTVOICE is a live VR performance art project that utilizes emotion-tracking AI technology to amplify the narratives of immigrant populations. Inspired by the pervasive use of emotional surveillance and the vulnerabilities surrounding emotion data, SentimentVoice subverts emotion AI technology, typically used for surveillance or commercial purposes, into an empathetic mediator for actively listening to the stories of immigrants. The project incorporates human voice and movement as the core material for the performance art, which is detected and analyzed by emotion AI. This analysis leverages various technologies, including face tracking, the ChatGPT API, voice analysis, and speech-to-text conversion. Emotion-tracking AI, such as lie detectors and facial recognition, has often been used to create monitored environments, frequently targeting minority populations. However, it is important to recognize that emotion data can also be harnessed to cultivate empathy, foster deep connections, and promote mutual understanding. The environments designed for this project are typical in the stories of immigrants and change colors based on perceived emotions of the viewer. Designed with minimal props for maximum exploration of the viewer in the VR space.
Exhibited in THE 2024 cyberarts initiative at the torpedo factory art center, Alexandria va
To be exhibited at SIGGRAPH 2025 in Vancouver, Canada from August 11th-14th and the Hong Kong International Media arts Festival.
FIVE ENVIRONMENTS
Click below to see a more detailed view of each environments
Or scroll to see the overview!
FIVE ENVIRONMENTS
Click below to see a more detailed view of each environments
Creative Director: Semi Ryu
Scientific Director: Alberto Cano
AI Engineer/VR Developer: Miles Popiela, Henry Bryant
3D Modeler and Texture Artist: Matthew Labella
Video Editor: Hanna Chou
Sound Artist: Chrystine Rayburn
Actors: Ryan Flores, Katherine Nguyen
Script Writer: Hanna Chou, Katherine Nguyen, Ryan Flores
Videographer: Hanna Chou, Kiara Brown, Uday Illa, Ryan Alvarado
Interviewer: Hanna Chou, Richmond Animation Archive, Menna Hassanain
Assistant AI Engineer: Ariana Thomas, Josiah Wilson
Interviewee: Hanna B, Kevin C, Tradie D, Kevin G, Maria G, Tina H. Dominica Ko, Sabrina Kim, Grace Kim, Magdalena Song, Sumaya S, Watt S, and more.
Technical diagram: Rayna Hugo
Special thanks to Noren Gelberg-Hagmaier, the VCU AAPIA student group, and everyone who shared their stories with us
Funded by Commonwealth Cyber Initiative 2024