Sophia Kim.
Creative Direction
Experiential I Spatial I Retaill I Creative AI
Strategy
Inspired by the cultural impact of Pokémon GO, I wanted to explore how digital interaction can transform our perception of physical space. Pokémon GO demonstrated how augmented experiences could encourage people to engage with real-world environments in entirely new ways.
For Anthropic's experiential design vision, I see TouchDesigner and MediaPipe as technologies that create a new platform for interactive art and immersive storytelling. Combined with Claude's AI and coding capabilities, they enable experiences where code extends beyond the screen and becomes something people can physically interact with.
My goal is to showcase how AI-powered coding can be applied to real-world environments, allowing people to experience technology in a tangible, intuitive way. By integrating TouchDesigner and MediaPipe, we can use projection mapping to transform everyday objects and spaces, reimagining reality through gesture-based interaction.
For this concept, I envisioned a future where experiences are no longer limited by permanent installations or rented venues. Instead, any public location can become an interactive canvas. As the first proof of concept, I selected a bench and streetlight in New York City's Central Park as the designated experience zone.
When a visitor enters this defined perimeter, the environment initially appears unchanged. Once activated, however, hand gestures trigger an interactive projection-mapped experience powered by TouchDesigner and MediaPipe. Participants can control the weather, illuminate the streetlight, and dynamically transform the surrounding environment in real time. The physical world becomes a programmable interface, allowing visitors to reshape their surroundings through natural movement and AI-driven interaction.
This concept demonstrates a future in which AI, computer vision, and projection mapping seamlessly merge with public spaces, transforming ordinary locations into immersive, interactive experiences without requiring permanent physical infrastructure.
