dancing memories
an experiment in VR, bodily performance, and motion capture
Tools
Brekel Body v3, Azure Kinect cameras, Field, HTC Vive VR headset
Timeline
2 weeks
Skills
VR design, concept design, javascript coding
Project overview
For my final project in my Virtual Reality Production class, my group explored the intersection of movement and memory through an immersive VR experience. Inspired by this video of an elderly woman with Alzheimer’s recalling a ballet routine to Swan Lake, we aimed to examine how memory can be triggered through physical movement. Our project evolved into a digital performance that immerses the viewer in the role of a ballerina, offering a deeply personal and interactive experience.
Exploring Accessibility Through VR
A key focus of our project was the potential of VR for accessibility. Virtual reality allows users to access experiences that may be out of reach due to physical, emotional, or situational limitations. With this in mind, we designed our piece to serve multiple audiences:
Non-dancers: To provide an understanding of a performer’s perspective.
Dancers or former dancers: To rekindle memories and reconnect with past experiences.
By prioritizing the performer’s experience over traditional audience-centered ballet conventions, our project invites viewers to engage with dance in an accessible and empathetic way.
Ballet as a Medium: Tradition and Transformation
We chose ballet as our focal point due to its significance within the dance community. Ballet often serves as a foundational repertoire for dancers, yet it is also one of the most demanding and ephemeral art forms. Traditionally, ballet prioritizes the viewer’s experience, with performers adhering to rigid standards that often neglect their physical and emotional well-being.
In contrast, our VR experience reimagines ballet as a personal exploration. Instead of emphasizing perfection, it celebrates the unique individuality of the performer, offering an introspective lens into the art form.
Technical Process
To bring this vision to life, we focused on the Bluebird variation from Sleeping Beauty, a milestone for many dancers when they first go en pointe. The technical steps included:
Motion Capture: Using Brekel Body v3 and two Azure Kinect cameras, we captured the choreography performed by a trained ballerina.
Data Manipulation: We processed the motion capture data to create a collection of digital dancers, each performing the variation at staggered intervals.
Live Interaction: A live-motion-captured figure of the viewer was integrated into the digital space, enabling them to interact dynamically with the virtual dancers.
This blend of digital and physical elements created a unique interplay where the geometry of the dancers preserved the essence of physical memory while existing entirely in a virtual form.
An Invitation to Interact
While initially focused on using movement to explore memory, our project evolved into an open-ended, exploratory experience. Viewers are free to decide how they interact with the virtual space:
Dance alongside the digital figures.
Weave through the ensemble of performers.
Stand still and observe the scene.
This open invitation allows each viewer to craft their own relationship with the digital memory, transforming a traditional performance into a deeply personal and immersive journey.
